1 ENTSO-E TRANSPARENCY PLATFORM DATA EXTRACTION PROCESS IMPLEMENTATION GUIDE 2016-07-15 DRAFT VERSION 0.3
2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 Table of Cotets 1 Objective... 5 2 Request for published trasparecy iformatio - use case ad process sequece... 5 3 Cotextual ad assembly models... 6 4 Request iterfaces... 6 5 Cotet of the request... 6 6 Format ad cotet of the respose... 8 7 Status Request Documet depedecy tables... 8 7.1 Load trasparecy data... 8 7.2 Network ad cogestio maagemet trasparecy data... 9 7.3 Trasmissio trasparecy data... 10 7.4 Geeratio trasparecy data... 13 7.5 Balacig trasparecy data... 14 7.6 Outages trasparecy data... 16 List of figures Figure 1 Use case... 5 Figure 2 Sequece diagram... 6 Figure 3 example of Status Request Documet... 7 List of tables Table 1 Depedecy table for requestig Load data... 8 Table 2 - Depedecy table for requestig Network ad Cogestio Maagemet data... 9 Table 3 - Depedecy table for requestig Trasmissio data... 12 Table 4 Depedecy table for requestig Geeratio data... 13 Table 5 Depedecy table for requestig Balacig data... 15 Table 6 Depedecy table for requestig Outages data... 16 Page 2 of 16
28 29 30 31 32 33 34 35 36 37 38 39 40 41 Copyright otice: Copyright ENTSO-E. All Rights Reserved. This documet ad its whole traslatios may be copied ad furished to others, ad derivative works that commet o or otherwise explai it or assist i its implemetatio may be prepared, copied, published ad distributed, i whole or i part, without restrictio of ay kid, provided that the above copyright otice ad this paragraph are icluded o all such copies ad derivative works. However, this documet itself may ot be modified i ay way, except for literal ad whole traslatio ito laguages other tha Eglish ad uder all circumstaces, the copyright otice or refereces to ENTSO-E may ot be removed. This documet ad the iformatio cotaied herei is provided o a "as is" basis. ENTSO-E DISCLAIMS ALL WARRANTIES, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTY THAT THE USE OF THE INFORMATION HEREIN WILL NOT INFRINGE ANY RIGHTS OR ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. 42 43 44 Maiteace otice: This documet is maitaied by the ENTSO-E WG EDI. Commets or remarks are to be provided at EDI.Library@etsoe.eu Page 3 of 16
45 Revisio History Versio Release Date Commets 0 1 2016-04-11 First draftig of the documet based o the maiteace request EMFIP27 from WG MIT to comply with the trasparecy regulatio (EU N 543/2013). 0 2 2016-06-14 Editorial amedmets. 46 0 3 2016-07-15 Editorial amedmets. Page 4 of 16
47 48 49 50 51 52 53 54 55 56 57 58 59 1 Objective The objective of this documet is to eable the data cosumers to query iformatio published i accordace with trasparecy regulatio (EU N 2013/543) o the ENTSO-E cetral trasparecy platform. This documet provides the busiess cotext ad i particular the depedecy table to be applied to the xsd schema for the Status Request Documet as per the CIM based stadard IEC 62325-451-5. 2 Request for published trasparecy iformatio - use case ad process sequece The cetral trasparecy platform allows data cosumers to perform machie-to-machie queries for all structured data published uder the trasparecy regulatio sice Jauary 5, 2015. Reports i PDF formats are oly available for dowload via the web site though. Figure 1 displays the use case with the ivolved actors. uc Request published trasparecy data - use case Data Cosumer Request published trasparecy data Market Iformatio Aggregator 60 61 62 63 Figure 1 Use case Figure 2 displays the sequece diagram ad i particular the exchage betwee data cosumer ad market iformatio aggregator. class Request published trasparecy data - sequece diagram :Data Cosumer Query is formulated i a Status Request Documet. request published trasparecy data() reply with requested data() :Market Iformatio Aggregator Data providers submit trasparecy data to market iformatio aggregator usig the followig documets: - Geeratio ad Load Market documet - Trasmissio Network Market documet - Publicatio Market documet - Balacig Market documet - Uavailability Market documet - Critical Network Elemet Documet - Cofiguratio Market documet. Respose provided i oe of the followig documets: - Geeratio ad Load Market documet - Trasmissio Network Market documet - Publicatio Market documet - Balacig Market documet - Uavailability Market documet - Critical Network Elemet Documet. If o published data is matchig the query, the query is icorrectly formatted or the requested data exceeds the iterface's techical limits, the Market Iformatio Aggregator will respod with a Ackowledgemet Documet. 64 Page 5 of 16
65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 Figure 2 Sequece diagram Data cosumer requests published trasparecy data by submittig a Status Request Documet with some selectio criteria. Market Iformatio Aggregator respods to the request with a documet cotaiig the requested data. The market iformatio aggregator will respod with a egative ackowledgemet documet if the request cotais errors (ot all madatory attributes icluded, for example) or if o data matchig the selectio criteria is available. Likewise, the market iformatio aggregator will respod with a egative ackowledgemet documet if the data volumes to be retured would exceed the techical limits imposed o the chael for the data exchage. 3 Cotextual ad assembly models The cotextual ad assembly models for the Status Request Documet are provided by the CIM stadard IEC 62325-451-5. The CIM compliat XSD is provided o the ENTSO-E web site. The ENTSO-E Status Request Documet implemetatio guide v3, also available o the ENTSO-E web site, serves as a geeric referece for the cocepts. Cotextual ad assembly models for the respose to the request are provided with documets described i IEC 62325-451-6. The correspodig XSDs may also be foud o the ENTSO-E web site. The cetral trasparecy platform provides data cosumers with a o-lie user maual for machie-to-machie data extractios. The maual cotais for each Trasparecy Regulatio article a example of how to query the iterface ad the platform s respose to the request. 4 Request iterfaces Status request documets may be lodged to the cetral trasparecy platform via the chaels implemeted accordig to the MADES (IEC 62325-503) ad web services (IEC 62325-504) stadards. The respose will be served via the same chael as the request. Additioally, a public web API has bee implemeted based o the https protocol. 5 Cotet of the request A Status Request Documet cotais a list of key-value pairs. Each key-value pair cosists of the fields attribute ad attributevalue. These pairs of attribute ad attributevalue will capture the selectio criteria for the published trasparecy data. For example, a Data Cosumer requests the data published uder article 6.1.a (Actual Total Load) of the Trasparecy Regulatio. The correspodig Status Request Documet would cotai the attribute DocumetType with the value A65, a attribute ProcessType with value A16, a attribute BusiessType with value A04 ad the attributes OutBiddigZoe_Domai ad TimeIterval to idicate the biddig zoe ad the time iterval, respectively. The example i the figure below shows how a Status Request Documet is used to extract data published uder trasparecy regulatio articles 15.1.a&b (plaed uavailabilities ad chages i actual availability of uits) for the Natioal Grid cotrol area durig the moth of April 2016: 104 Page 6 of 16
105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 <StatusRequest_MarketDocumet xmls="ur:iec62325.351:tc57wg16:451-5:statusrequestdocumet:4:0"> <mrid>samplerequest</mrid> <type>a59</type> <seder_marketparticipat.mrid codigscheme="a01">10v000000000008f</seder_marketparticipat.mrid> <seder_marketparticipat.marketrole.type>a07</seder_marketparticipat.marketrole.type> <receiver_marketparticipat.mrid codigscheme="a01">10x1001a1001a450</receiver_marketparticipat.mrid> <receiver_marketparticipat.marketrole.type>a32</receiver_marketparticipat.marketrole.type> <createddatetime>2016-05-27t13:00:00z</createddatetime> <AttributeIstaceCompoet> <attribute>documettype</attribute> <attributevalue>a80</attributevalue> </AttributeIstaceCompoet> <AttributeIstaceCompoet> <attribute>biddigzoe_domai</attribute> <attributevalue>10ygb----------a</attributevalue> </AttributeIstaceCompoet> <AttributeIstaceCompoet> <attribute>timeiterval</attribute> <attributevalue>2016-03-31t23:00z/2016-04-30t23:00z</attributevalue> </AttributeIstaceCompoet> </StatusRequest_MarketDocumet> Disclaimer: The example above is for illustratio purposes oly. It is highly recommeded that implemetatio of ay solutio for queryig the Cetral Trasparecy Platform shall be based solely upo the CIM stadard IEC 62325-451-5 for the Status Request Documet. Figure 3 example of Status Request Documet As a geeral rule, a give attribute may ot be used more tha oe time i the Status Request Documet. This meas that if data cosumer for example wats to query data for article 6.1.a Actual Total Load for both Belgia ad Frech biddig zoes, two separate Status Request Documets have to be submitted. The attributes OutBiddigZoe_Domai, I_Domai, Out_Domai, BiddigZoe, Acquirig_Domai, Coectig_Domai ad CotrolArea are used to specify a area. I the specific case of trasparecy regulatio article 12.1.e, I_Domai ad Out_Domai may refer to a border. The attribute value shall cotai the EIC code of the area (or border i the case of article 12.1.e). EIC codes for areas ad borders ca be foud o the ENTSO-E website. Data cosumer may query ay area or border for which the cetral trasparecy platform publishes data. For example, actual total load (regulatio article 6.1.a) is published for the biddig zoe comprisig Germay, Austria ad Luxemburg. No data is published o the level of the sychroous zoe of Cotietal Europe though. Hece, a query for the latter would yield a egative ackowledgemet respose. Whe queries are submitted via the iterfaces based o MADES (IEC 62325-503) ad web services (IEC 62325-504), there should i priciple be o costraits o the time iterval for which data is requested. Actual techical implemetatio of the iterface may have to impose limits i order to preserve availability ad reasoable respose times i the iterest of all data cosumers. Ay such costraits will be described i the o-lie user maual. I geeral, the public web API based o https ca support queries with a time iterval up to oe year. Due to techical limitatios of this iterface, tighter costraits o the permitted time iterval may apply for select trasparecy regulatio articles please refer to the o-lie user maual for details. The order of attributes withi the Status Request Documet is ot sigificat. Page 7 of 16
145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 6 Format ad cotet of the respose The market iformatio aggregator respods with oe of the documets described i the implemetatio guides for Geeratio ad Load, Trasmissio, Flow-based parameters, Balacig or Outages. The type of documet used i the respose depeds o the type of data beig requested. The format of the respose will be accordig to the dowload scearios described i the before-metioed implemetatio guides. Time graularity of the data i the respose will be the same as for the data published o the cetral trasparecy platform. 7 Status Request Documet depedecy tables The depedecy tables i this sectio idicate for each article of the Trasparecy Regulatio which attributes must or may be used withi the Status Request Documet i order to request the published data. For each category of data (Load, Geeratio, etc.), the sectios below explai what type of documet the market iformatio aggregator will retur. 7.1 Load trasparecy data Table 1 below is the depedecy matrix that applies to requests for published Load trasparecy data. attribute DocumetType ProcessType Art. 6.1.a Actual total load A65: total load A16: realised Art. 6.1.b Day-ahead total load A65: total load A01: dayahead Art. 6.1.c Week-ahead total load A65: total load A31: weekahead Art. 6.1.d Mothahead total load A65: total load A32: mothahead Art. 6.1.e Year-ahead total load A65: total load A33: yearahead Art. 8 Yearahead margi A70: load margi A33: yearahead OutBiddigZoe _Domai Used Used Used Used Used Used TimeIterval Used Used Used Used Used Used Table 1 Depedecy table for requestig Load data The market iformatio aggregator will respod with a Geeratio ad Load Market documet cotaiig the requested data. 165 Page 8 of 16
166 167 168 7.2 Network ad cogestio maagemet trasparecy data Table 2 below is the depedecy matrix that applies to requests for published etwork ad cogestio maagemet trasparecy data. 169 attribute Art. 9.1 Expasio ad dismatlig projects DocumetType A90 itercoector etwork expasio Art. 13.1.a Redispatch A63 redispatch mode Art. 13.1.b Coutertradig A91 coutertrade otice DocStatus May be used Not Used Not Used Not Used BusiessType May be used B01 itercoector etwork evolutio B02 itercoector etwork dismatlig May be Used A46: system operator redispatchig A85: iteral requiremets Not Used Art. 13.1.c Cogestio costs A92 cogestio costs May be Used B04: cogestio costs B03: coutertrade A46: system operator redispatch I_Domai Used Used Used Used, same as Out domai Out_Domai Used Used Used Used, same as I domai TimeIterval Used Used Used Used Table 2 - Depedecy table for requestig Network ad Cogestio Maagemet data 170 171 The market iformatio aggregator will respod with a Trasmissio Network Market documet cotaiig the requested data. 172 Page 9 of 16
173 174 175 176 177 178 7.3 Trasmissio trasparecy data Table 3 below is the depedecy matrix that applies to requests for published Trasmissio trasparecy data. attribute DocumetType Art. 11.1.a ed A61: estimated Art. 11.1.a offered A31: agreed Art. 11.1.b flow-based B11: Aoymized flow based parameters publicatio ProcessType Not used Not used A01 Day ahead Art. 11.3 Itraday trasfer limits A93: DC lik Not used A02 Itraday Auctio.Type Not used Used Not used Not used Auctio. Not used May be used Not used Not used Category BusiessType Not used Not used Not used Not used I_Domai Used Used Used, same Used as Out domai Out_Domai Used Used Used, same Used as I domai Cotract_Market Used Used Not used Not used Agreemet.Type ClassificatioSeq uece_attributei stacecompoe t.positio Not used May be used Not used Not used TimeIterval Used Used Used Used Note: For article 11.1.a ed, Cotract Type is used to distiguish betwee day-ahead, week-ahead, moth-ahead ad year-ahead s. 179 Page 10 of 16
180 attribute DocumetType Art. 12.1.a Explicit allocatio iformatio () A25: allocatio results Art. 12.1.a Explicit allocatio iformatio (reveue oly) A25: allocatio results Art. 12.1.b Total omiated A26: documet Art. 12.1.c Total already allocated A26: documet ProcessType Not used Not used Not used Not used Auctio.Type Not used Not used Not used Not used Auctio.Category May be used Not used Not used May be used BusiessType A43 requested B05 allocated (with price) B07 auctio reveue B08 total omiated A29 AAC I_Domai Used Used Used Used Out_Domai Used Used Used Used Cotract_Market Used Used Not used Used Agreemet.Type ClassificatioSequ May be used Not used Not used Not used ece_attributeis tacecompoet. Positio TimeIterval Used Used Used Used 181 182 Page 11 of 16
183 attribute DocumetType Art. 12.1.d Day ahead prices A44: price documet Art. 12.1.e Implicit auctio et positios ad cogestio icome A25: allocatio results Art. 12.1.f Schedule day ahead commercial exchages A09: fialised schedule Art. 12.1.g Physical flows A11: aggregated eergy data report Art. 12.1.h Capacity allocated outside EU A94: o EU allocatio ProcessType Not used Not used Not used Not used Not used Auctio.Type Not used Not used Not used Not used Used Auctio.Category Not used Not used Not used Not used Not used BusiessType Not used B09 et Not used Not used Not used positio B10 cogestio icome I_Domai Used, same Used Used Used Used as Out domai Out_Domai Used, same Used Used Used Used as I domai Cotract_Market Not used Used Not used Not used Used Agreemet.Type ClassificatioSequ Not used Not used Not used Not used Not used ece_attributeis tacecompoet. Positio TimeIterval Used Used Used Used Used 184 185 186 187 Table 3 - Depedecy table for requestig Trasmissio data The market iformatio aggregator will respod with a Publicatio Market documet cotaiig the requested data, except for article 11.1.b which will yield a Critical Network Elemet Documet. 188 Page 12 of 16
189 190 191 192 193 194 195 7.4 Geeratio trasparecy data Table 4 below is the depedecy matrix that applies to requests for published Geeratio trasparecy data. attribute DocumetTy pe ProcessType Art. 14.1.a Istalled aggregated A68: istalled per type A33: year ahead Art. 14.1.b Istalled per uit A71: A33: year ahead Art. 14.1.c Dayahead aggrega ted geerati o A71: geerati o A01: dayahead Art. 14.1.d Dayahead s for wid ad solar A69: wid ad solar A01: dayahead Art. 16.1.a Actual output per uit A73: actual A16: realised Art. 16.1.b&c Aggregate d per type A75: actual per type A74: wid ad solar A16: realised Art. 16.1.d Aggregate d fillig rate of water reservoirs ad hydro storage plats A72: reservoir filig A16: realised I_ Domai Used Used Used Used Used Used Used PsrType May be May be Not May be May be May be Not Used used used Used used used used TimeIterval Used Used Used Used Used Used Used Table 4 Depedecy table for requestig Geeratio data The market iformatio aggregator will respod with a Geeratio ad Load Market documet cotaiig the requested data. 196 Page 13 of 16
197 198 199 7.5 Balacig trasparecy data Table 5 below is the depedecy matrix that applies to requests for published Balacig trasparecy data. attribute Art. 17.1.b Amout of balacig reserves uder cotract Art. 17.1.c Prices of procured balacig reserves Art. 17.1.d Accepted aggregated offers Art. 17.1.e Activated balacig eergy Art. 17.1.f Prices of activated balacig eergy DocumetType A81 cotracted reserve A89 cotracted reserve price A82 accepted offer A83 activated balacig quatities A84 activated balacig price CotrolArea_Do mai Used Used Used Used Used BusiessType May be Used A95: FCR A96: affr A97: mfrr A98: RR May be Used A95: FCR A96: affr A97: mfrr A98: RR May be Used A95: FCR A96: affr A97: mfrr A98: RR May be Used A95: FCR A96: affr A97: mfrr A98: RR May be Used A95: FCR A96: affr A97: mfrr A98: RR Acquirig_ Not Used Not Used Not Used Not Used Not Used Domai Coectig_Do Not Used Not Used Not Used Not Used Not Used mai Type_MarketAg Used Used Not Used Not Used Not Used reemet.type PsrType May be used May be used May be used May be used May be used TimeIterval Used Used Used Used Used 200 201 Page 14 of 16
202 attribute Art. 17.1.g Imbalace prices DocumetType A85: imbalace prices Art. 17.1.h Total imbalace volumes A86: imbalace volume Art. 17.1.i Fiacial expeses ad icome for balacig A87: fiacial situatio Art. 17.1.j Cross-border balacig A88 cross-border balacig CotrolArea_Domai Used Used Used Not Used BusiessType Not Used Not Used Not Used Not Used 203 Acquirig_ Not Used Not Used Not Used Used Domai Coectig_Domai Not Used Not Used Not Used Used Type_MarketAgreem Not Used Not Used Not Used Not Used et.type PsrType Not Used Not Used Not Used Not Used TimeIterval Used Used Used Used Table 5 Depedecy table for requestig Balacig data 204 205 The market iformatio aggregator will respod with a Balacig Market documet cotaiig the requested data. 206 Page 15 of 16
207 208 209 7.6 Outages trasparecy data Table 6 below is the depedecy matrix that applies to requests for published Outage trasparecy data. 210 attribute DocumetType Art. 7.1.a&b Uavailability of cosumptio uits A76: load uavailability Art. 15.1.a&b Uavailability of uits A80: uavailability Art. 15.1c&d Uavailability of productio uits A77: productio uavailability Art. 10.1.a&b Uavailability of trasmissio ifrastructure A78: trasmissio uavailability Art. 10.1.c Uavailability of offshore grid ifrastructure A79: offshore grid ifrastructure uavailability DocStatus Not used may be used may be used may be used may be used BusiessType May be used A53: plaed maiteace A54: forced uavailability May be used A53: plaed maiteace A54: forced uavailability May be used A53: plaed maiteace A54: forced uavailability May be used A53: plaed maiteace A54: forced uavailability Not Used BiddigZoe_D Used Used Used Not Used Used omai I_Domai Not Used Not Used Not Used Used Not Used Out_Domai Not Used Not Used Not Used Used Not Used TimeIterval Used Used Used Used Used Table 6 Depedecy table for requestig Outages data 211 212 The market iformatio aggregator will respod with a Uavailability Market documet cotaiig the requested data. 213 Page 16 of 16