Skip to content

Instantly share code, notes, and snippets.

Embed
What would you like to do?
EIA to FERC1 Entity Matching Example
capacity_factor capacity_mw fuel_cost_per_mmbtu fuel_type_code_pudl heat_rate_mmbtu_mwh installation_year net_generation_mwh plant_id_pudl plant_name report_date total_fuel_cost total_mmbtu utility_id_pudl
0.5540409056538725 2569.5 3.008543250719239 8.80157206926361 12470807.018 32 Barry 2019-01-01 300575542.6785368 100290009.68900001 18
272.0 coal 32 Barry 2019-01-01 18
0.06607603800177611 153.1 2.878531157145114 gas 88618.27482231004 32 Barry 1 2019-01-01 1190545.6621597596 413594.8499999999 18
0.05667240289547967 153.1 2.878531157145114 gas 76006.53317768994 32 Barry 2 2019-01-01 966892.1159616909 335897.74199999997 18
0.13828147519597636 403.7 3.1586704229218143 coal 11.100510077642642 489020.2682607532 32 Barry 4 2019-01-01 17146445.71236468 5428374.416 18
0.5334216620789289 788.8 3.1586704229218143 coal 10.040013142556504 3685883.941739246 32 Barry 5 2019-01-01 116890778.60662277 37006323.217 18
0.8719241620228464 535.4 2.878531157145114 gas 7.094328251595888 4089415.0 32 Barry 6 2019-01-01 83510945.2586723 29011652.367 18
0.8617853676592246 535.4 2.878531157145114 gas 6.9507964760309795 4041863.0 32 Barry 7 2019-01-01 80869935.3227556 28094167.097000003 18
0.8260135372220975 390.4 2.878531157145114 gas 7.022562363813433 2824887.0 32 Barry CA 2019-01-01 57103996.67986931 19837894.246211402 18
0.8902886497064579 680.4 2.878531157145114 gas 7.022562363813433 5306391.0 32 Barry CT 2019-01-01 107276883.9015586 37267925.2177886 18
0.3305398177659603 1498.6999999999998 3.101435056817307 10.399025815675392 4339529.017999999 32 Barry ST 2019-01-01 136194662.0971089 43184190.225 18
0.3996538688339411 1192.5 3.1586704229218143 coal 10.399025815675392 4174904.209999999 32 Barry Conventional Steam Coal 2019-01-01 134037224.31898746 42434697.633 18
0.8668547648410355 1070.8 2.878531157145114 gas 7.022562363813434 8131278.0 32 Barry Natural Gas Fired Combined Cycle 2019-01-01 164380880.5814279 57105819.464 18
0.061374220448627885 306.2 2.878531157145114 gas 164624.80799999996 32 Barry Natural Gas Steam Turbine 2019-01-01 2157437.7781214505 749492.592 18
0.6877420976711334 1377.0 2.878531157145114 gas 7.022562363813434 8295902.808 32 Barry NG 2019-01-01 166538318.35954934 57855312.056 18
0.8992527897905879 170.1 2.878531157145114 gas 7.094328251595888 1339955.0 32 Barry A1CT 2019-01-01 27363549.225031998 9506080.612367168 18
0.8975186500554334 170.1 2.878531157145114 gas 7.094328251595888 1337371.0 32 Barry A1CT2 2019-01-01 27310780.72818137 9487748.868165044 18
0.8258062214611872 195.2 2.878531157145114 gas 7.094328251595888 1412089.0 32 Barry A1ST 2019-01-01 28836615.305458922 10017822.886467787 18
0.879242401058738 170.1 2.878531157145114 gas 6.9507964760309795 1310138.0 32 Barry A2C1 2019-01-01 26213351.44805363 9106502.593514275 18
0.8851407579210725 170.1 2.878531157145114 gas 6.9507964760309795 1318927.0 32 Barry A2C2 2019-01-01 26389202.500291597 9167593.143742112 18
0.8262208529830077 195.2 2.878531157145114 gas 6.950796476030979 1412798.0 32 Barry A2ST 2019-01-01 28267381.374410383 9820071.359743616 18
2569.5 32 Barry 2020-01-01 18
774.0 gas 32 Barry 2020-01-01 18
272.0 coal 32 Barry 2020-01-01 18
390.4 gas 32 Barry CA 2020-01-01 18
310.0 gas 32 Barry CA 2020-01-01 18
680.4 gas 32 Barry CT 2020-01-01 18
464.0 gas 32 Barry CT 2020-01-01 18
1498.6999999999998 32 Barry ST 2020-01-01 18
1192.5 coal 32 Barry Conventional Steam Coal 2020-01-01 18
1070.8 gas 32 Barry Natural Gas Fired Combined Cycle 2020-01-01 18
306.2 gas 1954 32 Barry Natural Gas Steam Turbine 2020-01-01 18
1377.0 gas 32 Barry NG 2020-01-01 18
153.1 gas 32 Barry 1 2020-01-01 18
153.1 gas 32 Barry 2 2020-01-01 18
403.7 coal 32 Barry 4 2020-01-01 18
788.8 coal 32 Barry 5 2020-01-01 18
170.1 gas 32 Barry A1CT 2020-01-01 18
170.1 gas 32 Barry A1CT2 2020-01-01 18
195.2 gas 32 Barry A1ST 2020-01-01 18
170.1 gas 32 Barry A2C1 2020-01-01 18
170.1 gas 32 Barry A2C2 2020-01-01 18
195.2 gas 32 Barry A2ST 2020-01-01 18
2664.6 32 Barry 2001-01-01 18
383.6 other 32 Barry CA 2001-01-01 18
510.29999999999995 gas 32 Barry CT 2001-01-01 18
1770.6999999999998 coal 1971 32 Barry ST 2001-01-01 18
153.1 coal 32 Barry 1 2001-01-01 18
153.1 coal 32 Barry 2 2001-01-01 18
272.0 coal 32 Barry 3 2001-01-01 18
403.7 coal 32 Barry 4 2001-01-01 18
788.8 coal 1971 32 Barry 5 2001-01-01 18
170.1 gas 32 Barry A1CT 2001-01-01 18
191.8 other 32 Barry A1ST 2001-01-01 18
170.1 gas 32 Barry A2C1 2001-01-01 18
170.1 gas 32 Barry A2C2 2001-01-01 18
191.8 other 32 Barry A2ST 2001-01-01 18
2664.6 2000 32 Barry 2002-01-01 18
383.6 gas 2000 32 Barry CA 2002-01-01 18
510.29999999999995 gas 2000 32 Barry CT 2002-01-01 18
1770.6999999999998 coal 32 Barry ST 2002-01-01 18
893.9 gas 2000 32 Barry NG 2002-01-01 18
153.1 coal 32 Barry 1 2002-01-01 18
153.1 coal 32 Barry 2 2002-01-01 18
272.0 coal 32 Barry 3 2002-01-01 18
403.7 coal 32 Barry 4 2002-01-01 18
788.8 coal 32 Barry 5 2002-01-01 18
170.1 gas 2000 32 Barry A1CT 2002-01-01 18
191.8 gas 2000 32 Barry A1ST 2002-01-01 18
170.1 gas 2000 32 Barry A2C1 2002-01-01 18
170.1 gas 2000 32 Barry A2C2 2002-01-01 18
191.8 gas 2000 32 Barry A2ST 2002-01-01 18
0.6347540919555121 2664.6 14816364.0 32 Barry 2003-01-01 18
0.0 383.6 gas 0.0 32 Barry CA 2003-01-01 18
0.7626076343309559 510.29999999999995 gas 3409030.0000000005 32 Barry CT 2003-01-01 18
0.7354193695293223 1770.6999999999998 coal 11407334.0 32 Barry ST 2003-01-01 18
0.4353492289955105 893.9 gas 3409030.0000000005 32 Barry NG 2003-01-01 18
0.7354193695293222 153.1 coal 1954 986312.0999604677 32 Barry 1 2003-01-01 18
0.7354193695293222 153.1 coal 1954 986312.0999604677 32 Barry 2 2003-01-01 18
0.7354193695293222 272.0 coal 1752298.4401649067 32 Barry 3 2003-01-01 18
0.7354193695293222 403.7 coal 2600745.883435929 32 Barry 4 2003-01-01 18
0.7354193695293222 788.8 coal 5081665.476478229 32 Barry 5 2003-01-01 18
0.7626076343309559 170.1 gas 1136343.3333333335 32 Barry A1CT 2003-01-01 18
0.0 191.8 gas 0.0 32 Barry A1ST 2003-01-01 18
0.7626076343309559 170.1 gas 1136343.3333333335 32 Barry A2C1 2003-01-01 18
0.7626076343309559 170.1 gas 1136343.3333333335 32 Barry A2C2 2003-01-01 18
0.0 191.8 gas 0.0 32 Barry A2ST 2003-01-01 18
0.6167403969633845 2664.6 14435331.000000002 32 Barry 2004-01-01 18
0.008226933128961368 383.6 gas 27721.0 32 Barry CA 2004-01-01 18
0.7810581974887447 510.29999999999995 gas 3501074.0 32 Barry CT 2004-01-01 18
0.701212295714609 1770.6999999999998 coal 10906536.0 32 Barry ST 2004-01-01 18
0.4494125178731133 893.9 gas 3528795.0 32 Barry NG 2004-01-01 18
0.701212295714609 153.1 coal 943011.6121307958 32 Barry 1 2004-01-01 18
0.701212295714609 153.1 coal 943011.6121307958 32 Barry 2 2004-01-01 18
0.701212295714609 272.0 coal 1675370.075111538 32 Barry 3 2004-01-01 18
0.701212295714609 403.7 coal 2486569.4828034113 32 Barry 4 2004-01-01 18
0.701212295714609 788.8 coal 4858573.21782346 32 Barry 5 2004-01-01 18
0.7810581974887447 170.1 gas 1167024.6666666667 32 Barry A1CT 2004-01-01 18
0.008226933128961368 191.8 gas 13860.5 32 Barry A1ST 2004-01-01 18
0.7810581974887447 170.1 gas 1167024.6666666667 32 Barry A2C1 2004-01-01 18
0.7810581974887447 170.1 gas 1167024.6666666667 32 Barry A2C2 2004-01-01 18
0.008226933128961368 191.8 gas 13860.5 32 Barry A2ST 2004-01-01 18
0.6239471171547217 2671.4 14601276.000000002 32 Barry 2005-01-01 18
0.0042767282356463805 390.4 gas 14626.0 32 Barry CA 2005-01-01 18
0.647238798557926 510.29999999999995 gas 2893305.0000000005 32 Barry CT 2005-01-01 18
0.7538582115320593 1770.6999999999998 coal 11693345.0 32 Barry ST 2005-01-01 18
0.3685528961999623 900.6999999999999 gas 2907931.0000000005 32 Barry NG 2005-01-01 18
0.7538582115320593 153.1 coal 1011041.4635454905 32 Barry 1 2005-01-01 18
0.7538582115320593 153.1 coal 1011041.4635454905 32 Barry 2 2005-01-01 18
0.7538582115320593 272.0 coal 1796233.0377816684 32 Barry 3 2005-01-01 18
0.7538582115320593 403.7 coal 2665953.225560513 32 Barry 4 2005-01-01 18
0.7538582115320593 788.8 coal 5209075.809566839 32 Barry 5 2005-01-01 18
0.647238798557926 170.1 gas 964435.0000000001 32 Barry A1CT 2005-01-01 18
0.0042767282356463805 195.2 gas 7313.0 32 Barry A1ST 2005-01-01 18
0.647238798557926 170.1 gas 964435.0000000001 32 Barry A2C1 2005-01-01 18
0.647238798557926 170.1 gas 964435.0000000001 32 Barry A2C2 2005-01-01 18
0.0042767282356463805 195.2 gas 7313.0 32 Barry A2ST 2005-01-01 18
0.6255797073208754 2671.4 14639481.000000002 32 Barry 2006-01-01 18
0.0 390.4 gas 0.0 32 Barry CA 2006-01-01 18
0.7698904843332377 510.29999999999995 gas 3441586.0000000005 32 Barry CT 2006-01-01 18
0.7219170474850258 1770.6999999999998 coal 11197895.0 32 Barry ST 2006-01-01 18
0.43618864678056096 900.6999999999999 gas 3441586.0000000005 32 Barry NG 2006-01-01 18
0.7219170474850257 153.1 coal 968203.3797368272 32 Barry 1 2006-01-01 18
0.7219170474850257 153.1 coal 968203.3797368272 32 Barry 2 2006-01-01 18
0.7219170474850259 272.0 coal 1720126.1873835209 32 Barry 3 2006-01-01 18
0.7219170474850257 403.7 coal 2552996.109730615 32 Barry 4 2006-01-01 18
0.7219170474850259 788.8 coal 4988365.943412211 32 Barry 5 2006-01-01 18
0.7698904843332377 170.1 gas 1147195.3333333335 32 Barry A1CT 2006-01-01 18
0.0 195.2 gas 0.0 32 Barry A1ST 2006-01-01 18
0.7698904843332377 170.1 gas 1147195.3333333335 32 Barry A2C1 2006-01-01 18
0.7698904843332377 170.1 gas 1147195.3333333335 32 Barry A2C2 2006-01-01 18
0.0 195.2 gas 0.0 32 Barry A2ST 2006-01-01 18
0.6474950883414815 2671.4 15152332.999999998 32 Barry 2007-01-01 18
0.0 390.4 gas 0.0 32 Barry CA 2007-01-01 18
0.9131037611504381 510.29999999999995 gas 4081782.000000001 32 Barry CT 2007-01-01 18
0.7137073076638422 1770.6999999999998 coal 11070550.999999998 32 Barry ST 2007-01-01 18
0.5173274667648148 900.6999999999999 gas 4081782.000000001 32 Barry NG 2007-01-01 18
0.713707307663842 153.1 coal 957192.8379172077 32 Barry 1 2007-01-01 18
0.713707307663842 153.1 coal 957192.8379172077 32 Barry 2 2007-01-01 18
0.713707307663842 272.0 coal 1700564.6761167897 32 Barry 3 2007-01-01 18
0.7137073076638419 403.7 coal 2523963.087310103 32 Barry 4 2007-01-01 18
0.713707307663842 788.8 coal 4931637.56073869 32 Barry 5 2007-01-01 18
0.9131037611504381 170.1 gas 1360594.0000000002 32 Barry A1CT 2007-01-01 18
0.0 195.2 gas 0.0 32 Barry A1ST 2007-01-01 18
0.9131037611504381 170.1 gas 1360594.0000000002 32 Barry A2C1 2007-01-01 18
0.9131037611504381 170.1 gas 1360594.0000000002 32 Barry A2C2 2007-01-01 18
0.0 195.2 gas 0.0 32 Barry A2ST 2007-01-01 18
0.5977842198949325 2671.4 14027352.000000002 32 Barry 2008-01-01 18
0.4692051984420258 390.4 gas 1609033.0 32 Barry CA 2008-01-01 18
0.6376376605496893 510.29999999999995 gas 2858195.0 32 Barry CT 2008-01-01 18
0.6146476293991356 1770.6999999999998 coal 9560124.000000002 32 Barry ST 2008-01-01 18
0.5646321834687168 900.6999999999999 gas 4467228.0 32 Barry NG 2008-01-01 18
0.6498938453503136 153.1 coal 873997.0000000002 32 Barry 1 2008-01-01 18
0.6049127086954609 153.1 coal 813505.0000000001 32 Barry 2 2008-01-01 18
0.6106059312386157 272.0 coal 1959 1458889.0000000002 32 Barry 3 2008-01-01 18
0.6896656744782891 403.7 coal 2445624.0000000005 32 Barry 4 2008-01-01 18
0.5726962827951985 788.8 coal 3968109.0000000005 32 Barry 5 2008-01-01 18
0.6376376605496893 170.1 gas 952731.6666666667 32 Barry A1CT 2008-01-01 18
0.48412293495625436 195.2 gas 830095.0 32 Barry A1ST 2008-01-01 18
0.6376376605496893 170.1 gas 952731.6666666667 32 Barry A2C1 2008-01-01 18
0.6376376605496893 170.1 gas 952731.6666666667 32 Barry A2C2 2008-01-01 18
0.45428746192779723 195.2 gas 778938.0 32 Barry A2ST 2008-01-01 18
0.5659313164231703 2841.5 3.603412071854142 10.015808661827393 14086902.0 32 Barry 2009-01-01 277242350.2317061 80578544.37900001 18
0.1654602447440864 153.1 3.437065039544713 coal 10.284149363700273 221907.99999999997 32 Barry 1 2009-01-01 7843846.482451479 2282135.017 18
0.2937995281682369 153.1 3.437065039544713 coal 10.271085739446898 394030.99999999994 32 Barry 2 2009-01-01 13910235.921089469 4047126.185 18
0.5398842499328498 272.0 3.437065039544713 coal 10.15707324200303 1286392.9999999998 32 Barry 3 2009-01-01 44908650.28350848 13065987.919000002 18
0.45994273291686605 403.7 3.437065039544713 coal 9.93560621488343 1626547.0 32 Barry 4 2009-01-01 55545481.75318677 16160730.481999999 18
0.6531366354997359 788.8 3.437065039544713 coal 9.906513377830457 4513100.999999999 32 Barry 5 2009-01-01 153668068.85899544 44709095.432000004 18
0.6565663831499364 195.2 4.357896421521934 gas 1122697.0 32 Barry 6 2009-01-01 767327.9952449274 176077.61199999996 18
0.604539191743394 195.2 4.357896421521934 gas 1033733.0 32 Barry 7 2009-01-01 598738.9372295006 137391.73200000002 18
0.6305527874466652 390.4 4.357896421521934 gas 2156430.0 32 Barry CA 2009-01-01 1366066.9324744279 313469.344 18
0.6523982669340356 680.4 gas 3888492.0 32 Barry CT 2009-01-01 18
0.5184583761085122 1770.6999999999998 3.4370650395447133 coal 10.015808661827393 8041979.999999999 32 Barry ST 2009-01-01 275876283.29923165 80265075.035 18
0.6444336841997533 1070.8 4.357896421521934 gas 6044922.0 32 Barry NG 2009-01-01 1366066.9324744279 313469.344 18
0.6523982669340356 170.1 gas 972123.0 32 Barry A1CT 2009-01-01 18
0.6523982669340356 170.1 gas 972123.0 32 Barry A1CT2 2009-01-01 18
0.6523982669340356 170.1 gas 972123.0 32 Barry A2C1 2009-01-01 18
0.6523982669340356 170.1 gas 972123.0 32 Barry A2C2 2009-01-01 18
0.6102027837570516 2841.5 3.939296602772454 10.173606816265472 15188887.0 32 Barry 2010-01-01 300053403.06077445 79740244.73 18
0.3245960947123228 153.1 3.7577287552640883 coal 10.392783393899856 1954 435334.0 32 Barry 1 2010-01-01 17001212.326998707 4524331.966 18
0.40151555821992363 153.1 3.7577287552640883 coal 10.624115562818599 1954 538494.9999999999 32 Barry 2 2010-01-01 21498090.62726494 5721033.11 18
0.3803728511952726 272.0 3.7577287552640883 coal 10.559444091614242 906321.9999999999 32 Barry 3 2010-01-01 35962428.000210315 9570256.488000002 18
0.529742009697965 403.7 3.7577287552640883 coal 10.111412622919143 1873385.9999999998 32 Barry 4 2010-01-01 71181073.23598689 18942578.848 18
0.5905732480758009 788.8 3.7577287552640883 coal 9.942409090385576 1971 4080794.9999999995 32 Barry 5 2010-01-01 152462078.1618528 40572933.304000005 18
0.7661770622801107 195.2 4.76281655047497 gas 1310126.0 32 Barry 6 2010-01-01 1115512.2334362098 234212.72300000003 18
0.7576218513736058 195.2 4.76281655047497 gas 1295497.0 32 Barry 7 2010-01-01 833008.4750245877 174898.29100000003 18
0.7618994568268583 390.4 4.76281655047497 gas 2605623.0 32 Barry CA 2010-01-01 1948520.7084607976 409111.0140000001 18
0.7967600310319742 680.4 gas 4748932.0 32 Barry CT 2010-01-01 18
0.5050715180359753 1770.6999999999998 3.757728755264089 coal 10.173606816265472 7834331.999999999 32 Barry ST 2010-01-01 298104882.35231364 79331133.716 18
0.7840503110378789 1070.8 4.76281655047497 gas 7354555.0 32 Barry NG 2010-01-01 1948520.7084607976 409111.0140000001 18
0.7967600310319742 170.1 gas 1187233.0 32 Barry A1CT 2010-01-01 18
0.7967600310319742 170.1 gas 1187233.0 32 Barry A1CT2 2010-01-01 18
0.7967600310319742 170.1 gas 1187233.0 32 Barry A2C1 2010-01-01 18
0.7967600310319742 170.1 gas 1187233.0 32 Barry A2C2 2010-01-01 18
0.49632248615393015 2841.5 4.298384164899995 10.502705526766224 12354231.016999999 32 Barry 2011-01-01 211103448.1688524 49141225.092 18
0.23273206184828277 153.1 4.295619023562648 coal 11.422532342216638 312130.0011401955 32 Barry 1 2011-01-01 15315235.080748688 3565315.0329999994 18
0.142768626990036 153.1 4.295619023562648 coal 11.941353830252696 191475.00069944875 32 Barry 2 2011-01-01 9821807.177494032 2286470.733 18
0.2980077401431335 272.0 4.295619023562648 coal 10.583450031684453 710069.0025938471 32 Barry 3 2011-01-01 32281490.224933974 7514979.807999999 18
0.3324513671751819 403.7 4.295619023562648 coal 10.18072228724246 1969 1175685.0042947195 32 Barry 4 2011-01-01 51415649.54184253 11969322.526 18
0.3277061810946558 788.8 4.295619023562648 coal 10.18188857411504 2264413.008271789 32 Barry 5 2011-01-01 99039796.22795981 23056000.935999997 18
0.8172714789654912 195.2 4.31092575241547 gas 1397494.9999999998 32 Barry 6 2011-01-01 1734822.0887218101 402424.488 18
0.8080817473239015 195.2 4.31092575241547 gas 1381781.0 32 Barry 7 2011-01-01 1494647.8271515472 346711.56799999997 18
0.8126766131446964 390.4 4.31092575241547 gas 2779276.0 32 Barry CA 2011-01-01 3229469.915873357 749136.056 18
0.8256597314499394 680.4 gas 4921183.0 32 Barry CT 2011-01-01 18
0.30002400935006746 1770.6999999999998 4.295619023562648 coal 10.502705526766224 4653772.017 32 Barry ST 2011-01-01 207873978.25297904 48392089.036 18
0.8209262523816103 1070.8 4.31092575241547 gas 7700459.0 32 Barry NG 2011-01-01 3229469.915873357 749136.056 18
0.8256597314499394 170.1 gas 1230295.75 32 Barry A1CT 2011-01-01 18
0.8256597314499394 170.1 gas 1230295.75 32 Barry A1CT2 2011-01-01 18
0.8256597314499394 170.1 gas 1230295.75 32 Barry A2C1 2011-01-01 18
0.8256597314499394 170.1 gas 1230295.75 32 Barry A2C2 2011-01-01 18
0.5313569421166955 2841.5 4.407786080679803 10.507966394590024 13262528.997000001 32 Barry 2012-01-01 258337225.8320239 55236430.03700001 18
0.11310125047308157 153.1 4.695764427341192 coal 11.460336096718853 152101.99991421448 32 Barry 1 2012-01-01 8185374.991706103 1743140.04 18
0.09176621820148978 153.1 4.695764427341192 coal 12.105615589033222 123409.99993039676 32 Barry 2 2012-01-01 7015256.138503607 1493954.0189999999 18
0.2078298275105564 272.0 4.695764427341192 coal 10.64269742643961 496556.9997199419 32 Barry 3 2012-01-01 24815733.988267414 5284705.903 18
0.3222409806724947 403.7 4.695764427341192 coal 10.29984412048848 1142698.9993555178 32 Barry 4 2012-01-01 55267370.291673586 11769621.569999998 18
0.49133609924183486 788.8 4.695764427341192 coal 10.073083316910669 3404378.9980799304 32 Barry 5 2012-01-01 161029939.69246128 34292593.29000001 18
0.8253083101914063 195.2 3.101630193299367 gas 1415104.0 32 Barry 6 2012-01-01 783359.6939122343 252563.86000000002 18
0.8374770680298009 195.2 3.101630193299367 gas 1435969.0 32 Barry 7 2012-01-01 1240191.0354996638 399851.355 18
0.8313926891106036 390.4 3.101630193299367 gas 2851073.0 32 Barry CA 2012-01-01 2023550.7294118982 652415.215 18
0.8520363369773915 680.4 gas 5092309.0 32 Barry CT 2012-01-01 18
0.34198312617405185 1770.6999999999998 4.695764427341193 coal 10.507966394590024 5319146.997000001 32 Barry ST 2012-01-01 256313675.102612 54584014.822000004 18
0.8445099266979799 1070.8 3.101630193299367 gas 7943382.0 32 Barry NG 2012-01-01 2023550.7294118982 652415.215 18
0.8520363369773915 170.1 gas 1273077.25 32 Barry A1CT 2012-01-01 18
0.8520363369773915 170.1 gas 1273077.25 32 Barry A1CT2 2012-01-01 18
0.8520363369773915 170.1 gas 1273077.25 32 Barry A2C1 2012-01-01 18
0.8520363369773915 170.1 gas 1273077.25 32 Barry A2C2 2012-01-01 18
0.5181333500860131 2841.5 4.539545886107523 10.235855788960974 12897137.009 32 Barry 2013-01-01 82183563.20295766 17735007.508 18
0.022836269646684313 153.1 4.655227096208192 coal 30627.000054268545 32 Barry 1 2013-01-01 18
0.054747546243765155 153.1 4.655227096208192 coal 73425.0001301031 32 Barry 2 2013-01-01 18
0.17908188992247562 272.0 4.655227096208192 coal 426702.00075608114 32 Barry 3 2013-01-01 18
0.47368095204071115 403.7 4.655227096208192 coal 10.235855788960974 1675131.0029681954 32 Barry 4 2013-01-01 79820382.96825199 17146399.374 18
0.4158325004821138 788.8 4.655227096208192 coal 2873356.0050913524 32 Barry 5 2013-01-01 18
0.855222836664421 195.2 4.014861668061281 gas 1462390.0 32 Barry 6 2013-01-01 1205442.334240419 300245.04799999995 18
0.790132705479452 195.2 4.014861668061281 gas 1351089.0 32 Barry 7 2013-01-01 1157737.9004652586 288363.086 18
0.8226777710719365 390.4 4.014861668061281 gas 2813479.0 32 Barry CA 2013-01-01 2363180.2347056777 588608.134 18
0.8396244553969059 680.4 gas 5004417.0 32 Barry CT 2013-01-01 18
0.3274535680752627 1770.6999999999998 4.6552270962081925 coal 10.235855788960974 5079241.009000001 32 Barry ST 2013-01-01 79820382.96825199 17146399.374 18
0.8334459107943022 1070.8 4.014861668061281 gas 7817896.0 32 Barry NG 2013-01-01 2363180.2347056777 588608.134 18
0.8396244553969059 170.1 gas 1251104.25 32 Barry A1CT 2013-01-01 18
0.8396244553969059 170.1 gas 1251104.25 32 Barry A1CT2 2013-01-01 18
0.8396244553969059 170.1 gas 1251104.25 32 Barry A2C1 2013-01-01 18
0.8396244553969059 170.1 gas 1251104.25 32 Barry A2C2 2013-01-01 18
0.5215036513610648 2841.5 4.171429554201436 12981028.998 32 Barry 2014-01-01 18
0.014624696897681824 153.1 3.9475829740187574 coal 19613.999992507364 32 Barry 1 2014-01-01 18
0.013642708225598262 153.1 3.9475829740187574 coal 18296.999993010464 32 Barry 2 2014-01-01 18
0.20339905646272505 272.0 3.947582974018757 coal 484642.99981486425 32 Barry 3 2014-01-01 18
0.38917778795973157 403.7 3.9475829740187574 coal 1376292.9994742502 32 Barry 4 2014-01-01 18
0.48288713199481204 788.8 3.9475829740187574 coal 3336695.9987253677 32 Barry 5 2014-01-01 18
0.8275253597788024 535.4 4.5415875104299275 gas 3881180.0 32 Barry 6 2014-01-01 18
0.8239275717553385 535.4 4.5415875104299275 gas 3864306.0 32 Barry 7 2014-01-01 18
0.8300811952616214 390.4 4.5415875104299275 gas 2838798.0 32 Barry CA 2014-01-01 18
0.8232278085144651 680.4 4.5415875104299275 gas 4906688.0 32 Barry CT 2014-01-01 18
0.3375302003722182 1770.6999999999998 3.947582974018758 coal 5235542.998 32 Barry ST 2014-01-01 18
0.8257264657670704 1070.8 4.5415875104299275 gas 7745486.0 32 Barry Natural Gas Fired Combined Cycle 2014-01-01 18
0.8232278085144651 170.1 4.5415875104299275 gas 1226672.0 32 Barry A1CT 2014-01-01 18
0.8232278085144651 170.1 4.5415875104299275 gas 1226672.0 32 Barry A1CT2 2014-01-01 18
0.8350152518901115 195.2 4.5415875104299275 gas 1427836.0 32 Barry A1ST 2014-01-01 18
0.8232278085144651 170.1 4.5415875104299275 gas 1226672.0 32 Barry A2C1 2014-01-01 18
0.8232278085144651 170.1 4.5415875104299275 gas 1226672.0 32 Barry A2C2 2014-01-01 18
0.8251471386331313 195.2 4.5415875104299275 gas 1410962.0 32 Barry A2ST 2014-01-01 18
0.45748724317579387 2841.5 3.222538059719033 8.964730938094974 11387562.013 32 Barry 2015-01-01 304249132.82577634 94523874.279 18
0.04695888003000967 153.1 3.1433485229502818 gas 62979.18370552765 32 Barry 1 2015-01-01 186956.11339885238 59476.737 18
-0.01389158659061857 153.1 3.1433485229502818 gas -18630.78470552764 32 Barry 2 2015-01-01 287012.54945534345 91307.89899999999 18
0.038399887228105514 272.0 3.2969962311977428 coal 11.215091984099498 1959 91496.17929615157 32 Barry 3 2015-01-01 3383173.3395875366 1026138.0669999999 18
0.44158975656959404 403.7 3.2969962311977428 coal 10.360309124870048 1561643.3142097911 32 Barry 4 2015-01-01 53342456.379109226 16179107.478000002 18
0.42067557686811385 788.8 3.2969962311977428 coal 10.03994758234029 2906821.1204940574 32 Barry 5 2015-01-01 96220631.56228189 29184331.681 18
0.7452563951673566 535.4 3.1433485229502818 gas 7.039380558917184 2000 3495330.0 32 Barry 6 2015-01-01 77341958.5405778 24604958.049 18
0.7010341348507411 535.4 3.1433485229502818 gas 7.110432442608905 2000 3287923.0 32 Barry 7 2015-01-01 73486944.34136567 23378554.368 18
0.7206447900291938 390.4 3.1433485229502818 gas 7.074906500763045 2464536.0 32 Barry CA 2015-01-01 54800318.944840916 17433739.384841256 18
0.7245799878663907 680.4 3.1433485229502813 gas 7.074906500763044 4318717.0 32 Barry CT 2015-01-01 96028583.93710253 30549773.032158744 18
0.2968351791451566 1770.6999999999998 3.270426553519213 10.34651585273822 4604309.013 32 Barry ST 2015-01-01 153420229.94383284 46540361.862 18
0.3554410714146521 1464.5 3.2969962311977423 coal 10.34651585273822 4559960.614 32 Barry Conventional Steam Coal 2015-01-01 152946261.28097865 46389577.226 18
0.7231452650090489 1070.8 3.1433485229502818 gas 7.074906500763045 2000 6783253.0 32 Barry Natural Gas Fired Combined Cycle 2015-01-01 150828902.88194346 47983512.416999996 18
0.01653364671969555 306.2 3.1433485229502818 gas 44348.399000000005 32 Barry Natural Gas Steam Turbine 2015-01-01 473968.6628541958 150784.636 18
0.5660178303538564 1377.0 3.1433485229502813 gas 7.074906500763045 6827601.399 32 Barry NG 2015-01-01 151302871.54479766 48134297.053 18
0.7361543974938191 170.1 3.1433485229502813 gas 7.039380558917183 1096926.0 32 Barry A1CT 2015-01-01 24271930.036386218 7721679.55897079 18
0.757832486396667 170.1 3.1433485229502813 gas 7.039380558917183 2000 1129228.0 32 Barry A1CT2 2015-01-01 24986683.706219323 7949065.629784933 18
0.7422290216333558 195.2 3.1433485229502818 gas 7.039380558917183 1269176.0 32 Barry A1ST 2015-01-01 28083344.79797225 8934212.860244274 18
0.687966922492544 170.1 3.1433485229502813 gas 7.110432442608906 1025123.0 32 Barry A2C1 2015-01-01 22912080.618692648 7289067.836864569 18
0.7163661450825327 170.1 3.1433485229502813 gas 7.110432442608906 1067440.0 32 Barry A2C2 2015-01-01 23857889.575804345 7589960.00653845 18
0.6990605584250318 195.2 3.1433485229502818 gas 7.110432442608905 1195360.0 32 Barry A2ST 2015-01-01 26716974.146868665 8499526.524596982 18
0.5658225469028405 2569.5 3.09206333007976 8.719802037553384 12770891.004999999 32 Barry 2016-01-01 314909332.0013378 102409037.02499999 18
272.0 coal 32 Barry 2016-01-01 18
0.04256025045265436 153.1 2.87909891585949 gas 57236.31864034334 32 Barry 1 2016-01-01 18
0.025268329270112168 153.1 2.87909891585949 gas 33981.61735965665 32 Barry 2 2016-01-01 18
0.31069826481564206 403.7 3.3379769555567513 coal 10.740765498598947 1101767.3654213601 32 Barry 4 2016-01-01 39501034.832321554 11833824.906000003 18
0.45845411922115675 788.8 3.3379769555567513 coal 10.038988517959643 3176545.70357864 32 Barry 5 2016-01-01 106445768.03931123 31889305.845 18
0.8789036319643895 535.4 2.8790989158594895 gas 7.037572297235017 4133443.0 32 Barry 6 2016-01-01 83751271.37256467 29089403.949 18
0.9074971524277851 535.4 2.8790989158594895 gas 6.9346480554799905 4267917.0 32 Barry 7 2016-01-01 85211257.75714035 29596502.32499999 18
0.8509898422803011 390.4 2.8790989158594895 gas 6.986110176357504 2918277.0 32 Barry CA 2016-01-01 58688319.395145044 20384266.435536817 18
0.9174199669860974 680.4 2.87909891585949 gas 6.986110176357503 5483083.0 32 Barry CT 2016-01-01 110274209.73455998 38301639.83846317 18
0.33191569647246194 1498.6999999999998 3.2442233986372204 10.276562829979841 4369531.005 32 Barry ST 2016-01-01 145946802.87163278 43723130.751 18
0.4084339612140236 1192.5 3.3379769555567513 coal 10.276562829979841 4278313.069 32 Barry Conventional Steam Coal 2016-01-01 145946802.87163278 43723130.751 18
0.8932003921960873 1070.8 2.8790989158594895 gas 6.986110176357503 8401360.0 32 Barry Natural Gas Fired Combined Cycle 2016-01-01 168962529.129705 58685906.27399999 18
0.033914289861383264 306.2 2.87909891585949 gas 91217.93599999999 32 Barry Natural Gas Steam Turbine 2016-01-01 18
0.7021231194764891 1377.0 2.8790989158594895 gas 6.986110176357503 8492577.935999999 32 Barry NG 2016-01-01 168962529.129705 58685906.27399999 18
0.9423478795822452 170.1 2.87909891585949 gas 7.037572297235016 1408017.0 32 Barry A1CT 2016-01-01 28529052.86565809 9909021.433235956 18
0.867898611017413 170.1 2.87909891585949 gas 7.037572297235016 1296778.0 32 Barry A1CT2 2016-01-01 26275143.067890782 9126168.928463832 18
0.8332073591328497 195.2 2.8790989158594895 gas 7.037572297235018 1428648.0 32 Barry A1ST 2016-01-01 28947075.4390158 10054213.587300213 18
0.9249896128817399 170.1 2.87909891585949 gas 6.93464805547999 1382080.9999999998 32 Barry A2C1 2016-01-01 27593990.307741757 9584245.319165839 18
0.9344437644629913 170.1 2.87909891585949 gas 6.93464805547999 1396206.9999999998 32 Barry A2C2 2016-01-01 27876023.49326935 9682204.15759755 18
0.8687723254277525 195.2 2.8790989158594895 gas 6.9346480554799905 1489629.0 32 Barry A2ST 2016-01-01 29741243.95612924 10330052.848236604 18
0.527106885345389 2569.5 3.139523681732764 8.80533401430109 11864554.002999999 32 Barry 2017-01-01 297900763.8678408 93645483.695 18
272.0 coal 32 Barry 2017-01-01 18
0.034488791145797566 153.1 3.3444905778281733 gas 46254.849177933276 32 Barry 1 2017-01-01 657705.1791831191 196653.321 18
0.035811792828027995 153.1 3.3444905778281733 gas 48029.20082206671 32 Barry 2 2017-01-01 620609.9860200067 185561.888 18
0.19958280546496907 403.7 2.9028449262414626 coal 11.123508844304899 705807.0282399822 32 Barry 4 2017-01-01 22790382.75111923 7851050.721000001 18
0.383145128366772 788.8 2.902844926241462 coal 10.11611476233576 2647489.9247600175 32 Barry 5 2017-01-01 77744898.24386266 26782311.911000006 18
0.8953106370349143 535.4 3.344490577828173 gas 7.0138894729823065 4199100.0 32 Barry 6 2017-01-01 98502014.37800294 29452023.286000002 18
0.8993133201310675 535.4 3.344490577828173 gas 6.917676887853189 4217873.0 32 Barry 7 2017-01-01 97585153.32965286 29177882.567999993 18
0.8649503026985553 390.4 3.344490577828173 gas 6.9657831804177475 2958047.0 32 Barry CA 2017-01-01 68911641.90179583 20604525.65142082 18
0.9158804651574819 680.4 3.344490577828173 gas 6.9657831804177475 5458926.0 32 Barry CT 2017-01-01 127175525.80585998 38025380.20257917 18
0.26260057064676756 1498.6999999999998 2.993077727012698 10.457150394110135 3447581.0029999996 32 Barry ST 2017-01-01 101813596.16018501 35015577.841000006 18
0.3210033172510841 1192.5 2.902844926241462 coal 10.457150394110135 3353296.9529999997 32 Barry Conventional Steam Coal 2017-01-01 100535280.99498188 34633362.63200001 18
0.8973119785829909 1070.8 3.344490577828173 gas 6.965783180417748 8416973.0 32 Barry Natural Gas Fired Combined Cycle 2017-01-01 196087167.70765582 58629905.853999995 18
0.03515029198691278 306.2 3.3444905778281733 gas 94284.04999999999 32 Barry Natural Gas Steam Turbine 2017-01-01 1278315.1652031257 382215.20900000003 18
0.705595269479346 1377.0 3.344490577828173 gas 6.965783180417748 8511257.05 32 Barry NG 2017-01-01 197365482.87285894 59012121.06299999 18
0.9140929724389897 170.1 3.344490577828173 gas 7.0138894729823065 1362068.0 32 Barry A1CT 2017-01-01 31951237.579437908 9553394.406686064 18
0.9154727678319764 170.1 3.344490577828173 gas 7.0138894729823065 1364124.0 32 Barry A1CT2 2017-01-01 31999466.9956369 9567814.963442516 18
0.8613738865184519 195.2 3.344490577828173 gas 7.0138894729823065 1472908.0 32 Barry A1ST 2017-01-01 34551309.80292814 10330813.915871423 18
0.913536624977518 170.1 3.344490577828173 gas 6.917676887853189 1361239.0 32 Barry A2C1 2017-01-01 31493768.668071166 9416611.569144387 18
0.9204194953814435 170.1 3.344490577828173 gas 6.917676887853189 1371494.9999999998 32 Barry A2C2 2017-01-01 31731052.562714014 9487559.263306208 18
0.8685267188786586 195.2 3.344490577828173 gas 6.917676887853189 1485139.0 32 Barry A2ST 2017-01-01 34360332.098867685 10273711.735549398 18
2569.5 3.1809602806576383 32 Barry 2018-01-01 18
272.0 coal 32 Barry 2018-01-01 18
153.1 3.4704231031008606 gas 32 Barry 1 2018-01-01 18
153.1 3.4704231031008606 gas 32 Barry 2 2018-01-01 18
403.7 2.846712644176032 coal 32 Barry 4 2018-01-01 18
788.8 2.8467126441760318 coal 32 Barry 5 2018-01-01 18
535.4 3.47042310310086 gas 32 Barry 6 2018-01-01 18
535.4 3.47042310310086 gas 32 Barry 7 2018-01-01 18
390.4 3.47042310310086 gas 32 Barry CA 2018-01-01 18
680.4 3.47042310310086 gas 32 Barry CT 2018-01-01 18
1498.6999999999998 2.974143178988058 32 Barry ST 2018-01-01 18
1192.5 2.8467126441760318 coal 1971 32 Barry Conventional Steam Coal 2018-01-01 18
1070.8 3.47042310310086 gas 32 Barry Natural Gas Fired Combined Cycle 2018-01-01 18
306.2 3.4704231031008606 gas 32 Barry Natural Gas Steam Turbine 2018-01-01 18
1377.0 3.4704231031008597 gas 32 Barry NG 2018-01-01 18
170.1 3.47042310310086 gas 32 Barry A1CT 2018-01-01 18
170.1 3.47042310310086 gas 32 Barry A1CT2 2018-01-01 18
195.2 3.47042310310086 gas 32 Barry A1ST 2018-01-01 18
170.1 3.47042310310086 gas 32 Barry A2C1 2018-01-01 18
170.1 3.47042310310086 gas 32 Barry A2C2 2018-01-01 18
195.2 3.47042310310086 gas 32 Barry A2ST 2018-01-01 18
capacity_factor capacity_mw fuel_cost_per_mmbtu fuel_type_code_pudl heat_rate_mmbtu_mwh installation_year net_generation_mwh plant_id_pudl plant_name report_date total_fuel_cost total_mmbtu utility_id_pudl
0.5973665008804973 1771.0 1.9711899791231735 coal 9.663927544801629 1971 9267520.0 32 barry 1994-01-01 176541039.64000002 89560641.8 18
0.06325928936664235 17711.0 1.938555813183173 coal 9.604294422937315 1971 9814575.0 32 barry 1995-01-01 182732279.76 94262067.936 18
0.7110310326957141 1771.0 1.9580912863070536 coal 9.557011930206647 1971 11030907.0 32 barry 1996-01-01 206426897.82 105422509.80000001 18
0.7469215214236425 1770.8 1.9539063150012481 coal 9.654567342648736 1971 11586402.0 32 barry 1997-01-01 218567278.84800002 111861698.368 18
0.6752961280560447 1770.8 2.023400033074252 coal 9.72566737442453 1971 10475334.0 32 barry 1998-01-01 206143214.58 101879614.12 18
0.7268811764256901 1770.8 1971 11275532.0 32 barry 1999-01-01 18
0.7136958194474958 1770.8 1971 11070998.0 32 barry 2000-01-01 18
0.6830124376877876 1770.8 1971 10595031.0 32 barry 2001-01-01 18
0.7080513618693096 1770.8 1971 10983440.0 32 barry 2002-01-01 18
0.7350123206187024 1770.8 1971 11401664.0 32 barry 2003-01-01 18
0.7037429487794388 1770.8 1971 10916607.0 32 barry 2004-01-01 18
0.7541210123020526 1770.8 1971 11698082.0 32 barry 2005-01-01 18
0.7218320564035758 1770.8 2.521211312700107 coal 9.691679141829004 1971 11197209.0 32 barry 2006-01-01 273601238.778 108519756.912 18
0.7155263776762147 1770.8 2.433170901496693 coal 9.946283024820996 1971 11099394.0 32 barry 2007-01-01 268616505.608 110397714.128 18
0.616127633151902 1770.8 1971 9557500.0 32 barry 2008-01-01 18
0.5183822315946254 1770.8 3.9646828573970283 coal 9.977310072447665 1971 8041253.0 32 barry 2009-01-01 318086801.224 80230074.552 18
0.505042995813362 1770.8 3.6211099585062243 coal 10.368510957156271 1971 7834332.0 32 barry 2010-01-01 294144055.332 81230357.184 18
0.3000053248383467 1770.8 4.368311665340055 coal 10.397693909743657 1971 4653745.0 32 barry 2011-01-01 211374808.60999998 48388216.04399999 18
0.3429007011767764 1770.8 4.691905062719971 coal 10.287304425690813 1971 5319147.0 32 barry 2012-01-01 256739564.614 54719684.47400001 18
0.3274352045820943 1770.8 4.908957762449211 coal 10.311457670759205 1971 5079243.0 32 barry 2013-01-01 257103713.47700003 52374399.194 18
0.3375111396133935 1770.8 1971 5235543.0 32 barry 2014-01-01 18
0.2967975932246396 1770.8 1971 4603986.0 32 barry 2015-01-01 18
0.3328028480623159 1498.8 3.620794237513032 coal 10.083357015661408 1971 4369531.0 32 barry 2016-01-01 159530532.39200002 44059541.064 18
0.2625830496969874 1498.8 1971 3447581.0 32 barry 2017-01-01 18
0.31276086318065105 1498.8 1971 4106390.0 32 barry 2018-01-01 18
0.3305177627642449 1498.8 1971 4339529.0 32 barry 2019-01-01 18
0.26362481243041774 566.0 1307094.0 32 barry combined cycle 2000-01-01 18
0.5212175508684302 1132.03 5168697.0 32 barry combined cycle 2001-01-01 18
0.6170536890994346 1132.03 6119064.0 32 barry combined cycle 2002-01-01 18
0.3437706384098361 1132.03 3409030.0 32 barry combined cycle 2003-01-01 18
0.38862530346643204 1132.03 2001 3853835.0 32 barry cc 2004-01-01 18
0.2928222411454075 1132.03 2000 2903796.0 32 barry cc 2005-01-01 18
0.3470536241577089 1132.03 2001 3441586.0 32 barry cc 2006-01-01 18
0.4116117499669342 1132.03 2001 4081782.0 32 barry cc 2007-01-01 18
0.4504781626993525 1132.03 2001 4467204.0 32 barry cc 2008-01-01 18
0.6095723821314738 1132.03 2001 6044875.0 32 barry cc 2009-01-01 18
0.7416420704922668 1132.03 2001 7354555.0 32 barry cc 2010-01-01 18
0.776248144673385 1132.03 2001 7697729.0 32 barry cc 2011-01-01 18
0.8007647553752085 1132.03 2001 7940850.0 32 barry cc 2012-01-01 18
0.7883780287701526 1132.03 2001 7818016.0 32 barry cc 2013-01-01 18
0.7810603870518785 1132.03 2001 7745450.0 32 barry cc 2014-01-01 18
0.6839304563664815 1132.03 2001 6782253.0 32 barry cc 2015-01-01 18
0.8472031313044652 1132.03 2001 8401360.0 32 barry cc 2016-01-01 18
1132.03 2001 32 barry cc 2017-01-01 18
0.8182152222840312 1132.03 2001 8113899.0 32 barry cc 2018-01-01 18
0.8199677413070157 1132.03 2001 8131278.0 32 barry cc 2019-01-01 18
plant_id_pudl utility_id_pudl match_type plant_part plant_name_new plant_name_ferc1 plant_name_eia capacity_factor_eia capacity_factor_ferc1 capacity_mw_eia capacity_mw_ferc1 fuel_cost_per_mmbtu_eia fuel_cost_per_mmbtu_ferc1 fuel_type_code_pudl_eia fuel_type_code_pudl_ferc1 installation_year_eia installation_year_ferc1 net_generation_mwh_eia net_generation_mwh_ferc1 total_fuel_cost_eia total_fuel_cost_ferc1 total_mmbtu_eia total_mmbtu_ferc1 heat_rate_mmbtu_mwh_eia heat_rate_mmbtu_mwh_ferc1 report_date
32 18 prediction plant_prime_mover Barry ST barry Barry 0.6830124376877876 1770.6999999999998 1770.8 coal 1971 1971 10595031.0 2001-01-01
32 18 prediction plant_prime_mover Barry ST barry Barry 0.7080513618693096 1770.6999999999998 1770.8 coal 1971 10983440.0 2002-01-01
32 18 prediction plant_prime_fuel Barry NG barry combined cycle Barry 0.4353492289955105 0.3437706384098361 893.9 1132.03 gas 3409030.0000000005 3409030.0 2003-01-01
32 18 prediction plant_prime_mover Barry ST barry Barry 0.7219170474850258 0.7218320564035758 1770.6999999999998 1770.8 2.521211312700107 coal coal 1971 11197895.0 11197209.0 273601238.778 108519756.912 9.691679141829004 2006-01-01
32 18 prediction plant_prime_fuel Barry NG barry cc Barry 0.43618864678056096 0.3470536241577089 900.6999999999999 1132.03 gas 2001 3441586.0000000005 3441586.0 2006-01-01
32 18 prediction plant_prime_mover Barry ST barry Barry 0.7137073076638422 0.7155263776762147 1770.6999999999998 1770.8 2.433170901496693 coal coal 1971 11070550.999999998 11099394.0 268616505.608 110397714.128 9.946283024820996 2007-01-01
32 18 prediction plant_prime_fuel Barry NG barry cc Barry 0.5173274667648148 0.4116117499669342 900.6999999999999 1132.03 gas 2001 4081782.000000001 4081782.0 2007-01-01
32 18 prediction plant_prime_mover Barry ST barry Barry 0.6146476293991356 0.616127633151902 1770.6999999999998 1770.8 coal 1971 9560124.000000002 9557500.0 2008-01-01
32 18 prediction plant_prime_fuel Barry NG barry cc Barry 0.5646321834687168 0.4504781626993525 900.6999999999999 1132.03 gas 2001 4467228.0 4467204.0 2008-01-01
32 18 prediction plant_prime_mover Barry ST barry Barry 0.5184583761085122 0.5183822315946254 1770.6999999999998 1770.8 3.4370650395447133 3.9646828573970283 coal coal 1971 8041979.999999999 8041253.0 275876283.29923165 318086801.224 80265075.035 80230074.552 10.015808661827393 9.977310072447665 2009-01-01
32 18 prediction plant_prime_fuel Barry NG barry cc Barry 0.6444336841997533 0.6095723821314738 1070.8 1132.03 4.357896421521934 gas 2001 6044922.0 6044875.0 1366066.9324744279 313469.344 2009-01-01
32 18 prediction plant_prime_mover Barry ST barry Barry 0.5050715180359753 0.505042995813362 1770.6999999999998 1770.8 3.757728755264089 3.6211099585062243 coal coal 1971 7834331.999999999 7834332.0 298104882.35231364 294144055.332 79331133.716 81230357.184 10.173606816265472 10.368510957156271 2010-01-01
32 18 prediction plant_prime_fuel Barry NG barry cc Barry 0.7840503110378789 0.7416420704922668 1070.8 1132.03 4.76281655047497 gas 2001 7354555.0 7354555.0 1948520.7084607976 409111.0140000001 2010-01-01
32 18 prediction plant_prime_mover Barry ST barry Barry 0.30002400935006746 0.3000053248383467 1770.6999999999998 1770.8 4.295619023562648 4.368311665340055 coal coal 1971 4653772.017 4653745.0 207873978.25297904 211374808.60999998 48392089.036 48388216.04399999 10.502705526766224 10.397693909743657 2011-01-01
32 18 prediction plant_prime_mover Barry ST barry Barry 0.34198312617405185 0.3429007011767764 1770.6999999999998 1770.8 4.695764427341193 4.691905062719971 coal coal 1971 5319146.997000001 5319147.0 256313675.102612 256739564.614 54584014.822000004 54719684.47400001 10.507966394590024 10.287304425690813 2012-01-01
32 18 prediction plant_prime_mover Barry ST barry Barry 0.3274535680752627 0.3274352045820943 1770.6999999999998 1770.8 4.6552270962081925 4.908957762449211 coal coal 1971 5079241.009000001 5079243.0 79820382.96825199 257103713.47700003 17146399.374 52374399.194 10.235855788960974 10.311457670759205 2013-01-01
32 18 prediction plant_prime_fuel Barry NG barry cc Barry 0.8334459107943022 0.7883780287701526 1070.8 1132.03 4.014861668061281 gas 2001 7817896.0 7818016.0 2363180.2347056777 588608.134 2013-01-01
32 18 prediction plant_prime_mover Barry ST barry Barry 0.3375302003722182 0.3375111396133935 1770.6999999999998 1770.8 3.947582974018758 coal 1971 5235542.998 5235543.0 2014-01-01
32 18 prediction plant_technology Barry Natural Gas Fired Combined Cycle barry cc Barry 0.8257264657670704 0.7810603870518785 1070.8 1132.03 4.5415875104299275 gas 2001 7745486.0 7745450.0 2014-01-01
32 18 prediction plant_prime_mover Barry ST barry Barry 0.2968351791451566 0.2967975932246396 1770.6999999999998 1770.8 3.270426553519213 1971 4604309.013 4603986.0 153420229.94383284 46540361.862 10.34651585273822 2015-01-01
32 18 prediction plant_prime_mover Barry ST barry Barry 0.33191569647246194 0.3328028480623159 1498.6999999999998 1498.8 3.2442233986372204 3.620794237513032 coal 1971 4369531.005 4369531.0 145946802.87163278 159530532.39200002 43723130.751 44059541.064 10.276562829979841 10.083357015661408 2016-01-01
32 18 prediction plant_technology Barry Natural Gas Fired Combined Cycle barry cc Barry 0.8932003921960873 0.8472031313044652 1070.8 1132.03 2.8790989158594895 gas 2001 8401360.0 8401360.0 168962529.129705 58685906.27399999 6.986110176357503 2016-01-01
32 18 prediction plant_prime_mover Barry ST barry Barry 0.26260057064676756 0.2625830496969874 1498.6999999999998 1498.8 2.993077727012698 1971 3447581.0029999996 3447581.0 101813596.16018501 35015577.841000006 10.457150394110135 2017-01-01
32 18 overridden plant_unit Barry 1 barry Barry 0.31276086318065105 153.1 1498.8 3.4704231031008606 gas 1971 4106390.0 2018-01-01
32 18 prediction plant_prime_mover Barry ST barry Barry 0.3305398177659603 0.3305177627642449 1498.6999999999998 1498.8 3.101435056817307 1971 4339529.017999999 4339529.0 136194662.0971089 43184190.225 10.399025815675392 2019-01-01
32 18 prediction plant_technology Barry Natural Gas Fired Combined Cycle barry cc Barry 0.8668547648410355 0.8199677413070157 1070.8 1132.03 2.878531157145114 gas 2001 8131278.0 8131278.0 164380880.5814279 57105819.464 7.022562363813434 2019-01-01
32 18 no prediction; training plant_unit Barry 6 barry cc Barry 0.8182152222840312 535.4 1132.03 3.47042310310086 gas 2001 8113899.0 2018-01-01
@zaneselvans
Copy link
Author

zaneselvans commented Oct 10, 2021

This is an example of the kinds of records we're matching between the FERC 1 and EIA datasets.

  • Most of the columns are numeric / quantitative, with the exception of plant_name which is a string feature that we've been using the jaro-winkler distance to compare, and fuel_type_code_pudl which is a categorical column.
  • We are primarily trying to ensure that every record from the FERC 1 dataset is associated with the best available match from the EIA dataset. * The FERC 1 records are the "real" records -- data actually reported to FERC -- while the EIA records are generally aggregations of several individual generator records that may have been scaled according to what portion of the generator is owned by an individual utility. We do a bunch of work to try and generate any possible aggregation of EIA records that might potentially show up as something that's reported in a singlle FERC 1 record, so we expect most of them not to end up finding a good match on the FERC side.
  • We currently use (plant_id_pudl, utility_id_pudl, report_date) as blocking IDs to minimize the number of records that need to be compared to each other.
  • One issue with the current system is that the Python record linkage toolkit (built on top of scikit-learn) returns all matches that have a probability of > 50%, but we ultimately need to choose a single best match.
  • There are a lot of NULL values especially on the EIA side, because when the records being aggregated don't share a consistent categorical attribute, or if any one of the records has an NA value, the whole aggregated record ends up with an NA value.
  • The plant_name_new column is a composition of the plant's reported EIA name (in this case Barry) and strings that describe the portion of the plant that has been aggregated to create the record, since many times the FERC records will include that kind of information in the plant_name string (e.g. "Barry Combined Cycle" or "Barry CC" or "Barry Unit 2").
  • Within a given plant-utility-year grouping, it is normally the case that all of the EIA generators (the smallest division of a plant) will end up being associated with a FERC plant, and that each of them will only be used once (though often as part of some larger aggregation of generators). When this doesn't happen, it's typically because there are some very small generators that aren't required to report to FERC. And then occasionally the same utility will report both the entire plant, and also its ownership share. In which case some generators would end up getting used more than once.
  • While we use the report_year as a blocking ID right now, there's a lot of continuity between years, and when doing the mapping by hand it's often useful to look at the whole time series for a particular plant, or sub-plant aggregation, especially when there's a gap in the data for some of the columns. Not sure if that's something that's best taken advantage of in the entity matching process, or if it means we should be filling in some of the NA values before we get this far.
  • There are a few instances in which non-standard aggregations are necessary to match the records as they are reported in FERC. E.g. two separate units that were installed in the same year might be reported together in FERC all the time (as with the Comanche 1 & 2 units in Pueblo, CO) even though they are distinct generators, units, etc. Currently these are being overridden by hand after the fact but it would be nice if this kind of thing could be worked into the process more uniformly.
  • In the example-matches the plant_part column indicates what level of aggregation the record came from. In the full table there are also long unique IDs that convey what collection of individual generator records and ownership slices went into creating the aggregated records so that can all be disentangled later.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment