Added energy-poverty repository

20160503-coal-production-sonification/README.md

@@ -3,7 +3,7 @@ Data and notes on data cleaning and sonifying of U.S. weekly coal production dat
 
 ## What's in this repository?
 
-This repository includes the data used in the story, ["TK Story Title"](URL).
+This repository includes the data used in the story, ["Listen To U.S. Coal Production Fall Off A Cliff"](http://insideenergy.org/2016/05/03/listen-to-u-s-coal-production-fall-off-a-cliff/).
 
 The data files *coal_prod_1984_2016_weeks_summed.csv* and *coal_prod_1984_2016_weeks_summed.xlsx* contain weekly data for U.S. coal production, in tons, from the beginning of 1984 through the first quarter of 2016 (week 16). (Note that the csv file does not include headers).:
 * *Year* 
@@ -17,7 +17,7 @@ The scripts for bulk downloading the weekly coal production files from the Energ
 
 ## Data Sources
 
-Weekly coal production data is from the Energy Information Administration, available [here]("https://www.eia.gov/coal/production/weekly/includes/archive.cfm").
+Weekly coal production data is from the Energy Information Administration, available [here](https://www.eia.gov/coal/production/weekly/includes/archive.cfm).
 
 ## Notes and Methods
 
@@ -27,4 +27,8 @@ Data Processing:
 * Some weeks were split into two records (i.e., because the week spanned two separate quarters), so those weeks were summed
 * Compiled all of the data into one file, *coal_prod_1984_2016_weeks_summed.csv*
 * Removed outlier weeks, which were caused by short weeks at the beginning/end of the year or holiday weeks (Fourth of July)
-* Adapted [MIDITime]("https://github.com/cirlabs/miditime") package to produce MIDI file where each week is mapped to a tone (5 octaves, roughly 9 weeks per second)
+* Adapted [MIDITime](https://github.com/cirlabs/miditime) package to produce MIDI file where each week is mapped to a tone (5 octaves, roughly 9 weeks per second)
+
+Note: The EIA releases new coal production estimates every week. After the data has been published, they go back and adjust those numbers based on quarterly Mining Safety and Health Administration data. Typically, those revisions result in very minor adjustments in the national production totals. [(More information about the revision process from the EIA.)](https://www.eia.gov/coal/production/weekly/includes/archive.cfm) Note that, because they are so recent, the 2016 weekly coal production data has not yet been revised.
+
+Special thanks to Mike Corey, who developed [MIDITime](https://github.com/cirlabs/miditime).

20160506-energy-poverty/README.md

@@ -0,0 +1,20 @@
+# The Gap Between Energy Need and Available Energy Assistance
+Data and notes on energy assistance available from the federal government's Low Income Housing Energy Assistance Program (LIHEAP).
+
+## What's in this repository?
+
+This repository includes the data used in the story, ["High Utility Costs Force Hard Decisions"](URL).
+
+The data files *state_energy_assistance_shortfall.csv* and *state_energy_assistance_shortfall.xlsx* contain annual data for 2012 to 2015, by state, on the energy bill need, the number of low-income households, the LIHEAP funds allocated, the gap between the needs and the funds (total), and the average household gap:
+* *YYYY_Need* -  Is the state energy bill shortfall, as defined by how much low-income families have to pay, annually, over 6% of their incomes on energy. (See notes below.)
+* *YYYY_Households* - The number of households below 200% of the federal poverty level. 
+* *YYYY_LIHEAP* - The total funds released in that fiscal year (defined as October 1 - September 30) from the LIHEAP program.
+* *YYYY_total_gap* - The difference between YYYY_Need and YYYY_LIHEAP.
+* *YYYY_household_gap* - The total gap divided by the number of households.
+
+This data file also contains four-year averages (2012 - 2015) for the total energy need/assistance gap and the household need/assistance gap.
+
+## Data Sources and Notes
+
+* LIHEAP funding allocation data comes from the U.S. Department of Health and Human Services Low Income Home Energy Assistance Program, [available here](https://liheapch.acf.hhs.gov/Funding/funding.htm).
+* Energy need and households comes from analysis by independent firm Accounting Insights, who shared their data with Inside Energy. Accounting Insights estimated annual energy bill in each U.S. county, modeled by combining energy data from the Energy Information Administration (eneryg mix, use, prices) and demographic data (household size, tenure) from the U.S. Census Bureau's American Community Survey. Then, based on an assumed "affordable" energy bill of 6% of household income, they calculated how much low-income families are spending each year above that affordable level. You can find a more detailed description of Accounting Insight's data methods [here](http://insideenergy.org/files/2016/05/2015-ConnecticutHEAG-11-30-15.pdf).

20160506-energy-poverty/state_energy_assistance_shortfall.csv

@@ -0,0 +1,52 @@
+State,2015_Need,2015_Households,2015_LIHEAP,2015_total_gap,2015_household_gap,2014_Need,2014_Households,2014_LIHEAP,2014_total_gap,2014_household_gap,2013_Need,2013_Households,2013_LIHEAP,2013_total_gap,2013_household_gap,2012_Need,2012_Households,2012_LIHEAP,2012_total_gap,2012_household_gap,2012_2015_total_gap_avg,2012_2015_household_gap_avg
+Hawaii,"$258,506,372","118,514","$5,622,255","$252,884,117","$2,133.79",369713087.1,117418,"$6,158,927","$363,554,160","$3,096.24",344834044.2,112939,5416000,"$339,418,044","$3,005.32",342193792,109322,"$6,107,011","$336,086,781","$3,074.28","$322,985,776","$2,827"
+Maine,"$477,949,995","187,113","$39,180,816","$438,769,179","$2,344.94",594301843.3,185023,"$39,195,339","$555,106,504","$3,000.20",499057851.5,181658,36046000,"$463,011,852","$2,548.81",508265799,177567,"$39,981,695","$468,284,104","$2,637.22","$481,292,910","$2,633"
+Vermont,"$149,087,086","76,455","$18,965,161","$130,121,925","$1,701.94",205747249.8,75390,"$19,140,144","$186,607,106","$2,475.22",238270092.1,73897,18230000,"$220,040,092","$2,977.66",232919129.3,72458,"$19,529,156","$213,389,973","$2,945.02","$187,539,774","$2,525"
+Connecticut,"$705,841,215","321,739","$85,764,007","$620,077,208","$1,927.27",799127248.1,313000,"$77,412,553","$721,714,695","$2,305.80",717525265.8,306192,76014000,"$641,511,266","$2,095.13",691139069.3,295477,"$79,531,964","$611,607,105","$2,069.90","$648,727,569","$2,100"
+New Hampshire,"$125,680,192","118,151","$25,749,807","$99,930,385",$845.79,238925124.5,116655,"$25,536,004","$213,389,121","$1,829.23",329057050.5,114860,24321000,"$304,736,051","$2,653.11",325725581.1,109498,"$26,055,007","$299,670,574","$2,736.77","$229,431,533","$2,016"
+Delaware,"$171,685,043","96,661","$12,547,203","$159,137,840","$1,646.35",212507669.9,95672,"$13,016,330","$199,491,340","$2,085.16",190020156.3,92509,12573000,"$177,447,156","$1,918.16",200305415.9,90020,"$11,956,809","$188,348,607","$2,092.30","$181,106,236","$1,935"
+North Dakota,"$208,993,875","80,055","$25,460,493","$183,533,382","$2,292.59",262722583.3,79666,"$25,695,405","$237,027,178","$2,975.26",76744375.14,79328,18994000,"$57,750,375",$727.99,82697052.47,80713,"$26,217,648","$56,479,404",$699.76,"$133,697,585","$1,674"
+Alaska,"$89,865,664","65,387","$17,481,696","$72,383,968","$1,107.01",126477349.7,65354,"$18,841,366","$107,635,984","$1,646.97",139289787.3,64873,10150000,"$129,139,787","$1,990.66",133419177.3,63665,"$18,001,573","$115,417,604","$1,812.89","$106,144,336","$1,639"
+Alabama,"$1,723,130,970","740,078","$44,386,516","$1,678,744,454","$2,268.33",1694909985,733648,"$48,885,209","$1,646,024,776","$2,243.62",771048187,720742,47937000,"$723,111,187","$1,003.29",779351578.1,704570,"$47,407,516","$731,944,062","$1,038.85","$1,194,956,120","$1,639"
+Massachusetts,"$1,057,463,362","639,275","$146,328,177","$911,135,185","$1,425.26",1210896307,631594,"$140,014,388","$1,070,881,919","$1,695.52",1159344937,616130,132150000,"$1,027,194,937","$1,667.17",1145219745,600353,"$132,731,128","$1,012,488,617","$1,686.49","$1,005,425,165","$1,619"
+Virginia,"$1,741,440,640","842,276","$81,432,310","$1,660,008,330","$1,970.86",1896252969,826575,"$81,877,330","$1,814,375,639","$2,195.05",948205917.5,803974,78971000,"$869,234,918","$1,081.17",1010206015,774526,"$80,436,332","$929,769,683","$1,200.44","$1,318,347,142","$1,612"
+Rhode Island,"$205,553,906","124,720","$27,361,354","$178,192,552","$1,428.74",242219897.9,122385,"$23,812,860","$218,407,038","$1,784.59",209229420.5,120866,23908000,"$185,321,421","$1,533.28",205167216.1,117662,"$23,241,292","$181,925,924","$1,546.17","$190,961,734","$1,573"
+Maryland,"$753,061,733","508,583","$68,853,946","$684,207,787","$1,345.32",858187799,496052,"$68,513,491","$789,674,308","$1,591.92",740136340.2,481369,70390000,"$669,746,340","$1,391.34",747183850.3,462181,"$69,790,309","$677,393,541","$1,465.65","$705,255,494","$1,449"
+Michigan,"$1,732,558,642","1,356,233","$161,826,861","$1,570,731,781","$1,158.16",2092263096,1349564,"$165,443,927","$1,926,819,169","$1,427.73",1921099770,1320495,164585000,"$1,756,514,770","$1,330.19",1926054219,1282356,"$173,449,659","$1,752,604,560","$1,366.71","$1,751,667,570","$1,321"
+New Jersey,"$1,328,955,722","781,528","$126,585,895","$1,202,369,827","$1,538.49",1284867943,765946,"$124,569,647","$1,160,298,296","$1,514.86",900235094.2,738683,124480000,"$775,755,094","$1,050.19",871613840.2,712866,"$136,745,901","$734,867,939","$1,030.86","$968,322,789","$1,284"
+New York,"$1,919,206,787","2,378,464","$381,440,172","$1,537,766,615",$646.54,2615995809,2340647,"$366,843,330","$2,249,152,479",$960.91,4199921779,2306354,349983000,"$3,849,938,779","$1,669.27",4014748487,2263227,"$375,709,769","$3,639,038,718","$1,607.90","$2,818,974,148","$1,221"
+West Virginia,"$422,984,287","294,735","$28,841,806","$394,142,481","$1,337.28",481134434.1,291715,"$29,107,918","$452,026,516","$1,549.55",292143943,290525,27723000,"$264,420,943",$910.15,337836376.4,288986,"$29,699,517","$308,136,859","$1,066.27","$354,681,700","$1,216"
+North Carolina,"$1,950,376,507","1,449,414","$86,504,101","$1,863,872,406","$1,285.95",2024258286,1427486,"$88,270,604","$1,935,987,682","$1,356.22",1565619786,1386657,86142000,"$1,479,477,786","$1,066.94",1530605399,1333337,"$83,010,856","$1,447,594,543","$1,085.69","$1,681,733,104","$1,199"
+Arkansas,"$758,369,234","487,174","$26,777,251","$731,591,983","$1,501.71",766685261,484069,"$27,504,709","$739,180,552","$1,527.01",428167920.6,477160,26746000,"$401,421,921",$841.27,439604397.6,468537,"$28,537,364","$411,067,034",$877.34,"$570,815,372","$1,187"
+Wisconsin,"$840,467,094","708,343","$103,064,918","$737,402,176","$1,041.02",923712280,702066,"$103,103,118","$820,609,162","$1,168.85",873748038.2,684172,98417000,"$775,331,038","$1,133.24",896851084.8,664491,"$105,171,626","$791,679,459","$1,191.41","$781,255,459","$1,134"
+South Carolina,"$812,708,391","716,740","$35,441,690","$777,266,701","$1,084.45",851463142,704222,"$38,824,818","$812,638,324","$1,153.95",785505004.1,688017,38335000,"$747,170,004","$1,085.98",702933059.7,664086,"$36,269,889","$666,663,171","$1,003.88","$750,934,550","$1,082"
+Texas,"$3,849,701,692","3,462,609","$117,472,748","$3,732,228,944","$1,077.87",3909597949,3417801,"$128,686,252","$3,780,911,697","$1,106.24",3508492047,3348008,127064000,"$3,381,428,047","$1,009.98",3339515041,3257584,"$129,832,056","$3,209,682,985",$985.30,"$3,526,062,918","$1,045"
+Pennsylvania,"$1,580,959,313","1,531,404","$206,355,657","$1,374,603,656",$897.61,1859335848,1519803,"$203,071,386","$1,656,264,462","$1,089.79",1763565070,1501040,190810000,"$1,572,755,070","$1,047.78",1840924328,1470959,"$209,548,185","$1,631,376,143","$1,109.06","$1,558,749,833","$1,036"
+Georgia,"$1,401,565,045","1,390,079","$55,828,634","$1,345,736,411",$968.10,1554361878,1368909,"$61,157,824","$1,493,204,054","$1,090.80",1398940851,1329078,60387000,"$1,338,553,851","$1,007.13",1384329619,1278355,"$61,702,366","$1,322,627,253","$1,034.63","$1,375,030,392","$1,025"
+Minnesota,"$675,339,852","580,552","$114,498,307","$560,841,545",$966.05,855467619.3,578030,"$114,540,746","$740,926,873","$1,281.81",627828704.9,568643,109335000,"$518,493,705",$911.81,624735821.1,555120,"$116,838,721","$507,897,100",$914.93,"$582,039,806","$1,019"
+District of Columbia,"$105,001,733","86,211","$10,378,501","$94,623,232","$1,097.58",104572864,86989,"$10,474,258","$94,098,606","$1,081.73",89894057.11,84822,9976000,"$79,918,057",$942.19,89802255.5,84086,"$10,687,141","$79,115,115",$940.88,"$86,938,752","$1,016"
+Mississippi,"$522,582,096","503,257","$26,996,355","$495,585,741",$984.76,580340871.2,501248,"$30,120,190","$550,220,681","$1,097.70",490218356.9,494515,29257000,"$460,961,357",$932.15,469420097.1,484212,"$31,590,547","$437,829,550",$904.21,"$486,149,332",$980
+Ohio,"$1,610,134,809","1,574,414","$148,086,520","$1,462,048,289",$928.63,1825551757,1561134,"$154,313,750","$1,671,238,007","$1,070.53",1561664274,1530471,144794000,"$1,416,870,274",$925.77,1639395334,1492534,"$165,463,488","$1,473,931,846",$987.54,"$1,506,022,104",$978
+South Dakota,"$105,875,417","107,643","$20,678,380","$85,197,037",$791.48,156850845,106421,"$20,869,167","$135,981,678","$1,277.77",103930859.7,104359,16712000,"$87,218,860",$835.76,112008985.1,103197,"$21,293,322","$90,715,663",$879.05,"$99,778,309",$946
+Indiana,"$878,518,797","880,376","$75,792,072","$802,726,725",$911.80,950208534.7,870096,"$75,820,165","$874,388,370","$1,004.93",780776439.6,847752,72367000,"$708,409,440",$835.63,762057496.1,819003,"$80,005,509","$682,051,987",$832.78,"$766,894,130",$896
+Kentucky,"$626,870,867","677,807","$44,896,434","$581,974,433",$858.61,721698615.7,670675,"$48,288,203","$673,410,413","$1,004.08",606677254.9,663562,43483000,"$563,194,255",$848.74,593549634.8,648068,"$46,423,070","$547,126,565",$844.24,"$591,426,416",$889
+Oklahoma,"$532,719,187","562,091","$36,338,463","$496,380,724",$883.10,566865510.4,561105,"$37,146,767","$529,718,743",$944.06,485465206,552701,32650000,"$452,815,206",$819.28,487650899.8,545626,"$36,094,358","$451,556,542",$827.59,"$482,617,804",$869
+Missouri,"$797,821,367","841,094","$73,771,730","$724,049,637",$860.84,872150693.9,836998,"$70,882,484","$801,268,210",$957.31,702093920.3,819201,66553000,"$635,540,920",$775.81,706735026.5,801132,"$68,231,128","$638,503,899",$797.00,"$699,840,666",$848
+Tennessee,"$895,754,787","981,213","$55,160,955","$840,593,832",$856.69,964159467.2,965647,"$58,039,595","$906,119,872",$938.36,798525125,947437,56856000,"$741,669,125",$782.82,799921872.4,925291,"$55,405,327","$744,516,545",$804.63,"$808,224,844",$846
+Iowa,"$341,406,051","375,402","$53,714,858","$287,691,193",$766.35,467613321.7,373149,"$53,734,767","$413,878,555","$1,109.15",298573816.9,370855,51292000,"$247,281,817",$666.79,312674090.8,363566,"$54,812,821","$257,861,270",$709.26,"$301,678,209",$813
+Florida,"$2,234,644,838","2,732,449","$70,610,762","$2,164,034,076",$791.98,2317610164,2679560,"$77,350,999","$2,240,259,165",$836.05,2018393519,2600442,76356000,"$1,942,037,519",$746.81,2083677669,2488875,"$78,039,720","$2,005,637,949",$805.84,"$2,087,992,177",$795
+Kansas,"$324,279,706","363,534","$30,716,744","$293,562,962",$807.53,369377799.3,362432,"$31,019,030","$338,358,769",$933.58,290036136.2,356823,31367000,"$258,669,136",$724.92,277431680.3,348442,"$32,159,734","$245,271,946",$703.91,"$283,965,703",$792
+Nebraska,"$232,421,588","231,942","$29,352,674","$203,068,914",$875.52,288848832.5,229756,"$29,623,498","$259,225,335","$1,128.26",138325203.8,224091,28196000,"$110,129,204",$491.45,136530040.6,219254,"$30,225,576","$106,304,465",$484.85,"$169,681,979",$745
+Illinois,"$1,333,485,158","1,535,274","$167,395,704","$1,166,089,454",$759.53,1134231095,1516189,"$167,457,747","$966,773,348",$637.63,1209217064,1485292,160191000,"$1,049,026,064",$706.28,1331523388,1443347,"$185,683,819","$1,145,839,569",$793.88,"$1,081,932,109",$724
+New Mexico,"$278,306,651","326,753","$17,844,351","$260,462,300",$797.12,319834724.4,320262,"$16,734,368","$303,100,356",$946.41,153529243.4,316343,14670000,"$138,859,243",$438.95,157886700.5,310347,"$17,074,485","$140,812,216",$453.73,"$210,808,529",$659
+Louisiana,"$453,710,257","693,029","$38,389,693","$415,320,564",$599.28,504752928.6,678483,"$42,062,123","$462,690,806",$681.95,450692283.1,666765,40864000,"$409,828,283",$614.65,376498180.4,653335,"$43,421,576","$333,076,604",$509.81,"$405,229,064",$601
+California,"$3,182,116,879","4,557,152","$174,086,117","$3,008,030,762",$660.07,2955813901,4469995,"$153,591,640","$2,802,222,261",$626.90,2497506873,4339796,144173000,"$2,353,333,873",$542.27,2131417175,4178274,"$154,574,436","$1,976,842,739",$473.12,"$2,535,107,409",$576
+Montana,"$80,649,126","147,333","$23,437,755","$57,211,371",$388.31,107246350.7,145952,"$23,654,004","$83,592,347",$572.74,84128852.18,144883,18591000,"$65,537,852",$452.35,91397005.68,141259,"$24,134,757","$67,262,249",$476.16,"$68,400,955",$472
+Oregon,"$320,725,094","567,373","$35,931,461","$284,793,633",$501.95,293770938.3,553081,"$35,944,777","$257,826,161",$466.16,258753765,540211,33674000,"$225,079,765",$416.65,271701797.6,524510,"$36,665,921","$235,035,877",$448.11,"$250,683,859",$458
+Arizona,"$333,522,974","932,156","$21,581,391","$311,941,583",$334.65,328226042.8,912649,"$23,641,470","$304,584,573",$333.74,483201879.8,881292,21437000,"$461,764,880",$523.96,462925175.4,844522,"$23,851,970","$439,073,205",$519.91,"$379,341,060",$428
+Idaho,"$120,169,561","227,518","$19,982,119","$100,187,442",$440.35,151220662,224902,"$20,166,484","$131,054,178",$582.72,87034338.2,220304,18275000,"$68,759,338",$312.11,86655151.06,212418,"$20,576,356","$66,078,795",$311.08,"$91,519,938",$412
+Wyoming,"$36,985,819","65,005","$9,531,206","$27,454,613",$422.35,42102642.78,63828,"$9,619,145","$32,483,498",$508.92,29856766.65,63154,8866000,"$20,990,767",$332.37,31917475.16,60402,"$9,814,649","$22,102,826",$365.93,"$25,757,926",$407
+Colorado,"$267,980,834","606,297","$48,889,437","$219,091,397",$361.36,326046830.8,599483,"$46,377,830","$279,669,001",$466.52,252665859.5,584640,44270000,"$208,395,860",$356.45,266402939,566423,"$47,308,286","$219,094,653",$386.80,"$231,562,728",$393
+Washington,"$331,013,517","797,879","$59,102,303","$271,911,214",$340.79,356558639.7,783172,"$59,124,210","$297,434,430",$379.78,328604567.8,762840,54401000,"$274,203,568",$359.45,332734291.2,738050,"$60,310,389","$272,423,902",$369.11,"$278,993,278",$362
+Nevada,"$106,300,279","368,097","$10,136,137","$96,164,142",$261.25,108706127.5,355431,"$11,103,694","$97,602,434",$274.60,141949510.9,337075,10964000,"$130,985,511",$388.59,148899587.2,313813,"$11,202,561","$137,697,026",$438.79,"$115,612,278",$341
+Utah,"$140,984,390","292,728","$23,805,517","$117,178,873",$400.30,125777423.5,289087,"$24,025,160","$101,752,264",$351.98,104006153.3,280393,22493000,"$81,513,153",$290.71,98763117.39,267122,"$24,513,456","$74,249,661",$277.96,"$93,673,488",$330