Poll and aggregate multiple "agencies"

[thekaveman]

Unlike the DAP, we don't have One Analytics Account to Rule Them All

Sites such as http://bigbluebus.com, http://smpl.org, and http://santamonicapd.org are tracked under different accounts, different properties, different views 😢

It would be really cool if we could poll all of our individual "agencies" - BBB, library, police, fire, others - and aggregate into unified data files (one for each report type), to be consumed by the dashboard.

[allejo]

@thekaveman would you be able to add .env files with the other IDs? I can tackle aggregating the data from there

[thekaveman]

@allejo will do

[thekaveman]

see 361d487

[allejo]

Progress of aggregation branch:

• Aggregate the data
  • Figure out how to keep same structure of each data object (it's hard coded atm)
• Check to see if the data looks correct
• Aggregate CSV data too?
• Get this working on Azure with the correct paths
• Clean up

[thekaveman]

Would it be possible to just turn the aggregated JSON into CSV? (Rather than re-aggregating into CSV)

[allejo]

Yea it would be, the CSV files are typically the data array in the JSON data or some other unique values like totals['totals']['browser'] (e.g. browser.json)

[allejo]

Moved to #9