Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changed US-MIDW-MISO parser to use EIA instead #3009

Merged
merged 3 commits into from
Feb 24, 2021

Conversation

FelixDQ
Copy link
Member

@FelixDQ FelixDQ commented Feb 24, 2021

Resolves #2725

The current data source is coming in very spotty. We investigated the opportunity of estimating the unknown breakdown, but it turned out to be rather difficult, and we don't want to make too many assumptions.

It's a bit unfortunate because EIA isn't real-time (It's delayed up to 30 hours afaik), so it won't always show up on the map. It would be shown when the historical view has been implemented #2393

I backed up the old data, so we can potentially switch back if we find a fix.

@optimap-prime
Copy link

optimap-prime bot commented Feb 24, 2021

Thanks for your contribution! ⚡️

A few things to be aware of:

  • add your GitHub username (https://github.com/FelixDQ) to the contributors list in config/zones.json for zone US-MIDW-MISO
  • update DATA_SOURCES.md if you made changes to a data source

Potential reviewer(s): @systemcatch

@optimap-prime optimap-prime bot added change requested A change was requested from the contributor parser labels Feb 24, 2021
@corradio
Copy link
Member

corradio commented Feb 24, 2021

@FelixDQ (cc @skovhus) should we keep unused parsers around? Any opinions? They might be useful for the community.

@FelixDQ
Copy link
Member Author

FelixDQ commented Feb 24, 2021

Hmm. I don't have a strong opinion here. I'm a bit hesitant to delete it if people are finding it useful. It also makes it slightly easier to switch back if that becomes relevant. On the other hand, it could clutter the parser folder a bit if we keep them around.

@systemcatch
Copy link
Collaborator

I would prefer the old parser is left in place, the file size is tiny and it would save quite a bit of time if you wanted to switch back in the future. How about marking it with a comment linked to relevent issues and moving it to an old_parsers directory?

@skovhus
Copy link
Contributor

skovhus commented Feb 24, 2021

I'm usually all for deleting code that we already have in the git history. But in this case, I think it makes sense to keep.

How about marking it with a comment linked to relevent issues and moving it to an old_parsers directory?

I might be overthinking this, but I see an old_parsers folder might quickly become out of sync as we would start using those by changing the zones.json file.

We could have a script that prints out parsers that are not used – we could even do a unit test that prints out parsers that are not used. 🤔

@corradio
Copy link
Member

corradio commented Feb 24, 2021 via email

@FelixDQ
Copy link
Member Author

FelixDQ commented Feb 24, 2021

👍 I agree. In that case, are there any changes I should do to this PR?

@corradio
Copy link
Member

👍 I agree. In that case, are there any changes I should do to this PR?

LGTM

@FelixDQ FelixDQ merged commit 6fcddea into master Feb 24, 2021
@FelixDQ FelixDQ deleted the fq/update-us-midw-miso-parser-to-eia branch February 24, 2021 14:38
con-cat pushed a commit to con-cat/electricitymap-contrib that referenced this pull request May 18, 2021
* Changed US-MIDW-MISO parser to use EIA instead

* Added delay to zone config

* Updatd DATA_SOURCES
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
change requested A change was requested from the contributor parser
Projects
None yet
Development

Successfully merging this pull request may close these issues.

US-MIDW-MISO: Reporting negative unknown production
4 participants