Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add test case to verify that all zones in geometries are in zones.json #3817

Merged
merged 17 commits into from
May 19, 2022

Conversation

pierresegonne
Copy link
Member

@pierresegonne pierresegonne commented Feb 23, 2022

Reviewing should be done commit per commit

This PR adds a test case to verify that all zones with geometries are defined in zones.json.

Figured out that we should delete the following zones:

  • NZ-NZN and NZ-NZS, deprecated since last NZ update
  • AUS-ACT not used
  • US-NW-SCL and US-SW-DEAA small US zones whose geometries were deleted in the geography improvement process
  • US-NW-AVRN other small US zone that has never "existed" geographically

And replace US-MIDW-EEI with US-MIDW-GLHB.

Note that for the US zones, all parsers are EIA so backfilling would be possible if we revert some decision.

@pierresegonne pierresegonne self-assigned this Feb 23, 2022
@pierresegonne pierresegonne marked this pull request as ready for review February 23, 2022 15:33
@pierresegonne pierresegonne added techdebt Unpleasantness that does (or may in future) affect development and removed frontend 🎨 labels Feb 24, 2022
Copy link
Contributor

@Kongkille Kongkille left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we also remove US-SW-DEAA from EIA.py?

@pierresegonne
Copy link
Member Author

Good catch, removed it

@KabelWlan
Copy link
Contributor

Should we also remove US-SW-DEAA from EIA.py?

I would not remove that zone since it's still in use. There are times where there's no generation reported (like right now). This zone consists of only one generating station, the Arlington Valley natural gas power plant. As you see on this site it is normal that they don't generate electricity in some months.

Another option which is probably better:
US-SW-DEAA is a "generation-only" zone, there are a few more of those in the USA (HGMA, GRIF,...). Since they send all the power produced to US-SW-SRP we could think about including DEAA generation in SRP since they're the ones using the electricity.

@pierresegonne
Copy link
Member Author

US-SW-DEAA is a "generation-only" zone, there are a few more of those in the USA (HGMA, GRIF,...). Since they send all the power produced to US-SW-SRP we could think about including DEAA generation in SRP since they're the ones using the electricity.

Interesting!

Would you have a mapping of all of these zones by any chance?

If yes, then let's make a subsequent PR where we add the generation only zones to the bigger grids they feed into.

Otherwise the idea behind deleting some of these zones is that they don't currently "really" exist on the map. They are simply too small to display correctly on the map.

@KabelWlan
Copy link
Contributor

Here is a map of all the zones we have for the USA. The yellow dots are "generation-only" zones. The ones connecting to only one "consumption and generating zone" could be included quite easily (don't mind their coloring fo all the consumption and generating zones, this just shows if the consumption is increasing or decreasing). However, there are some which interconnect to multiple zones. Those are more difficult to split up.
EIA

To be more specific, this is a list of which zones I'd include into other ones:

  • Include US-SW-DEAA into US-SW-SRP
  • Include US-SW-HGMA into US-SW-SRP
  • Include US-SW-GRIF into US-SW-WALC
  • Include US-NW-GWA into US-NW-NWMT
  • Include US-NW-WWA into US-NW-NWMT
  • Include US-NW-AVRN gas generation into US-NW-PACW and wind generation into US-NW-BPAT

Then there's US-NW-GRID which makes things more complicated. Wind generation is only transmitted to US-SW-PNM but it's not clear where solar, coal and gas really go, either to US-SW-SRP or US-NW-BPAT.
It's also not clear where US-MIDW-GLHB, US-CAR-SEPA and US-CAR-YAD generating is going to. So we either delete them because they're too small or we leave them as they are right now.

I agree, that less small zones make the map easier to understand. Also it would make things more transparent since some emissionfactors could change quite a bit.

You can doubble check all the information here and if something is unclear, reach out to me again.

@pierresegonne
Copy link
Member Author

Great! Thanks for the details, will include these in a following commit

@madsnedergaard
Copy link
Member

Would be good to wrap this up - let me know if we should take over on it :)

@corradio
Copy link
Member

Might be worth taking a look (and possibly closing #3359)

@github-actions github-actions bot added the tests label May 19, 2022
Copy link
Contributor

@Kongkille Kongkille left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Alright, I've tried to update with latest changes, and it seems to look good so lets get it in :)

@Kongkille Kongkille merged commit 266d117 into master May 19, 2022
@Kongkille Kongkille deleted the ps/add_test_case_for_equal_zone_keys_2 branch May 19, 2022 13:31
@pierresegonne
Copy link
Member Author

yihouuuuu

@pierresegonne
Copy link
Member Author

[Post merge comment]
What actually happened in this PR:

  • Introduction of test to verify that all zones in world.json have their counterpart in zones.json
  • Delete zones from config:
    • AUS-ACT
    • NZ-NZN
    • NZ-NZS
  • Replaced US-MIDW-EEI with US-MIDW-GLHB

I've created a subsequent issue to handle other small US zones #4173

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
frontend 🎨 parser techdebt Unpleasantness that does (or may in future) affect development tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants