-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Ensure complete subplant_id
mapping
#49
Comments
I should check whether subplant ids are used at all in the |
It appears that certain plants/generators that exist in both CEMS EIA-860 are missing from the crosswalk. One reason for this might be that we currently inner join the CEMS ids with EIA ids from EIA-923 and not EIA-860, but it is possible that EIA-860 is more complete. |
One example of a missing plant is |
So at least part of the issue was that when we were filtering the CEMS data using the EPA crosswalk, certain units were being dropped because of a mismatch in |
Maybe we can get this fixed in PUDL: catalyst-cooperative/pudl#1769 |
Fuel category differences within subplants with
|
Since hourly data is shaped at the subplant level, I think this does end up affecting currently released data. |
I think that one way to fix this issue would be to take advantage of the existing |
As noted in catalyst-cooperative/pudl#1769 (comment), I've actually noticed that the current subplant id mapping is not behaving as expected (mapping units to generators and boilers) because it ignores all of the boiler-generator associations. |
Currently, subplant IDs are only created for units that exist both in CEMS and EIA-923, meaning that there are certain generators/units that have a subplant ID of
NaN
.subplant_id
as one of the keys are not dropping observations with missing subplant values.pudl.analysis.epa_crosswalk
code to generate subplant IDs for all boilers/generators that exist in the EIA data, regardless of whether data exists in CEMS.The text was updated successfully, but these errors were encountered: