Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tiny fix to make FERC to EIA tests xfail #3257

Merged
merged 2 commits into from
Jan 19, 2024
Merged

Conversation

katie-lamb
Copy link
Member

@katie-lamb katie-lamb commented Jan 18, 2024

Overview

Addresses 3 of the 4 test/integration/ferc1_eia_train_test.py::test_validate_override_fixes tests that should XFAIL but don't as mentioned in #3251 . If we don't care about this patch to make those 3/4 tests XFAIL and just want to address the larger problem in a larger PR, then no need to merge this.

What problem does this address?

The following tests should XFAIL but don't because of a small issue with how the parameters are set in the test_validate_override_fixes test.

test/integration/ferc1_eia_train_test.py::test_validate_override_fixes[verified4-report_year4-record_id_eia_override_14-record_id_ferc14-utility_id_pudl_ferc14]
test/integration/ferc1_eia_train_test.py::test_validate_override_fixes[verified5-report_year5-record_id_eia_override_15-record_id_ferc15-utility_id_pudl_ferc15]
test/integration/ferc1_eia_train_test.py::test_validate_override_fixes[verified6-report_year6-record_id_eia_override_16-record_id_ferc16-utility_id_pudl_ferc16]

Based on a scan of the history with this test, I don't think these parameters have ever been correctly set, and these tests have never XFAILed, but I've never touched this test before so I'm not entirely sure.

What did you change?

Since it was a really simple change, I just updated those parameters. But that's really just a patch for the larger issue in this test, which I've moved into #3256 .

Testing

How did you make sure this worked? How can a reviewer verify this?

To-do list

Edit tasklist title
Beta Give feedback Tasklist To-do list, more options

Delete tasklist

Delete tasklist block?
Are you sure? All relationships in this tasklist will be removed.
  1. Make sure full ETL runs & make pytest-integration-full passes locally
    Options
  2. For major data coverage & analysis changes, run data validation tests
    Options
  3. If updating analyses or data processing functions: make sure to update or write data validation tests
    Options
  4. Update the release notes: reference the PR and related issues.
    Options
  5. Review the PR yourself and call out any questions or issues you have
    Options

@katie-lamb katie-lamb mentioned this pull request Jan 18, 2024
8 tasks
@zaneselvans
Copy link
Member

It seems like it's more correct for the tests marked xfail to fail, and if it's just that these parameters were set incorrectly, that seems like a good change. We can refactor the tests in an actual sprint plan.

@katie-lamb katie-lamb marked this pull request as ready for review January 19, 2024 17:46
@katie-lamb katie-lamb enabled auto-merge (squash) January 19, 2024 17:47
@katie-lamb katie-lamb merged commit 8503c65 into main Jan 19, 2024
18 checks passed
@katie-lamb katie-lamb deleted the ferc_to_eia_test_fix branch January 19, 2024 19:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

None yet

2 participants