Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Start splitting up the cloud test suite #70

Merged
merged 28 commits into from
Jan 28, 2021
Merged

Conversation

jbusecke
Copy link
Owner

No description provided.

@jbusecke jbusecke mentioned this pull request Jan 27, 2021
@jbusecke
Copy link
Owner Author

I think I finally got this to run properly. I have converted the grid_label, variable_id, and experiment_id to fixtures that are defined via command line inputs. I use these to separate the tests into a matrix of GHA jobs.
I think I finally figured out how to conditionally fail certain combinations of parameters for each test, allowing for very fine grained control/documentation which cases do cause problems. The xfail-strict option also allows detection of problems just 'fixing themselves' e.g. via changes introduced to the raw data.

@jbusecke
Copy link
Owner Author

Just as a record. This in combination with the indirect=True option seem to have been the crucial parts to get this going.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant