Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Include file looping #387

Merged
merged 18 commits into from
Apr 9, 2024
Merged

Include file looping #387

merged 18 commits into from
Apr 9, 2024

Conversation

jfrost-mo
Copy link
Member

@jfrost-mo jfrost-mo commented Feb 8, 2024

Based on #379

Fixes #361

To Do

  • Tests

@jfrost-mo jfrost-mo changed the base branch from main to 307_sequential_plot_display February 8, 2024 16:22
Copy link
Contributor

github-actions bot commented Feb 8, 2024

Coverage

@jfrost-mo
Copy link
Member Author

To get the deterministic output file working we need to add the hashing inside the cset cli, as that has the templated recipe.

@jfrost-mo jfrost-mo force-pushed the 361_include_file_looping branch 2 times, most recently from 2fc6fc2 to 8c16858 Compare February 12, 2024 09:36
@jfrost-mo jfrost-mo force-pushed the 361_include_file_looping branch 4 times, most recently from 6cc76df to 3f5fc96 Compare February 13, 2024 16:10
@jfrost-mo jfrost-mo marked this pull request as ready for review February 13, 2024 16:12
@jfrost-mo
Copy link
Member Author

This is ready to go as soon as #379 is merged. (and it is reviewed)

Add tests for generate_pressure_level_constraint

Test exception when filter_cubes returns multiple cubes

Also tests the inner workings of the pressure constraint.
This is the result of an effort to make the plot ID deterministically
generated though it became apparent this wasn't the right place to implement
it.

Make plot ID deterministically generated

The plot ID is now the SHA256 hash of the recipe. As this is deterministic
it will allow updating plots in other cycles.

Revert to UUID for plot ID as hashing isn't working

We can't hash the recipe there as the templating hasn't yet happened.
This allows it to be found more easily, and is isolated per cycle.

Replace MASS script with simpler bash one

Replace plots folder with dynamically created symlink
This cleans up the initial download of the raw data after each cycle.
Copy link
Contributor

@Sylviabohnenstengel Sylviabohnenstengel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Happy with changes, need to test drive the capability. Added one question for you.

@Sylviabohnenstengel
Copy link
Contributor

Sylviabohnenstengel commented Mar 20, 2024

@jfrost-mo I added date and validity time as subtitle to the plot operator on this branch. Please could you take a look as some of the tests fail with not allowing a leading zero in the format statement. I removed the leading 0 from the formatting for year, but need to keep them for month, day, hour and minute to allow for days between 1-9 etc in the timestamp. WIthout the 0 in the formatting we get the following tomestamp:
image

src/CSET/operators/plot.py Outdated Show resolved Hide resolved
Base automatically changed from 307_sequential_plot_display to main March 25, 2024 11:07
@jfrost-mo jfrost-mo mentioned this pull request Mar 25, 2024
@jfrost-mo jfrost-mo added the enhancement New feature or request label Mar 28, 2024
@jfrost-mo
Copy link
Member Author

@JorgeBornemann will you be able to review this soon?

@JorgeBornemann
Copy link
Collaborator

Working on it. It will be ready on Monday.

@jfrost-mo
Copy link
Member Author

Thanks! :)

@jfrost-mo
Copy link
Member Author

Merging as a prerequisite of #395

@jfrost-mo jfrost-mo merged commit a76ebc3 into main Apr 9, 2024
8 checks passed
@jfrost-mo jfrost-mo deleted the 361_include_file_looping branch April 9, 2024 09:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Looping in include files
3 participants