Skip to content

ECC-2222: Add model keyword for indexing of DestinE On-demand-extremes-dt (DE330) data#434

Merged
joobog merged 6 commits intohotfix/2.46.1from
feature/ECC-2222-model-for-de330
Mar 16, 2026
Merged

ECC-2222: Add model keyword for indexing of DestinE On-demand-extremes-dt (DE330) data#434
joobog merged 6 commits intohotfix/2.46.1from
feature/ECC-2222-model-for-de330

Conversation

@mjg41
Copy link
Collaborator

@mjg41 mjg41 commented Mar 12, 2026

Description

The on-demand-extremes-dt routinely runs multiple models covering the same period, such as different NWP models (ALARO, AROME, HARMONIE-AROME) as well as several impact models (AQ, Hydrology, renewables, wildfire etc.).

Thus it makes sense to introduce the model keyword introduced in other datasets such as class=ai and the new hydrology data layout also to on-demand-extremes data. We will add the model keyword in the same way here.

ADR approved, to be merged at: ecmwf/codex#40

Contributor Declaration

By opening this pull request, I affirm the following:

  • All authors agree to the Contributor License Agreement.
  • The code follows the project's coding standards.
  • I have performed self-review and added comments where needed.
  • I have added or updated tests to verify that my changes are effective and functional.
  • I have run all existing tests and confirmed they pass.

… done post metadata otherwise the metadata for the modelName is not yet defined as they come in Section 4.

Thus we use logic in post_meta_data.hook for productionstatus 12/13.
I also take this opportunity to refactor that into includes to prevent duplicated code.
@mjg41 mjg41 requested review from joobog and shahramn March 12, 2026 17:02
@mjg41 mjg41 self-assigned this Mar 12, 2026
@codecov-commenter
Copy link

Codecov Report

✅ All modified and coverable lines are covered by tests.
⚠️ Please upload report for BASE (hotfix/2.46.1@dde9f28). Learn more about missing BASE report.

Additional details and impacted files
@@               Coverage Diff                @@
##             hotfix/2.46.1     #434   +/-   ##
================================================
  Coverage                 ?   88.51%           
================================================
  Files                    ?      849           
  Lines                    ?    63104           
  Branches                 ?    11226           
================================================
  Hits                     ?    55856           
  Misses                   ?     7248           
  Partials                 ?        0           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@joobog joobog added the approved-for-ci Approved to run CI on ECMWF machines label Mar 13, 2026
@mjg41 mjg41 changed the title Add model keyword for indexing of DestinE On-demand-extremes-dt (DE330) data ECC-2222: Add model keyword for indexing of DestinE On-demand-extremes-dt (DE330) data Mar 13, 2026
Copy link
Collaborator

@joobog joobog left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, implemented as discussed.

Copy link
Collaborator

@shahramn shahramn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks OK to me

@joobog joobog merged commit 0ff88b8 into hotfix/2.46.1 Mar 16, 2026
1551 of 1637 checks passed
@joobog joobog deleted the feature/ECC-2222-model-for-de330 branch March 16, 2026 13:45
joobog pushed a commit that referenced this pull request Mar 16, 2026
…s-dt (DE330) data (#434)

* ECC-2222: First try

* ECC-2222: Approach suggested by Eugen, which looks good. Want to do a bit more testing to confirm.

* ECC-2222: Concept and aliasing into mars namespace must ultimately be done post metadata otherwise the metadata for the modelName is not yet defined as they come in Section 4.
Thus we use logic in post_meta_data.hook for productionstatus 12/13.
I also take this opportunity to refactor that into includes to prevent duplicated code.

* ECC-2222: Newline suggested by copilot.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved-for-ci Approved to run CI on ECMWF machines

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants