Skip to content

fix(tests): use local ignore list in solve regression tests#606

Merged
lewisjared merged 2 commits intomainfrom
fix/solve-regression-local-ignore-list
Mar 30, 2026
Merged

fix(tests): use local ignore list in solve regression tests#606
lewisjared merged 2 commits intomainfrom
fix/solve-regression-local-ignore-list

Conversation

@lewisjared
Copy link
Copy Markdown
Contributor

@lewisjared lewisjared commented Mar 30, 2026

Description

The solve regression tests were using Config.default() which downloads default_ignore_datasets.yaml from the main branch on GitHub. This caused tests to fail when the local ignore list was updated (e.g. adding new entries to sea-ice-sensitivity) but the cached remote version hadn't refreshed yet.

This adds a solve_config session-scoped fixture to conftest_plugin.py that points to the repo's local default_ignore_datasets.yaml, and updates all three provider regression test files (esmvaltool, pmp, ilamb) to use it.

The production download-from-GitHub behavior is unchanged -- only tests now use the local file.

Checklist

Please confirm that this pull request has done the following:

  • Tests added
  • Documentation added (where applicable)
  • Changelog item added to changelog/

The solve regression tests were using Config.default() which downloads
the ignore list from the main branch on GitHub. This caused tests to
fail when the local default_ignore_datasets.yaml was updated but the
remote version hadn't been refreshed yet.

Add a solve_config fixture that points to the repo's local
default_ignore_datasets.yaml and use it in all three provider
regression test files.
@codecov
Copy link
Copy Markdown

codecov Bot commented Mar 30, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.

Flag Coverage Δ
core 93.18% <ø> (ø)
providers 91.80% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.
see 35 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@lewisjared lewisjared merged commit 904bcfb into main Mar 30, 2026
26 checks passed
@lewisjared lewisjared deleted the fix/solve-regression-local-ignore-list branch March 30, 2026 14:52
lewisjared added a commit that referenced this pull request Mar 30, 2026
…f into pmp-mov-issue-583

* 'pmp-mov-issue-583' of github.com:Climate-REF/climate-ref:
  chore: add changelog for #606
  fix(tests): use local ignore list in solve regression tests
  Add docs on configuring Dask
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant