Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support context configurations (spatial/temporal subsets) and climatology-derived-configs. #39

Merged
merged 49 commits into from Nov 30, 2020

Conversation

kwilcox
Copy link
Member

@kwilcox kwilcox commented Nov 25, 2020

Superseding #33

This combines the work @yosoyjay worked on for generating configurations based on climatology datasets and the work I've been doing to add support for contextual QC configurations (temporal and spatial subsets).

Left to do:

  • Fix and add notebooks using new-style configurations and result yielding. Make sure they all reflect current best-practices in ioos_qc
  • Document all of these changes in sphinx

kwilcox and others added 30 commits November 16, 2020 16:28
Ability to pass JSON/YAML strings and String.IO objects into loader
Starting to move to the new style YAML loading in `ruamel.yaml`
This is for backwards compat. No test changes... it works the same way.
This allows for namedtuple defaults, which are my fav
# Conflicts:
#	docs/source/usage.rst
#	requirements.txt
kwilcox and others added 8 commits November 20, 2020 13:33
…sults

This change allows us to better handle additional Streams (that actually
stream) and Stores (that can write based on a generator and not a very
confusing dict structure).

This is a huge change and is not backwards compatible with previous Stream
or Store code. To get the functionality of the old return style, you need
to first collect any results using
`ioos_qc.results.collect_results(results, how='dict')`. See all of the
test changes for examples.

This does NOT affect anyone that was using the QC checks directly or
was using  QcConfig.run() or NcQcConfig.run(), both of which remain
backwards compatible.
@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@kwilcox kwilcox mentioned this pull request Nov 25, 2020
@kwilcox kwilcox merged commit c9b1487 into master Nov 30, 2020
@kwilcox kwilcox deleted the config-and-clim branch June 14, 2021 18:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants