Skip to content
This repository has been archived by the owner on May 12, 2021. It is now read-only.

CLIMATE-838 - Update configuration files and example scripts to use new DatasetLoader #384

Merged
merged 4 commits into from Aug 9, 2016

Conversation

agoodm
Copy link
Member

@agoodm agoodm commented Aug 9, 2016

This PR makes the following changes:

  • Datasets are now loaded from the new DatasetLoader class in run_RCMES.py.
  • I also cleaned up run_RCMES.py to make it more closely conform to PEP8, in particular I made many blocks of code multiline to make them more readable. There is still much more that can be done, but this seems like a good start.
  • Several variable names had to be changed in the config files in order to make them compatible with DatasetLoader. Also note that new blocks of info for each dataset loader are now denoted by a dash (-) under reference and targets. This will make it easy to use multiple loaders in each file.

Note that the capability of handling more than one reference (observation) dataset is still not included, I am saving that for a separate JIRA issue / PR. Right now getting these fundamental changes out of the way and making sure everything else works is a bigger priority.

So far I have only tested these changes for one config file (RCMES/configuration_files/cordex_AF_prec_subregion_annual_cycle_time_series.yaml). @huikyole, please feel free to make comments and keep me posted here.

@OCWJenkins
Copy link

Can one of the admins verify this patch?

ref_dataset = dsp.temporal_subset(ref_dataset,month_start, month_end,average_each_year)
for idata,dataset in enumerate(model_datasets):
model_datasets[idata] = dsp.temporal_subset(dataset,month_start, month_end,average_each_year)
# TODO: Fully support multiple observation / reference datasets.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to open another JIRA issue for this.

@huikyole
Copy link
Contributor

huikyole commented Aug 9, 2016

This PR is a major breakthrough in RCMES development.

@asfgit asfgit merged commit 93971e1 into apache:master Aug 9, 2016
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
4 participants