-
Notifications
You must be signed in to change notification settings - Fork 10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Bnb/fp output #41
Bnb/fp output #41
Conversation
…bclassed for NETCDF.
…n fix in data handler parallel norm method.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This looks good, but our priority needs to be the flattened output h5 data because that is our desired final product.
sup3r/pipeline/forward_pass.py
Outdated
logger.info('Combining forward pass output for ' | ||
f'{cls.file_info_logging(file_paths)}') | ||
@classmethod | ||
def write_output(cls, data, features, bottom_left_corner, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
At some point we need to save meta data about the GAN used to generate this output.
…ctly. Added lat/lon/time interpolation to output handler.
@bnb32, the meta data interpolation still fails. This test should be a bare minimum acceptance criteria (feel free to add to the test suite): test_meta_interp.py.txt Also, can we make sure the preprocessing / post_processing modules both either have underscores or do not? Thats going to make importing a nightmare. |
Lol yeah I realized the underscore annoyance as well. Good test will add that thanks. |
…rom h5_output branch
Basic netcdf output handling for forward pass results. Added some more parallelization for feature loading and normalization. Added new model configs for full production models. Forward pass test for fp -> netcdf -> fp included and working.