merge tung exps #105
Merged
merge tung exps #105
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
jasonjewik
added a commit
that referenced
this pull request
Jul 6, 2023
* Scripts for table 1 * Fixed typos in table1.py * Temp fix * iter module working with new refactor * Checkpoint Tried to get ShardDataset working. Switching to IterDataset. * Update table 1 code * Adding table experiments for other architectures * Update ViT architecture * Add notebook * Checkpoint * Checkpointing * Updated log dir for checkpoints * Checkpoint * Fix mse, rmse, and acc metrics * Update acc code * Reduce precision, change early stopping metric * Fixes * add lr monitor, modify checkpointing, use ddp instead of ddp_spawn * modify logging keys to separate train/val/test * use normalized lat_mse as a validation metric * change training setting * Checkpoint * Downscaling * DL models for downscaling * Pearson now does not rely on scipy * ViT experiment and PRISM support * Multiple transformation bug fix * fix duplicate denormalization bug * add ReduceLROnPlateau scheduler * update gitignore * fix resnet to match with weatherbench implementation * current best setting * update projection and prediction layers for unet * update run scripts for resnet and unet * avoid spiking loss * update vit models and scripts * Downscaling exp changes * Downscaling changes * rollback resnet and unet architectures * Merge Tung's changes * Downscaling updates * use 16 precision * CMIP6 running with iterdatamodule * add continuous data modules * update nc2npz to accumulate precipitation data * merge tung exps (#105) * avoid spiking loss * update vit models and scripts * rollback resnet and unet architectures * use 16 precision * add continuous data modules * update nc2npz to accumulate precipitation data --------- Co-authored-by: Tung Nguyen <ductungnguyen1997@gmail.com> * ERA5 downscaling updates * use 1 worker, somehone increasing # workers affects performance * update scripts to be consistent * prepare iterative exps * Downscaling checkpoint: PRISM implemented * evaluate iterative models * summarize results * update json results and add plot scripts * Add probabilistic metrics * Add class metrics * Add rank histogram visualization * update plot script * add climatebench experiments * Disable all data tests * Formatting * Fix trainer * Cleanup files * Moved processing scripts, added PRISM processing * Cleanup data downloading * Add CLI utility for downloads, processing scripts * Combine iter modules * Add data modules * Reorganize files * Remove unused notebooks * Cleaning utilities * Add visualizations for bias and mean bias * Add rank histogram visualization * Organize experiments, add ERA5 crop script * Clean up downscaling and climate projection * Add forecasting baselines * Cleanup forecasting experiments * Removed unneeded tables * Add climate projection experiments * Iterative forecasting experiments * Iterative forecasting experiments * Add extreme ERA5 * Changes for quickstart notebook * Update notebooks * Formatting * Update era5_constants.py Add units for variables * Update cmip6_constants.py Add units for variables. * Add units for visualizations * Updates for notebook * Update docs and notebook * Update docs * Finish tasks and datasets * Finish docs * Update configs * Fix pyproject.toml * Remove rasterio version for rtd * Change rtd python version * Add OS * Add images * v1 release --------- Co-authored-by: Prakhar Sharma <prakhar6sharma@gmail.com> Co-authored-by: tung-nd <ductungnguyen1997@gmail.com> Co-authored-by: Prakhar Sharma <37648724+prakhar6sharma@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.