Dev op concat (#217)

* added conda env for notebooks * added concat notebook * update concat nb * update nb * added mem profile * update mem profile * update nb * added example with aggregation * update nb * added readme * update static nb * using combine_nested * update nbs for day datasets * use mem prof with day * added diskcache example notebook * use pickle cache * added dummy concat operator * use concat args * fixed concat operator * use cmip6 decadal test data * fixed concat test * update conda env * use default collection parameter * add concat op to workflow * use realization dim * update roocs-utils * fix concat test
roocs · Sep 27, 2022 · d0671ef · d0671ef
1 parent edff736
commit d0671ef
Show file tree

Hide file tree

Showing 23 changed files with 4,859 additions and 2 deletions.
diff --git a/environment.yml b/environment.yml
@@ -13,12 +13,13 @@ dependencies:
 # daops
 - cftime>=1.2.1
 - xarray>=0.20,<0.22
+- cf_xarray>=0.7
 - dask>=2021.12
 - netcdf4>=1.4
 - bottleneck>=1.3.1,<1.4
 - daops>=0.8.1,<0.9
 - clisops>=0.9.2,<0.10
-- roocs-utils>=0.6.2,<0.7
+- roocs-utils>=0.6.3,<0.7
 # workflow
 - networkx
 # provenance

diff --git a/notebooks/.gitignore b/notebooks/.gitignore
@@ -0,0 +1 @@
+*.nc
diff --git a/notebooks/README.md b/notebooks/README.md
@@ -0,0 +1,5 @@
+# Compare concat performance for cmip6-decdal
+
+* [static](https://nbviewer.org/github/roocs/rook/blob/dev-op-concat/notebooks/concat_static_profile.ipynb)
+* [aggregation](https://nbviewer.org/github/roocs/rook/blob/dev-op-concat/notebooks/concat_dynamic_agg_profile.ipynb)
+* [dynamic concat](https://nbviewer.org/github/roocs/rook/blob/dev-op-concat/notebooks/concat_dynamic_profile.ipynb)