Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

update predefined catalogs (deltares_data & artifact_data) #833

Merged
merged 134 commits into from
Jul 1, 2024
Merged

update predefined catalogs (deltares_data & artifact_data) #833

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
134 commits
Select commit Hold shift + click to select a range
3ed4bd3
Updated first couple of datasets in deltares_data.yml datacatalog
Tjalling-dejong Nov 9, 2023
d93f9a5
Added processing scripts/notes tags where necessary #356
Tjalling-dejong Nov 10, 2023
1afa979
Merge branch 'main' into improve_reproducibility_dd
Tjalling-dejong Nov 30, 2023
4a9d791
Updated kwargs to driver_kwargs
Tjalling-dejong Nov 30, 2023
4c215db
Updated deltares datacatalog with data version and added variants whe…
Tjalling-dejong Nov 30, 2023
94ba815
updated data catalog sources with version and where applicable variants
Tjalling-dejong Nov 30, 2023
818002c
Added code for updating meta from variants
Tjalling-dejong Nov 30, 2023
66259fe
updated tests for checking if meta is preserved for variants that hav…
Tjalling-dejong Dec 1, 2023
9d6b346
removed source_version
Tjalling-dejong Dec 1, 2023
77c3055
Updated predefined data catalog changelog
Tjalling-dejong Dec 1, 2023
8d37459
updated changelog
Tjalling-dejong Dec 1, 2023
88ad4f8
Merge branch 'main' into improve_reproducibility_dd
Tjalling-dejong Dec 1, 2023
efe622a
removed '*' era5 path in deltares data catalog and added check in dat…
Tjalling-dejong Dec 7, 2023
fe8ea5a
Added data_type to glofas_uparea
Tjalling-dejong Dec 8, 2023
30aa581
merged dd_era5_quick_fix in branch
Tjalling-dejong Dec 8, 2023
47f7fdc
Set mollweide crs to ESRI:54009 otherwise will error
Tjalling-dejong Dec 15, 2023
a7af219
merged main into branch
Tjalling-dejong Dec 21, 2023
252dab3
fixed failing datacatalog validation tests
Tjalling-dejong Dec 21, 2023
1817fbc
added temporal extent to deltares data
Tjalling-dejong Dec 21, 2023
2bab26b
updated changelog
Tjalling-dejong Dec 21, 2023
c79cc31
Merge branch 'main' into improve_reproducibility_dd
savente93 Jan 2, 2024
9a85eb3
added hydromt version to deltares_data
Tjalling-dejong Jan 10, 2024
2dc66f1
added hydromt versions to aws_data and gcs_cmip6_data data catalogs
Tjalling-dejong Jan 10, 2024
237579f
Updated data catalog version
Tjalling-dejong Jan 10, 2024
dd80683
updated changelog
Tjalling-dejong Jan 10, 2024
cac2cf3
Added spatial extent for raster datasets
Tjalling-dejong Jan 15, 2024
c53b5c9
Added spatial extents to geodataframe
Tjalling-dejong Jan 16, 2024
9a9b6a9
updated data catalog changelog
Tjalling-dejong Jan 16, 2024
0403192
fixed merge conflict
Tjalling-dejong Jan 16, 2024
9ad2aad
removed gtsm_codec_reanalysis dataset from deltares data catalog and …
Tjalling-dejong Jan 16, 2024
cb16e3c
updated data catalog change log
Tjalling-dejong Jan 16, 2024
c4c9239
Merge branch 'main' into improve_reproducibility_dd
Tjalling-dejong Jan 23, 2024
552c142
updated changelog
Tjalling-dejong Jan 23, 2024
9b2ea1a
Merge branch 'main' into improve_reproducibility_dd
Tjalling-dejong Jan 25, 2024
d0a31f3
Merge branch 'main' into improve_reproducibility_dd
Tjalling-dejong Jan 29, 2024
e4acd67
update data catalog readme
Tjalling-dejong Jan 29, 2024
d3323f1
Merge branch 'main' into improve_reproducibility_dd
Tjalling-dejong Feb 1, 2024
7d46830
removed merge conflict statements
Tjalling-dejong Feb 7, 2024
0b56622
Merge branch 'main' into improve_reproducibility_dd
Tjalling-dejong Feb 7, 2024
a356974
Added mapping table for old to new names of datasets in datacatalog
Tjalling-dejong Feb 7, 2024
b4ee491
removed versions from dataset names and added hydro prefix where nece…
Tjalling-dejong Feb 7, 2024
5944ecf
removed source version and unit from meta
Tjalling-dejong Feb 7, 2024
4397c35
removed archived gtsm dataset data catalog
Tjalling-dejong Feb 7, 2024
0174234
trying to add table to rst
Tjalling-dejong Feb 7, 2024
86f1a25
trying to add table to rst
Tjalling-dejong Feb 7, 2024
13d2f31
trying to add table to rst
Tjalling-dejong Feb 7, 2024
0c8e306
test changelog in markdown
Tjalling-dejong Feb 8, 2024
8b2c0ef
added table to changelog
Tjalling-dejong Feb 8, 2024
5d928eb
transefered rst changelog to md changelog
Tjalling-dejong Feb 8, 2024
93b360b
added versions to datasets where possible
Tjalling-dejong Feb 8, 2024
b93ca08
removed source version
Tjalling-dejong Feb 8, 2024
1c4c204
added table with default versions for datasets with variants
Tjalling-dejong Feb 8, 2024
1559bc7
Merge branch 'main' into improve_reproducibility_dd
Tjalling-dejong Feb 8, 2024
4fe7c4d
Merge branch 'main' into improve_reproducibility_dd
Tjalling-dejong Mar 1, 2024
710e378
moved soilgrids_v2 from deltares_data catalog to its own data catalog
Tjalling-dejong Mar 1, 2024
cef7a69
updated artifact_data catalog
Tjalling-dejong Mar 1, 2024
f384955
updated artifact_data in predefined_data_catalog.yml
Tjalling-dejong Mar 1, 2024
166af6e
Update data/catalogs/deltares_data.yml
Tjalling-dejong Mar 1, 2024
8622059
Update data/catalogs/deltares_data.yml
Tjalling-dejong Mar 1, 2024
58d0c41
renamed vito
Tjalling-dejong Mar 1, 2024
07e6be9
Merge branch 'improve_reproducibility_dd' of https://github.com/Delta…
Tjalling-dejong Mar 1, 2024
67c0a44
Update data/catalogs/deltares_data.yml
Tjalling-dejong Mar 1, 2024
284a056
Merge branch 'improve_reproducibility_dd' of https://github.com/Delta…
Tjalling-dejong Mar 1, 2024
fe6a942
added temporal extents for each eobs version
Tjalling-dejong Mar 1, 2024
e630cb9
added nodata to worldclim
Tjalling-dejong Mar 1, 2024
94632b3
updated artifact versions
Tjalling-dejong Mar 1, 2024
b4914e8
review changes and add consistency with epoch in naming
DirkEilander Mar 1, 2024
d138d4c
revert move artifact_data catalog to core
DirkEilander Mar 1, 2024
76ea696
Update data/catalogs/deltares_data.yml
Tjalling-dejong Mar 4, 2024
06170f1
Merge branch 'main' into improve_reproducibility_dd
Tjalling-dejong Mar 4, 2024
6a582a7
fixed typo
Tjalling-dejong Mar 4, 2024
9fa6713
re-revert move artifact data cataloc to core
DirkEilander Mar 4, 2024
555ccb8
fix artifact version in example and test; add artifact data changelog
DirkEilander Mar 4, 2024
e34e355
Merge branch 'main' into improve_reproducibility_dd
DirkEilander Mar 4, 2024
202874e
fix typo in artifacts root (#828)
DirkEilander Mar 6, 2024
a80cb33
Merge branch 'main' into improve_reproducibility_dd
DirkEilander Mar 6, 2024
64c1c16
update artifact data v0.0.8 git hash
DirkEilander Mar 6, 2024
9f4d3f2
Update data catalog (#718)
Tjalling-dejong Mar 6, 2024
69ad608
Revert "Update data catalog" (#831)
Tjalling-dejong Mar 6, 2024
3f1445f
add data catalog versions and data variants to docs
DirkEilander Mar 6, 2024
3a40796
version fixes; unit era5 zarr fix
DirkEilander Mar 6, 2024
d1d0871
Merge branch 'main' into improve_reproducibility_dd
DirkEilander Mar 7, 2024
f59f7a5
Main pin pixi 0.15.2 (#839)
deltamarnix Mar 11, 2024
9b7f394
fix mesh_2d_from_rasterdataset for rasterdatasets with multidimension…
roeldegoede Mar 18, 2024
49f3c07
fix get_mesh after xugrid update (#848)
hboisgon Mar 27, 2024
0a1346c
Update pixi lock file (#868)
github-actions[bot] Apr 3, 2024
43fcebe
make zoom level more robust for crs (#851)
DirkEilander Apr 11, 2024
8a446b0
bugfix in clip_bbox for clipping on a bbox outside of rasterdataset (…
roeldegoede Apr 11, 2024
d8120b7
Improved `flw.d8_from_dem` method (#305)
DirkEilander Apr 12, 2024
9cc9eb4
fix renaming issue (#883)
DirkEilander Apr 15, 2024
5dabbc3
fix error message for 0D geometry variable in GeoDataset (#885)
DirkEilander Apr 17, 2024
7079e9b
add EOBS v29.0e deltares_data.yml (#892)
aweerts Apr 19, 2024
c815c86
Merge branch 'main' into improve_reproducibility_dd
Tjalling-dejong Apr 25, 2024
e53b503
updated eobs in deltares_data catalog
Tjalling-dejong Apr 25, 2024
07537c7
Catalogs refactor (#849)
DirkEilander Apr 25, 2024
ce20255
restructured data catalog directory to match main
Tjalling-dejong Apr 25, 2024
563949b
Revert "Catalogs refactor" (#909)
Tjalling-dejong Apr 25, 2024
f1fad0e
Update pixi lock file (#914)
github-actions[bot] May 3, 2024
4b4012d
Update pixi to 0.21.1 (#919)
deltamarnix May 10, 2024
39cc2c5
Refactor Catalogs (#921)
savente93 May 13, 2024
9f065f7
Merge branch 'main' into improve_reproducibility_dd
Tjalling-dejong May 15, 2024
08478c2
fixed failing tests
Tjalling-dejong May 15, 2024
fb8be0d
updated parse_predefined_catalogs.py
Tjalling-dejong May 15, 2024
57a930d
updated artifact_data v0.0.8
Tjalling-dejong May 15, 2024
dac6742
bug fixed archive extraction
Tjalling-dejong May 15, 2024
0e8b9df
updated data catalog changelog
Tjalling-dejong May 15, 2024
c9ffc63
updated artifact data catalog
Tjalling-dejong May 16, 2024
2ac6e7d
updated registry for artifact_data
Tjalling-dejong May 16, 2024
7cfa04a
Updated .gitattributes for working with yaml files on Windows (#930)
Tjalling-dejong May 21, 2024
ef8766a
Update data/catalogs/artifact_data/v0.0.8/data_catalog.yml
Tjalling-dejong May 22, 2024
95d76b2
Update data/catalogs/artifact_data/v0.0.8/data_catalog.yml
Tjalling-dejong May 22, 2024
fcce980
Update data/catalogs/deltares_data/v0.7.0/data_catalog.yml
Tjalling-dejong May 22, 2024
5ceb03d
Update data/catalogs/deltares_data/v0.7.0/data_catalog.yml
Tjalling-dejong May 22, 2024
b381e67
Update data/catalogs/deltares_data/v0.7.0/data_catalog.yml
Tjalling-dejong May 22, 2024
9123922
Update docs/user_guide/data_existing_cat.rst
Tjalling-dejong May 22, 2024
bc24b95
updated data catalogs with requested changes
Tjalling-dejong May 22, 2024
d8ea9fc
Merge branch 'main' into improve_reproducibility_dd
Tjalling-dejong May 22, 2024
a2e31d1
updated data catalog registry files
Tjalling-dejong May 22, 2024
4b5029e
updated tests
Tjalling-dejong May 22, 2024
c6682fc
updated docs
Tjalling-dejong May 22, 2024
658013c
changed .yaml to .yml
Tjalling-dejong May 23, 2024
7c240e0
Merge branch 'v1' into improve_reproducibility_dd
Tjalling-dejong Jun 20, 2024
3ac134c
restored plugins.py
Tjalling-dejong Jun 20, 2024
e454b82
updated registry.txt for data catalogs
Tjalling-dejong Jun 20, 2024
ccadb91
updated deltares_data
Tjalling-dejong Jun 20, 2024
033f852
updated registry.txt files
Tjalling-dejong Jun 20, 2024
d9b7938
updated test_data_catalog.py
Tjalling-dejong Jun 20, 2024
1717491
fixed minor issues deltares_data
Tjalling-dejong Jun 20, 2024
fab4428
fixed bug with using era5 daily and hourly netcdf files
Tjalling-dejong Jun 21, 2024
2125b95
updated test_data_catalog.py
Tjalling-dejong Jun 21, 2024
c305bb8
updated registry.txt files
Tjalling-dejong Jun 21, 2024
b5b08a0
implemented requested changes
Tjalling-dejong Jun 26, 2024
f051285
Merge branch 'v1' into improve_reproducibility_dd
Tjalling-dejong Jun 27, 2024
014b216
updated registry files
Tjalling-dejong Jun 27, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions data/catalogs/artifact_data/registry.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
v0.0.9/data_catalog.yml 6592ad6028b01012ed6bf1a7511238c3e02844f696ff2065c404ddbbab55bdc8
v0.0.6/data_catalog.yml 5d9e47158185f1afbf793db68c887f6e6b119d7ffd3edfbc198e5ae3a9d760f3
v0.0.7/data_catalog.yml 8c4aa8e5bc28fd9a6d25b93d73dc091dd9aa6beec3de48dc2a56b57aafe415ee
v0.0.8/data_catalog.yml c1cf2229eeb93607ea881fdbced45ebf43471271f0b7d878db8183734274cd88
v0.0.9/data_catalog.yml a074379f3ef244f3a860ec40165163538b6d690d8a3cbc8c6e883e02a8936258
v1.0.0/data_catalog.yml e871875c4d4919eb2f3f0975db2ee4fa6967489ccb6a1f2c231aacb4ca510365
v0.0.8/data_catalog.yml 3092305249af479061938ca484fe0245731174f072325740e9a85d1e986f8efc
v0.0.7/data_catalog.yml 8daccd1b551b3bafdb95b5ddc4b8dddafd6f25070ad9c543e3c0027bb55bc16e
2 changes: 1 addition & 1 deletion data/catalogs/artifact_data/v0.0.7/data_catalog.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
meta:
version: v0.0.7
root: https://github.com/DirkEilander/hydromt-artifacts/releases/download/v0.0.7/data.tar.gz
name: artifact_data


chelsa:
crs: 4326
Expand Down
Loading
Loading