Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix slow performance of dfmt.open_dataset_curvilinear()` due to incorrectly added time dimension #928

Closed
veenstrajelmer opened this issue Aug 8, 2024 · 0 comments · Fixed by #929

Comments

@veenstrajelmer
Copy link
Collaborator

This code has terrible performance since a time dimension is added to vertices_longitude` and other vars:

import dfm_tools as dfmt

file_nc = r'P:\archivedprojects\11206304-futuremares-rawdata-preps\data\CMIP6_BC\CMCC-ESM2\vo_Omon_CMCC-ESM2_historical_r1i1p1f1_gn_*.nc'
uds = dfmt.open_dataset_curvilinear(file_nc, convert_360to180=True)#, data_vars="minimal")

When passing data_vars='minimal' this is avoided. Add this directly to the xr.open_mfdataset() call in the function

@veenstrajelmer veenstrajelmer linked a pull request Aug 8, 2024 that will close this issue
@veenstrajelmer veenstrajelmer changed the title fix slow performance of dfmt.open_dataset_curvilinear()` due to added time dimension fix slow performance of dfmt.open_dataset_curvilinear()` due to incorrectly added time dimension Aug 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant