Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

import xsar is sometime very slow #65

Closed
oarcher opened this issue Mar 19, 2022 · 1 comment
Closed

import xsar is sometime very slow #65

oarcher opened this issue Mar 19, 2022 · 1 comment

Comments

@oarcher
Copy link
Collaborator

oarcher commented Mar 19, 2022

a simple import xsar can take many times (up to 8 minutes with many workers !) on datarmor.
This is a possible IO issue, be we might find a solution on xsar side to reduce it.

@oarcher
Copy link
Collaborator Author

oarcher commented Mar 19, 2022

import time can be profiled with the following command:

python -X importtime -c 'import xsar' 2> >(grep "import time" > xsar.prof)

and the output can be parsed with tuna

image

We can see here that import xsar take ~80s, and that import xsar.ipython_backends take ~45s, because of holoviews and geoviews.

But we should detect that we are not using a notebook, and don't import those module, as xsar is able to work without them.

This will not solve the IO issue, but will probably save some import time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant