-
Notifications
You must be signed in to change notification settings - Fork 271
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ENH: cleanup empty cache directory after a successful call to load_sample #4501
ENH: cleanup empty cache directory after a successful call to load_sample #4501
Conversation
53de0a2
to
2b2c735
Compare
I don't think we should hide it -- dumping a couple gigs into a hidden directory is not something I really want to push. That being said, does this mean that if I use |
9e64e91
to
294320c
Compare
You have a point, I'll revert that part.
it doesn't ! when the untared data is already on disk, |
294320c
to
37dab04
Compare
Great -- for some reason I thought it ran a hash on the tarball to see if it needed to re-download, rather than looking at contents of the directory. |
pooch internally verifies that the file's hash matches the data base we provide for security, that might be where you got that idea :) |
37dab04
to
8264ef6
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
looks good to me.
PR Summary
Context: internally,
yt.load_sample
usespooch
to retrieve data from the hub server. Because data is obtained most often as compressed archives, we first download it to a temporary directory (yt_download_cache
). This is an implementation detail that should not be directly visible to users.This PR does two things:
prepend a.
to its name so its "hidden" in the conventional POSIX sense