Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Notification for FastHerbie.download #245

Open
Bing1996 opened this issue Nov 21, 2023 · 1 comment
Open

Notification for FastHerbie.download #245

Bing1996 opened this issue Nov 21, 2023 · 1 comment

Comments

@Bing1996
Copy link

Hi,
I'm using the FastHerbie for downloading concurrency. It seems no message show up when I set the verbose == False, because there is too many redundant info shown when turns it on. I am wondering if could add a callback function so that I can know extract files downloaded successfully (like for logging). please let me know if anything I missed about this thought.

Thanks

@blaylockbk
Copy link
Owner

This is a good idea to provide more info as the function is running, even when verbose=False.

You might be interested to know that FastHerbie can tell you which files Herbie found and which it did not.

FH = FastHerbie(DATES, model="hrrr", fxx=fxx)

FH.objects # a list of Herbie objects for each file requests
FH.file_exists # a list of Heribe objects where the file was found
FH.file_not_exists # a list of Herbie objects where the file was NOT found

When you do FH.download() it will iterate over the list in FH.file_exists.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants