Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mbox Download Notebook Producing Empty Folders #249

Open
lh-zhan opened this issue Nov 13, 2023 · 1 comment
Open

Mbox Download Notebook Producing Empty Folders #249

lh-zhan opened this issue Nov 13, 2023 · 1 comment
Assignees
Labels
module:download Anything associated to the download module for data acquisition. type:bug Something isn't working

Comments

@lh-zhan
Copy link
Collaborator

lh-zhan commented Nov 13, 2023

Config File:

conf <- yaml::read_yaml("../conf/hadoop.yml") save_path_mbox <- conf[["mailing_list"]][["mbox"]] 
mod_mbox_url <- conf[["mailing_list"]][["domain"]] 
mailing_list <- conf[["mailing_list"]][["list_key"]] 
start_year <- 2009 
end_year <- 2023

While downloading the mbox using this notebook, I noticed that if I specify a start year or end year that's outside of the actual mbox coverage, the notebook would create empty folders within that specified time coverage. Constraints should be added to avoid creating empty folders.

@carlosparadis carlosparadis self-assigned this Nov 13, 2023
@carlosparadis carlosparadis added type:bug Something isn't working module:download Anything associated to the download module for data acquisition. labels Nov 13, 2023
@carlosparadis
Copy link
Member

Thank you for this!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
module:download Anything associated to the download module for data acquisition. type:bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants