Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Logging refresh #51

Closed
4 tasks done
lewisjared opened this issue May 28, 2019 · 1 comment
Closed
4 tasks done

Logging refresh #51

lewisjared opened this issue May 28, 2019 · 1 comment
Labels
cli command line interface enhancement New feature or request
Milestone

Comments

@lewisjared
Copy link
Collaborator

lewisjared commented May 28, 2019

Is your feature request related to a problem? Please describe.

We need a way to keep track of the files used when crunching to CSV. This provides traceability and the ability to perform smart updating in future when new land area masks become available.

These files will replace the *-failures-and-warnings.txt files written in the root of a dataset.

Describe the solution you'd like

  • Database of crunched files which is flushed to disk after every crunch. Entries include updated_at, in_files, out_file
  • Database becomes the authority regarding recrunching
  • Smarter progress bars
  • Log everything to disk
@znicholls znicholls added this to the v2.0 milestone May 28, 2019
@znicholls znicholls added cli command line interface enhancement New feature or request labels May 28, 2019
@znicholls znicholls mentioned this issue May 28, 2019
Closed
33 tasks
@lewisjared lewisjared mentioned this issue May 30, 2019
4 tasks
@znicholls
Copy link
Owner

@lewisjared we can close this right?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cli command line interface enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants