Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data loader #85

Merged
merged 29 commits into from May 14, 2020
Merged

Data loader #85

merged 29 commits into from May 14, 2020

Conversation

MekWarrior
Copy link
Collaborator

@MekWarrior MekWarrior commented May 13, 2020

This PR adds an elementary data loader that is built to read from the CellNet data ontology. It allows for human-readable calls to build raw data and packages it with the accompanying metadata files to prepare it for submission to crowdsourcing platforms.

It represents the first step toward a complete overhaul of our data pipeline, and, as such, will undergo several changes once DeepCell Datasets is closer to being a mature repo.

There are also miscellaneous critical updates to inits and testing that bring the current toolbox repo closer to maturity.

@MekWarrior MekWarrior requested a review from willgraf May 13, 2020 21:35
Dockerfile Show resolved Hide resolved
requirements.txt Outdated Show resolved Hide resolved
Copy link
Contributor

@willgraf willgraf left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few minor changes.

Additionally, there's a lot of TODOs to add a logger. Is there a reason to not do it in this PR?

@willgraf willgraf added the enhancement New feature or request label May 13, 2020
Copy link
Contributor

@willgraf willgraf left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@MekWarrior MekWarrior merged commit a012476 into master May 14, 2020
@MekWarrior MekWarrior deleted the data_loader branch May 14, 2020 22:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants