-
Notifications
You must be signed in to change notification settings - Fork 272
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Data Infra for Training #124
Commits on Apr 24, 2024
-
ported over necessary files for file download from benjieg/wip-traini…
…ng-fork. implemented and tested a dataset only arg version of download.py. Need to reconsider the other arguments.
Configuration menu - View commit details
-
Copy full SHA for f1eaa65 - Browse repository at this point
Copy the full SHA f1eaa65View commit details -
added files for downloading and converting datasets, and a guitarset …
…to test the ecosystem. Tests are written but tox is currently not passing. Many files reformatted by black.
Configuration menu - View commit details
-
Copy full SHA for b6229dd - Browse repository at this point
Copy the full SHA b6229ddView commit details -
added sox, apache_beam and mirdata to many more places in tox.ini, py…
…project.toml and tox.yml, which needs review. Added .jams files to MANIFEST.in to accomodate test file for guitarset. Added check for pytest run to guitarset download to avoid unnecessary full download during testing, need review. tox passing.
Configuration menu - View commit details
-
Copy full SHA for bfede5c - Browse repository at this point
Copy the full SHA bfede5cView commit details -
simplified / created train environment and testenv in tox.ini and pyp…
…roject.toml. Moved all tests relating to data into their own test directory. Updated path to resources accordingly.
Configuration menu - View commit details
-
Copy full SHA for 4975d82 - Browse repository at this point
Copy the full SHA 4975d82View commit details -
black formatting, flake linting, mypy corrections across files. Added…
… test for tf_example_serialization, added / corrected tests for other data / train files.
Configuration menu - View commit details
-
Copy full SHA for 5f78d3a - Browse repository at this point
Copy the full SHA 5f78d3aView commit details
Commits on May 1, 2024
-
modify .github/workflows/tox.ini so os name check matches os names li…
…sted, add .zip files to manifest.in
Configuration menu - View commit details
-
Copy full SHA for ad479f2 - Browse repository at this point
Copy the full SHA ad479f2View commit details -
.github/workflows/tox.ini for windows, choco install sox -> choco ins…
…tall sox.portable
Configuration menu - View commit details
-
Copy full SHA for 3296466 - Browse repository at this point
Copy the full SHA 3296466View commit details
Commits on May 8, 2024
-
addressing pr comments - undoing incorrect reformat, adding entry for…
… sox in CONTRIBUTING.md, add copyright notice to download.py, remove apache_beam from general dependencies.
Configuration menu - View commit details
-
Copy full SHA for 2c3d4fd - Browse repository at this point
Copy the full SHA 2c3d4fdView commit details
Commits on Jun 5, 2024
-
Switch over arguments and defaults to use PortableRunner in emulation of
Dataflow runner, using our Docker image. Added Dockerfile and .dockerfileignore to Manifest.in
Configuration menu - View commit details
-
Copy full SHA for 4225ade - Browse repository at this point
Copy the full SHA 4225adeView commit details -
added an entrypoint for downloading datasets, figured out how to pass…
… unknown args / pipeline args to the pipeline along with keyword args, added a README.md in the data folder.
Configuration menu - View commit details
-
Copy full SHA for 1c58725 - Browse repository at this point
Copy the full SHA 1c58725View commit details
Commits on Jun 12, 2024
-
Configuration menu - View commit details
-
Copy full SHA for d218e1c - Browse repository at this point
Copy the full SHA d218e1cView commit details -
changed copyright years in data files to 2024, changed 'train' to 'da…
…ta' in pyproject.toml
Configuration menu - View commit details
-
Copy full SHA for 23f7245 - Browse repository at this point
Copy the full SHA 23f7245View commit details
Commits on Jun 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for a6634f3 - Browse repository at this point
Copy the full SHA a6634f3View commit details