Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create and Use docker volume to save all the datasets #883

Closed
2 tasks
utkarsharma2 opened this issue Sep 21, 2022 · 0 comments · Fixed by #945
Closed
2 tasks

Create and Use docker volume to save all the datasets #883

utkarsharma2 opened this issue Sep 21, 2022 · 0 comments · Fixed by #945
Assignees
Labels
ci Continuous integration or test automation improvements feature New feature or request product/python-sdk Label describing products
Milestone

Comments

@utkarsharma2
Copy link
Collaborator

Please describe the feature you'd like to see
We would like to run benchmarking script for loading local files. For that, the datasets need to be locally available.

Describe the solution you'd like
We can use a docker volume to keep the datasets and use it in benchmarking script.

Are there any alternatives to this feature?
Copy data from GCS to Docker container, but this will be very slow.

Acceptance Criteria

  • Volume should contain all the datasets
  • Should be read-only
@utkarsharma2 utkarsharma2 added feature New feature or request product/python-sdk Label describing products CI/Benchmarking and removed CI/Benchmarking labels Sep 21, 2022
@phanikumv phanikumv added this to the 1.1.1 milestone Sep 26, 2022
@phanikumv phanikumv added the ci Continuous integration or test automation improvements label Sep 26, 2022
@utkarsharma2 utkarsharma2 modified the milestones: 1.1.1, 1.2.0 Oct 4, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci Continuous integration or test automation improvements feature New feature or request product/python-sdk Label describing products
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants