Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Example Needed: Reading Numpy files from SageMakerPipe #23

Open
system123 opened this issue Oct 17, 2020 · 0 comments
Open

Example Needed: Reading Numpy files from SageMakerPipe #23

system123 opened this issue Oct 17, 2020 · 0 comments

Comments

@system123
Copy link

My dataset consists of a collection of .npy files stored in S3. As the dataset is relatively large I am wanting to access these from SageMaker using the SageMakerPipe source, however, it doesn't seem that there is a DatasetReader which supports plain Numpy files. Nor does it seem that the ImageDatasetReader could be used for this as it only supports JPG, PNG files.

Is there a way to achieve this? or does the library need to be extended?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant