Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NEURIPS] .zip and .tar.gz archives are not supported for file uploading #663

Open
amorehead opened this issue May 25, 2024 · 5 comments
Open

Comments

@amorehead
Copy link

  • .zip and .tar.gz archives are currently not supported for file uploading. What would be needed to implement this feature?
@amorehead
Copy link
Author

This appears related to #547, so I am closing this issue.

@amorehead amorehead changed the title .zip and .tar.gz archives are not supported for file uploading [NEURIPS] .zip and .tar.gz archives are not supported for file uploading Jun 5, 2024
@amorehead amorehead reopened this Jun 5, 2024
@amorehead
Copy link
Author

I am reopening this issue per the NeurIPS organizer's recommendation.

@JovinLeong
Copy link

JovinLeong commented Jun 10, 2024

Hi, wanted to check what you mean by this. I have a FileObject with a content_url pointing to a publicly available .zip file and I have my encoding_format set to application/zip similar to coco2014 but I'm getting the following error:

ValueError: Unsupported compression method for file: ...

and

GenerationError: An error occurred during the streaming generation of the dataset, more specifically during the operation Extract(training_data).

Is this the same issue you're facing? I'm able to get it working if I don't upload a compressed .zip file.

Edit: I tried updating my content_url to refer to the .zip locally instead and it works perfectly - I'm just not able to get it to work with a content_url that points to a remote .zip file

@amorehead
Copy link
Author

Hi, @JovinLeong. I believe the issue for me is that I'm trying to point to a remote .zip/.tar.gz archive. Good to know that local paths work though!

@JovinLeong
Copy link

Okay, then it seems like we're facing the same issue then - which seems odd since the coco2014 example uses a remote .zip. Though tbf it seems like coco2014 isn't working for me anyway

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants