Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reading multiple GZIP archives in one file, individually #192

Open
matthewrobertbell opened this issue Apr 25, 2019 · 1 comment
Open

Reading multiple GZIP archives in one file, individually #192

matthewrobertbell opened this issue Apr 25, 2019 · 1 comment

Comments

@matthewrobertbell
Copy link

Hi,

I have a large .gz file with many (hundreds of thousands) individual archives in the one file.

Using GZDecoder works on this, for the first archive. Using MultiGZDecoder works, allowing me to produce one big string with data from all archives.

Since the archives are to be processed individually, and because it is hard to split the parts of data once they are all in one big string, I would like to produce something like an iterator of strings, one per archive. Is this possible currently? If not, is it something that is easy to build on top of flate2?

Thanks!

@alexcrichton
Copy link
Member

I think you'd probably want to see how MultiGzDecoder works internally and probably copy that externally. I don't think it would be too too hard to set up though!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants