Reading multiple individual files from solid 7zips duplicates a lot of work #1

Closed
mikelikespie opened this Issue Jun 11, 2010 · 2 comments

Projects

None yet

2 participants

@mikelikespie

Hi, it seems when you decompress stuff from solid 7zips in py7zlib it decompresses the beginning part of the file several times. Would it be possible to memoize this?

I'm going to make a patch for this.

Also, I noticed if you change self._file.read(1024) (in _read_from_decompressor) to a bigger number like 16384 there's about a 2x perf improvement.

@fancycode
Owner

Thanks for the heads up, I just updated the blocksize when reading compressed files to 16384 in the repository.

@fancycode
Owner

A decompression cache for solid archives has been added in 2496d6d.

@fancycode fancycode closed this Sep 12, 2011
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment