Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Q: Dictionary tablelog limit #2179

Closed
klauspost opened this issue May 26, 2020 · 1 comment
Closed

Q: Dictionary tablelog limit #2179

klauspost opened this issue May 26, 2020 · 1 comment

Comments

@klauspost
Copy link

In the Symbol compression modes it states that:

the maximum allowed accuracy log for literals length and match length tables is 9, and the maximum accuracy log for the offsets table is 8.

The dictionary format basically states that you should just refer to the other section.

So my assumption was that this would also be true for dictionaries. However in a dictionary generated from zstd the first byte after the magic and ID is 0x35 which indicates that tablelog = 5 + 5 = 10.

My question then is, if the tables for literal length can be at least 10 bits, what is the maximum tablelog I can assume to see in a dictionary?

The dictionary is directly from zstd --train with no modifications. If you should need it I can of course attach it if you need it.

@klauspost
Copy link
Author

klauspost commented May 26, 2020

Ah. I see my mistake (overlooked the literals table). Sorry for the confusion.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant