-
Notifications
You must be signed in to change notification settings - Fork 30
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Streaming writes in framing2-format not supported #28
Comments
Hi @dpq, Could you post a reproducible example? I did the following on Ubuntu 20.04. It works fine. $ pip3 install --user python-snappy # install python-snappy
$ echo Hello World | python3 -m snappy -c > hello-world.sz # compress by python-snappy
$ file hello-world.sz # verify that the file format is snappy framed.
hello-world.sz: snappy framed data
$ cat hello-world.sz | ./snzip -d # uncompress by snzip
Hello World |
Hi, I can post a sample in a bit but the gist of it is that I had sort of like several snappy files concatenated to each other due to an error on my part. I.e. snzip was balking at the second frame's header's "s" character (sNaPpy). |
Thanks. $ echo Hello World | python3 -m snappy -c > hello-world.sz
$ cat hello-world.sz hello-world.sz > hello-world-concatenated.sz
$ cat hello-world-concatenated.sz | python3 -m snappy -d
Hello World
Hello World
$ cat hello-world-concatenated.sz | ./snzip -d
Hello World
Unsupported identifier 0x73 |
This issue was fixed by b607e60. |
Hi,
Currently
snzip
lacks the ability to decompress files written withsnappy.NewBufferedWriter()
streaming writer. Upon reading the header of the next snappy frame it throws an error:framing2-format.c:227: Unsupported identifier 0x73
.Other tools like python-snappy have been verified to work with this format correctly.
The text was updated successfully, but these errors were encountered: