Fixed error in writing compressed IPC arrow

[jorgecarleitao]

There is some ambiguity in the format over how to count buffer lengths, but I think this handles it.

Will work on apache/arrow to clear up the ambiguity and add an integration test for this.

[codecov]

Codecov Report

Merging #855 (7124086) into main (6ccb154) will decrease coverage by 0.00%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main     #855      +/-   ##
==========================================
- Coverage   71.49%   71.48%   -0.01%     
==========================================
  Files         335      335              
  Lines       17910    17902       -8     
==========================================
- Hits        12805    12798       -7     
+ Misses       5105     5104       -1     

Impacted Files	Coverage Δ
src/io/ipc/write/serialize.rs	65.18% <100.00%> (-0.29%)	⬇️
src/io/ipc/write/common_sync.rs	96.66% <0.00%> (-3.34%)	⬇️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6ccb154...7124086. Read the comment docs.

[jorgecarleitao]

cc @ghuls (related to pola-rs/polars#2639)

[ghuls]

Thanks, I will test it on a big file to see if PyArrow likes it now.

[ghuls]

Pyarrow seems to be able to read lz4 and zstd feather files created by arrow2 now (for the full big file).
Thanks a lot.