Skip to content

Panic and OOM free Parquet and thrift implementation in Rust

License

Notifications You must be signed in to change notification settings

ritchie46/parquet-format-safe

 
 

Repository files navigation

parquet-format-safe

This crate contains an implementation of Thirft and generated Rust code associated to Parquet's thrift definition.

Note that this crate does not contain functionality to read the parquet format. See parquet2 for such functionality.

  • supports sync and async read API
  • supports sync and async write API
  • the write API returns the number of written bytes
  • the read API is panic free
  • the read API has a bound on the maximum number of possible bytes read, to avoid OOM.

It must be used with the fork of thrift's compiler available at https://github.com/jorgecarleitao/thrift/tree/safe .

About

Panic and OOM free Parquet and thrift implementation in Rust

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Rust 92.8%
  • Thrift 7.1%
  • Shell 0.1%