Skip to content

Panic and OOM free Parquet and thrift implementation in Rust

License

Apache-2.0, MIT licenses found

Licenses found

Apache-2.0
LICENSE-APACHE
MIT
LICENSE-MIT
Notifications You must be signed in to change notification settings

jorgecarleitao/parquet-format-safe

Repository files navigation

parquet-format-safe

This crate contains an implementation of Thirft and generated Rust code associated to Parquet's thrift definition.

Note that this crate does not contain functionality to read the parquet format. See parquet2 for such functionality.

  • supports sync and async read API
  • supports sync and async write API
  • the write API returns the number of written bytes
  • the read API is panic free
  • the read API has a bound on the maximum number of possible bytes read, to avoid OOM.

The Rust generated code is done by a fork of thrift's compiler, available at https://github.com/jorgecarleitao/thrift/tree/safe .

About

Panic and OOM free Parquet and thrift implementation in Rust

Resources

License

Apache-2.0, MIT licenses found

Licenses found

Apache-2.0
LICENSE-APACHE
MIT
LICENSE-MIT

Stars

Watchers

Forks

Packages

No packages published