Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Geospatial extensions for Polars

Rust-based WebAssembly bindings to read and write Apache Parquet data

A Rust DataFrame implementation, built on Apache Arrow

GeoArrow in Rust, Python, and JavaScript (WebAssembly) with vectorized geometry operations

A minimal Python library for Apache Arrow, connecting to the Rust arrow crate

A lightweight Logging and Tracing observability solution for Rust, built with Apache Arrow, Apache Parquet and Apache DataFusion.

Read specialized NGS formats as data frames in R, Python, and more.

Integration between arrow-rs and extendr

Building block library for using Apache Arrow in Rust WebAssembly modules.

A Book about how SQLite works. Rewriting SQLite in Rust for Learning and Fun and writing a book I wished I had.

ModelarDB: Model-Based Time Series Management from Edge to Cloud

An experimental (work-in-progress) statically typed implementation of Apache Arrow

Efficiently evolve your old fixed-length data files into modern file formats.

A Flight SQL client for Node.js

A fast and simple command-line (CLI) tool to convert a Parquet file to an Apache Arrow file

Interoperability between Polars and Clickhouse

In-memory Columnar Database

Kusto client library optimized for data science workloads

Query and extract entity data from Rerun data files.