Skip to content

Kxnr/parqbench

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

76 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ParqBench

A simple, cross-platform, utility for viewing parquet files, built on egui and arrow.

TODO List

  • CI for builds/releases
  • load partitioned dataset
  • tab layout/tree
  • add controls and metadata to side panels
  • parse pandas format metadata
  • open with hooks (cmd line args)
  • notification for errors
  • support all filetypes supported by datafusion
  • Update datafusion and egui/eframe
  • Auto resize columns
  • revisit &str vs String usages
  • Ui for basic query operations
  • source configuration in query pane
  • rich metadata with parquet crate

Installation

Generic, portable binaries for Windows and Linux are available on the releases page.

ParqBench is tested for Linux (Manjaro 22.0, kernel 5.15.60) and Windows 10 (21H2). Releases are built with:

cargo build --release --target x86_64-pc-windows-gnu cargo build --release --target x86_64-unknown-linux-gnu

The builds are self-contained, portable, executables. The resulting binaries are placed in target/<target>.

Contribution

Please contribute! I'm learning Rust and this is my first 'major' project using it, so any and all feedback is welcome. I'm working on this intermittently and will review PRs/comments/issues on a roughly weekly basis.

About

A small Rust application for viewing parquet formatted data.

Resources

Stars

Watchers

Forks

Packages

No packages published