Parquet Viewer

Online at: https://parquet-viewer.xiangpeng.systems

OpenVSX or VS Code extension

Parquet viewer is made possible with the funding from InfluxData.

Features

• Query parquet data with SQL ✅
• Query parquet data with natural language through LLM ✅
• View Parquet metadata ✅
• View Parquet files from anywhere -- local file, S3, or any URLs ✅
• Everything runs in the browser, no server, no external dependencies, just a web page ✅
• Read only you query -- won't download the entire parquet file ✅

Demo

Tips

• You can use ?url= to load a file from a url. For example, parquet-viewer.xiangpeng.systems/?url=https://raw.githubusercontent.com/tobilg/public-cloud-provider-ip-ranges/main/data/providers/all.parquet will load the file from github. parquet-viewer is smart enough to only download the data that is relevant to your query, usually a few KBs, even if the file is large.

• If you have parquet files on remote servers, a useful tip is to use sshfs to mount the folder from the server to your local machine. This allows you to access your remote parquet files without opening additional ports for this tool.

Development

It compiles Parquet, Arrow, Datafusion, OpenDAL to WebAssembly and uses it to explore Parquet files, more details.

Checkout the awesome Leptos framework.

Run locally

cargo install trunk --locked
trunk serve --release --no-autoreload

Run tests

cargo install wasm-pack --locked
wasm-pack test --headless --chrome

Build VS Code extension

cd vscode-extension
npm install
npm run compile
vsce login xiangpeng-systems
vsce package
vsce publish

License

Licensed under either of

• Apache License, Version 2.0, (LICENSE-APACHE or http://www.apache.org/licenses/LICENSE-2.0)
• MIT license (LICENSE-MIT or http://opensource.org/licenses/MIT)

at your option.

Be aware that most of the code is generated by AI, resistance is futile.