This project demonstrates how to stream process a Gzip compressed file using Rust. It fetches a Gzip compressed file from a URL, decompresses it, processes each line, and then recompresses the output.
- Cargo (Rust package manager)
- Node.js (for running the preprocessing script)
-
Clone the repository:
git clone https://github.com/h2cone/gzstream.git cd gzstream -
Run the preprocessing script using Node.js:
node scripts/fs.mjs
-
Run the project using Cargo:
cargo run > assets/transformed.vcf.gz -
The program will fetch the Gzip file from the specified URL, decompress it, process each line, and recompress the output to
assets/transformed.vcf.gz.