Skip to content

A tool to take large JSON and convert it to JSONL

License

Notifications You must be signed in to change notification settings

zaibacu/json2jsonl

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

About

This is a tool to take large JSON blob and convert it to JSONL file which can be readed as stream

Build

Rust language and Cargo is used to build project. More info: Cargo

Usage

json2jsonl <input_file>.json <output_file>.jsonl

Caveats

At the moment it expects root element of JSON to be array and each array item as a line in JSONL.

TODO: somekind of pattern to control this