Skip to content

v0.1.1

Choose a tag to compare

@github-actions github-actions released this 22 Oct 22:54
· 31 commits to main since this release
v0.1.1
73a356a
  • About twice as fast without plugins: records are read, made into rows and encoded on
    three threads, with the same Parquet bytes as before. On a 2019 laptop: a 1 GB tall CSV
    8.2 -> 4.3 seconds, the 2.5 GB wide CSV 7.4 -> 4.4, a 1.2 GB CSV with 1000 columns
    16.8 -> 9.7, a 229 MB JSON 2.8 -> 1.3.
  • The command reads a .gz, or a .zip with one .csv or .json in it, unpacked on the
    fly (a Mac's __MACOSX/ entries are left out). The default output name drops .gz or
    .zip.
  • The binary has a default feature of its own, cli (with flate2 and zip), so
    parquet alone no longer pulls them in or builds it.
  • An input that is neither .csv nor .json now exits with 1 (the input failed), not 2.
  • cargo binstall hpt-parser fetches the release binary.