Skip to content

Latest commit

 

History

History
79 lines (59 loc) · 4.63 KB

snb-interactive-pre-generated-data-sets.md

File metadata and controls

79 lines (59 loc) · 4.63 KB
Raw

Pre-generated data sets

Streaming decompression

To download and decompress the data sets on-the-fly, make sure you have curl and zstd installed, then run:

export DATASET_URL=...
curl --silent --fail ${DATASET_URL} | tar -xv --use-compress-program=unzstd

For multi-file data sets, first download them. Then, to recombine and decompress, run:

cat <data-set-filename>.tar.zst* | tar -xv --use-compress-program=unzstd

This command works on both standalone files (.tar.zst) and chunked ones (.tar.zst.XXX).

Data sets links

Merged FK

Projected FK

Raw (up to SF30)

Update streams

Factor tables

Parameters (deprecated)