precompiled binaries list installed commands that are not compiled in

[terefang]

precompiled binaries list installed commands that are not compiled in.

i only did check the musl versions :

----- ..../bin/qsvdp-musl
qsvdp 20.0.0-jemalloc-geocode;self_update-12-12;50.19 GiB-2.52 GiB-32.83 GiB-62.74 GiB (x86_64-unknown-linux-musl compiled with Rust 1.95;Linux (Linux Mint 22.3)-Linux 6.8.0-90-generic;AMD Ryzen 5 2600 Six-Core Processor-6) prebuilt
Installed commands:
    applydp     Apply series of transformations to a column
    blake3      Compute BLAKE3 cryptographic hashes of files
    count       Count records
    datefmt     Format date/datetime strings
    describegpt Infer extended metadata or chat with your data using a LLM
    diff        Find the difference between two CSVs
    dedup       Remove redundant rows
    excel       Exports an Excel sheet to a CSV
    exclude     Excludes the records in one CSV from another
    extdedup    Remove duplicates rows from an arbitrarily large text file
    frequency   Show frequency tables
    geocode     Geocodes a location against the Geonames cities database
    geoconvert  Convert between spatial formats & CSV, including GeoJSON, SHP & more
    headers     Show header names
    help        Show this usage message
    index       Create CSV index for faster access
    input       Read CSVs w/ special quoting, skipping, trimming & transcoding rules
    join        Join CSV files
    *joinp       Join CSV files using the Pola.rs engine 🐻‍❄️*
    *luau        Execute Luau script on CSV data 👑*
    moarstats   Add "moar" statistics to existing stats CSV
    *pivotp      Pivot CSV data 🐻‍❄️*
    pragmastat  Pragmatic statistical toolkit
    pseudo      Pseudonymise the values of a column
    rename      Rename the columns of CSV data efficiently
    replace     Replace patterns in CSV data
    reverse     Reverse rows of CSV data
    safenames   Modify a CSV's header names to db-safe names
    sample      Randomly sample CSV data
    search      Search CSV data with a regex
    searchset   Search CSV data with a regex set
    select      Select, re-order, duplicate or drop columns
    slice       Slice records from CSV
    snappy      Compress/decompress data using the Snappy algorithm
    sniff       Quickly sniff CSV metadata
    sort        Sort CSV data in alphabetical, numerical, reverse or random order
    sortcheck   Check if a CSV is sorted
    *sqlp        Run a SQL query against several CSVs using the Pola.rs engine 🐻‍❄️*
    stats       Infer data types and compute summary statistics
    template    Render templates using CSV data
    validate    Validate CSV data for RFC4180-compliance or with JSON Schema

    NOTE: qsvdp ignores the --progressbar option for all commands.
          🐻‍❄️ - requires polars feature
          👑 - requires luau feature

sponsored by datHere - Data Infrastructure Engineering (https://qsv.datHere.com)
Need a UI & more advanced data-wrangling? Upgrade to qsv pro (https://qsvpro.datHere.com)

$ qsvdp-musl    joinp
Could not match 'joinp' with any of the allowed variants: ["applydp", "blake3", "count", "datefmt", "dedup", "describegpt", "diff", "excel", "exclude", "extdedup", "frequency", "geocode", "geoconvert", "headers", "help", "index", "input", "join", "pragmastat", "pseudo", "rename", "replace", "reverse", "safenames", "sample", "search", "searchset", "select", "slice", "snappy", "sniff", "sort", "sortcheck", "stats", "moarstats", "template", "validate"]

----- ..../bin/qsvpdp-musl
qsvdp 20.0.0-jemalloc-geocode;self_update-12-12;50.19 GiB-2.52 GiB-32.81 GiB-62.74 GiB (x86_64-unknown-linux-musl compiled with Rust 1.95;Linux (Linux Mint 22.3)-Linux 6.8.0-90-generic;AMD Ryzen 5 2600 Six-Core Processor-6) prebuilt
Installed commands:
    applydp     Apply series of transformations to a column
    blake3      Compute BLAKE3 cryptographic hashes of files
    count       Count records
    datefmt     Format date/datetime strings
    describegpt Infer extended metadata or chat with your data using a LLM
    diff        Find the difference between two CSVs
    dedup       Remove redundant rows
    excel       Exports an Excel sheet to a CSV
    exclude     Excludes the records in one CSV from another
    extdedup    Remove duplicates rows from an arbitrarily large text file
    frequency   Show frequency tables
    geocode     Geocodes a location against the Geonames cities database
    geoconvert  Convert between spatial formats & CSV, including GeoJSON, SHP & more
    headers     Show header names
    help        Show this usage message
    index       Create CSV index for faster access
    input       Read CSVs w/ special quoting, skipping, trimming & transcoding rules
    join        Join CSV files
    *joinp       Join CSV files using the Pola.rs engine 🐻‍❄️*
    *luau        Execute Luau script on CSV data 👑*
    moarstats   Add "moar" statistics to existing stats CSV
    pivotp      Pivot CSV data 🐻‍❄️
    pragmastat  Pragmatic statistical toolkit
    pseudo      Pseudonymise the values of a column
    rename      Rename the columns of CSV data efficiently
    replace     Replace patterns in CSV data
    reverse     Reverse rows of CSV data
    safenames   Modify a CSV's header names to db-safe names
    sample      Randomly sample CSV data
    search      Search CSV data with a regex
    searchset   Search CSV data with a regex set
    select      Select, re-order, duplicate or drop columns
    slice       Slice records from CSV
    snappy      Compress/decompress data using the Snappy algorithm
    sniff       Quickly sniff CSV metadata
    sort        Sort CSV data in alphabetical, numerical, reverse or random order
    sortcheck   Check if a CSV is sorted
    *sqlp        Run a SQL query against several CSVs using the Pola.rs engine 🐻‍❄️*
    stats       Infer data types and compute summary statistics
    template    Render templates using CSV data
    validate    Validate CSV data for RFC4180-compliance or with JSON Schema

    NOTE: qsvdp ignores the --progressbar option for all commands.
          🐻‍❄️ - requires polars feature
          👑 - requires luau feature

$ qsvpdp-musl    luau
Could not match 'luau' with any of the allowed variants: ["applydp", "blake3", "count", "datefmt", "dedup", "describegpt", "diff", "excel", "exclude", "extdedup", "frequency", "geocode", "geoconvert", "headers", "help", "index", "input", "join", "pragmastat", "pseudo", "rename", "replace", "reverse", "safenames", "sample", "search", "searchset", "select", "slice", "snappy", "sniff", "sort", "sortcheck", "stats", "moarstats", "template", "validate"]

[jqnatividad]

Thanks for the report @terefang . This was intentional, thus the emoji legends, but its cleaner this way.

[terefang]

yes, i have had a few colleges getting confused.

thx.

[jqnatividad]

Colleges? I'm intrigued - can you tell me how qsv is being used there?

[terefang]

on a high-level

• data is arriving via batch processing from various sources, in various formats (csv, xlsx), in various qualities
• all data is prefiltered with fixlengths/safenames/fmt to ensure validity/conformity for standardization
• depending on need, data is:
  • futher prepared with various qsv pipelines (normalizing)
  • loaded into sqlite/sqlean/duckdb instances
• depending on need, db instances are:
  • subjected to sql transformations
  • distributed verbatim to external processors
  • exported to spreadsheet (csv, excel) and synced to file storage
  • processed to create graphical reports/charts (pdf)
  • exported and transformed into various tool-specific formats

the main challenge is to only use simple tools (bash, qsv, sqlean/duckdb, pandoc, typst) within the department to not create a sort of shadow-it

[jqnatividad]

Great to know qsv is helping. I'm glad you count qsv among those simple, workhorse tools!