Skip to content

History / Scripting Luau Python

Revisions

  • wiki: adopt GitHub Alerts for callouts across the wiki Convert advisory blockquotes and inline callouts to semantic GitHub Alerts (NOTE/TIP/IMPORTANT/CAUTION): - [!NOTE] for the standard category-page "workflow layer" ledes and other top-of-page orientation / "canonical reference" notes - [!IMPORTANT] for behavior-affecting gotchas (auto approx-stats on OOM, group-by unsupported aggs, MiniJinja filter-errors-as-values, synthesize cross-column correlation, profile always-warn RFC4180) - [!TIP] for the Binary-Variants TL;DR and Why-qsv "why it matters" - [!CAUTION] for foreach shell-injection risk and joinp --cross blowup Also update the Contributing-to-the-Wiki category template to use the [!NOTE] lede so new pages follow the convention. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

    @jqnatividad jqnatividad committed May 30, 2026
  • wiki: convert luau helper-functions list to a table Replace the categorized bullet list with a Helper/Category/What-it-does table covering ~25 qsv_* helpers with accurate signatures (incl. qsv_lag's real value/lag/default/name arg order, qsv_fileexists, and qsv_sleep) sourced from src/cmd/luau.rs. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

    @jqnatividad jqnatividad committed May 30, 2026
  • wiki: expand luau section with detailed, test-grounded examples Rewrite and expand the Scripting-Luau-Python luau coverage into workflow subsections drawn from src/cmd/luau.rs USAGE and tests/test_luau.rs: column references (direct/col./col[]) + multi-column return, BEGIN/MAIN/ END (separate flags & embedded syntax), special vars (_IDX/_ROWCOUNT/ _INDEX/_LASTROW) and random-access mode, filter truthiness, file:/.lua script loading, the qsv_* helper catalog (cumulative/window, lookups, control flow, I/O) with runnable examples, Lua-pattern escaping, LuaDate/ require, and debugging tips. Fixes inaccuracies in the prior section: nonexistent -x/-f flags, --remap wrongly described as triggering random access, fabricated helpers (qsv_cumulative_avg/qsv_format_float/qsv_breakeven), the bogus _[...] column accessor, and the Luau version (0.720 -> 0.722); also corrects the helper count (~50 -> ~30). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

    @jqnatividad jqnatividad committed May 30, 2026
  • docs: add MiniJinja Templating page (filters, helpers, tips) + cross-links

    @jqnatividad jqnatividad committed May 29, 2026
  • wiki: complete Phase B - Scripting + Indexing/Compression/Diff + AI/Doc Scripting-Luau-Python covers luau (qsv's flagship DSL with BEGIN/MAIN/END, random-access mode, ~50 qsv helpers), py (Python 3.10+ expressions), foreach (shell-out per row with --unify pattern), and template (MiniJinja rendering with register_lookup). Examples: cumulative running total, NYC 311 classification with dynamicEnum lookup, getquarter.lua from docs/cookbook/lua, helper.py module pattern, per-borough markdown reports. Indexing-Compression-Diff covers index (with QSV_AUTOINDEX_SIZE auto-mode), diff (1M x 9 in <600ms primary-key diff), blake3 (pipeline gating, cache keys, integrity checks), plus cross-references to extsort/extdedup/snappy. AI-and-Documentation covers describegpt (neuro-symbolic data dictionary, Ollama/Jan/LM Studio local LLMs, SQL-RAG sub-mode with DuckDB/Polars, multilingual output, controlled tag vocabulary), color (theme-aware colorized table), and pro (qsv pro API bridge). All 13 Phase B pages now live. All 81 commands covered with non-trivial real-world examples anchored on the wiki's six anchor datasets. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

    @jqnatividad jqnatividad committed May 13, 2026
  • wiki: add stubs for Phase B/C/D/E pages so sidebar links resolve Adds 39 placeholder pages so every sidebar entry resolves to real content rather than a 404. Each stub declares its tier, the phase it will be filled in, and a one-paragraph preview of what's coming. They link back to Home / Getting-Started / Command-Reference / Cookbook for navigation. Pages added: - Phase B (Command Reference, 13): Command-Reference, Selection-and- Inspection, Transform-and-Reshape, Aggregation-and-Statistics, Joins- and-Set-Ops, SQL-and-Polars, Validation-and-Schema, Conversion-and-IO, Geospatial, HTTP-and-Web, Scripting-Luau-Python, Indexing-Compression- Diff, AI-and-Documentation - Phase C (Cookbook recipes, 12): Recipe-Inspect-Unknown-CSV, Recipe- Clean-and-Normalize, Recipe-Geographic-Enrichment, Recipe-Date- Enrichment, Recipe-CKAN-Integration, Recipe-JSON-Schema-Validate, Recipe-Build-a-Data-Pipeline, Recipe-Stats-to-Insights, Recipe-Fetch- and-Cache, Recipe-Larger-than-RAM, Recipe-Diff-and-Audit, Recipe-Multi- Table-Joins - Phase D (Tuning + ecosystem, 8): Performance-Tuning, Environment- Variables, Stats-Cache-and-Caching, Lookup-Tables, Claude-Cowork-Plugin, MCP-Server, qsv-pro-Spotlight, Integrations - Phase E (Polish, 6): Troubleshooting, FAQ, Comparison, Glossary, External-Resources, Contributing-to-the-Wiki Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

    @jqnatividad jqnatividad committed May 13, 2026