Performance-Tuning: document that an index sharpens stats date type inference `stats --infer-dates` uses the default `--dates-whitelist sniff` to pick date columns; on an indexed file that sniff step uses distributed sampling, so date columns whose values only appear late are correctly typed (and get date-aware Min/Max) instead of being missed by a first-N sample. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

jqnatividad committed May 30, 2026

Performance-Tuning: note sniff benefits from an index (distributed sampling) `sniff` now draws a distributed sample (first/last 5 + quartile windows + random) across an indexed file instead of only the first --sample rows, improving type/date inference for values that appear late in the file. Also benefits `stats --infer-dates sniff`. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

jqnatividad committed May 30, 2026

wiki: adopt GitHub Alerts for callouts across the wiki Convert advisory blockquotes and inline callouts to semantic GitHub Alerts (NOTE/TIP/IMPORTANT/CAUTION): - [!NOTE] for the standard category-page "workflow layer" ledes and other top-of-page orientation / "canonical reference" notes - [!IMPORTANT] for behavior-affecting gotchas (auto approx-stats on OOM, group-by unsupported aggs, MiniJinja filter-errors-as-values, synthesize cross-column correlation, profile always-warn RFC4180) - [!TIP] for the Binary-Variants TL;DR and Why-qsv "why it matters" - [!CAUTION] for foreach shell-injection risk and joinp --cross blowup Also update the Contributing-to-the-Wiki category template to use the [!NOTE] lede so new pages follow the convention. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

jqnatividad committed May 30, 2026

wiki: Phase D batch 1 - Performance-Tuning + Environment-Variables Performance-Tuning: the five-minute rule (index, stats cache, schema --polars, ext-*), what gets faster with an index, stats-cache smart commands, multithreading map, memory management with QSV_MEMORY_CHECK, approximate algorithms (DataSketches t-digest + HyperLogLog), build-time optimizations (target-cpu=native, nightly, allocator choice), and a tuning checklist. All numbers link to BENCHMARKS.md. Environment-Variables: grouped overview of 50+ env vars by purpose (I/O, performance, cache, AI/LLM, web, geocoding, stats, dates, regex, color, logging, Polars, MCP). Each links back to the canonical ENVIRONMENT_VARIABLES.md. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

jqnatividad committed May 13, 2026

wiki: add stubs for Phase B/C/D/E pages so sidebar links resolve Adds 39 placeholder pages so every sidebar entry resolves to real content rather than a 404. Each stub declares its tier, the phase it will be filled in, and a one-paragraph preview of what's coming. They link back to Home / Getting-Started / Command-Reference / Cookbook for navigation. Pages added: - Phase B (Command Reference, 13): Command-Reference, Selection-and- Inspection, Transform-and-Reshape, Aggregation-and-Statistics, Joins- and-Set-Ops, SQL-and-Polars, Validation-and-Schema, Conversion-and-IO, Geospatial, HTTP-and-Web, Scripting-Luau-Python, Indexing-Compression- Diff, AI-and-Documentation - Phase C (Cookbook recipes, 12): Recipe-Inspect-Unknown-CSV, Recipe- Clean-and-Normalize, Recipe-Geographic-Enrichment, Recipe-Date- Enrichment, Recipe-CKAN-Integration, Recipe-JSON-Schema-Validate, Recipe-Build-a-Data-Pipeline, Recipe-Stats-to-Insights, Recipe-Fetch- and-Cache, Recipe-Larger-than-RAM, Recipe-Diff-and-Audit, Recipe-Multi- Table-Joins - Phase D (Tuning + ecosystem, 8): Performance-Tuning, Environment- Variables, Stats-Cache-and-Caching, Lookup-Tables, Claude-Cowork-Plugin, MCP-Server, qsv-pro-Spotlight, Integrations - Phase E (Polish, 6): Troubleshooting, FAQ, Comparison, Glossary, External-Resources, Contributing-to-the-Wiki Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

jqnatividad committed May 13, 2026