VN-GeoQA v3.0.0 — frozen benchmark

VN-GeoQA v3.0.0 — frozen Vietnamese GS-QA benchmark.

• 28 canonical TIDs x 100 = 2,800 questions, seed 42, from Geofabrik vietnam-260901.osm.pbf (sha256 in MANIFEST).
• Location gold (T13–T20) freezes geometry and native OSM address components and a deterministic canonical address string; candidates are address-bearing POIs (predicate stated verbatim in the Text2SQL prompt).
• T7/T8 external facts are verifiably out-of-schema (capacity removed from the reference schema).
• Verified 2,800/2,800 (incl. loc address guards, T7/T8 out-of-schema assertion); second seed-42 run byte-identical; human QC approved (docs/qc_spot_check_v3.0.0.tsv).
• Assets: vn-geoqa.zip (dataset), osm-vn.dump (PostgreSQL custom-format reference DB dump, restored with pg_restore). Restore via scripts/restore_dataset.sh and scripts/restore_database.sh (SHA-256 pinned).

VN-GeoQA v2.0.0 — frozen benchmark (28 templates)

Frozen Vietnamese geospatial QA benchmark (VN-GeoQA), 2,800 questions — all 28 canonical GS-QA templates × 100, stable string ids {type}-NNN plus a tid field (T01–T28).

• Seed: 42 · python generator/generator_vi.py --seed 42 --count 100 --output data/v2.0.0/questions_vi
• Snapshot: Geofabrik vietnam-260825.osm.pbf (sha256 99ab8080…), evaluation must use this pinned extract
• Validation: verify_vi layer-2 2,800/2,800 (incl. SUM-totals and angle-wraparound guards); byte-identical pinned-seed regeneration; G4 human QC approved in two rounds (template review + 140-row spot check)
• Restore: scripts/restore_dataset.sh (downloads this asset, sha256-verifies, idempotent)
• Data: © OpenStreetMap contributors (ODbL 1.0); derived from Geofabrik extracts

VN-GeoQA v1.0.0 — frozen benchmark

Frozen Vietnamese geospatial QA benchmark (VN-GeoQA), 800 questions — 8 types × 100, stable string ids {type}-NNN.

• Seed: 42 · python generator/generator_vi.py --seed 42 --count 100 --output data/v1.0.0/questions_vi
• Snapshot: Geofabrik vietnam-260825.osm.pbf (sha256 99ab8080…), evaluation must use this pinned extract
• Validation: verify_vi layer-2 800/800; 80/80 human QC on the identical bytes
• Restore: scripts/restore_dataset.sh (downloads this asset, sha256-verifies, idempotent)
• Data: © OpenStreetMap contributors (ODbL 1.0); derived from Geofabrik extracts