Skip to content

VN-GeoQA v2.0.0 — frozen benchmark (28 templates)

Choose a tag to compare

@itskyf itskyf released this 05 Sep 04:24
4ed8c67

Frozen Vietnamese geospatial QA benchmark (VN-GeoQA), 2,800 questions — all 28 canonical GS-QA templates × 100, stable string ids {type}-NNN plus a tid field (T01–T28).

  • Seed: 42 · python generator/generator_vi.py --seed 42 --count 100 --output data/v2.0.0/questions_vi
  • Snapshot: Geofabrik vietnam-260825.osm.pbf (sha256 99ab8080…), evaluation must use this pinned extract
  • Validation: verify_vi layer-2 2,800/2,800 (incl. SUM-totals and angle-wraparound guards); byte-identical pinned-seed regeneration; G4 human QC approved in two rounds (template review + 140-row spot check)
  • Restore: scripts/restore_dataset.sh (downloads this asset, sha256-verifies, idempotent)
  • Data: © OpenStreetMap contributors (ODbL 1.0); derived from Geofabrik extracts