Skip to content

VN-GeoQA v1.0.0 — frozen benchmark

Choose a tag to compare

View all tags
@itskyf itskyf released this 05 Sep 04:23
v1.0.0
0abe75e
This commit was signed with the committer’s verified signature.
itskyf Kỳ Anh
SSH Key Fingerprint: OPVO6HGjZgDv5IICkWdBaei2PtFtvzOww4nWeWYIhMQ
Verified
Learn about vigilant mode.

Frozen Vietnamese geospatial QA benchmark (VN-GeoQA), 800 questions — 8 types × 100, stable string ids {type}-NNN.

  • Seed: 42 · python generator/generator_vi.py --seed 42 --count 100 --output data/v1.0.0/questions_vi
  • Snapshot: Geofabrik vietnam-260825.osm.pbf (sha256 99ab8080…), evaluation must use this pinned extract
  • Validation: verify_vi layer-2 800/800; 80/80 human QC on the identical bytes
  • Restore: scripts/restore_dataset.sh (downloads this asset, sha256-verifies, idempotent)
  • Data: © OpenStreetMap contributors (ODbL 1.0); derived from Geofabrik extracts
Assets 3
Loading