Skip to content

rangefind 0.3.0 — geographic index sharding

Choose a tag to compare

@xjodoin xjodoin released this 14 Jul 03:51

Geographic index sharding

Index a corpus as independently built and updated geographic shards that federate into one engine at query time — the planet-scale OSM path. Highlights:

  • Exact cross-shard scoring: a frozen scoring-stats artifact (rangefind/scoring-stats, scoringStats config) makes a sharded index reproduce the monolithic build's rankings exactly.
  • Sharded roots + runtime federation (rangefind/shards): lazy shard engines, bbox geo routing, expanding nearest-first, merged text/geo/sort/facet/suggest/vector/hybrid lanes.
  • Incremental shard updates: scoringStats composes with build --update; a delta generation is proven identical to a full rebuild.
  • Multi-level scoping: shards: ["canada"] resolves shard ids or group labels; hierarchical roots compose.
  • Provenance: meta block (attribution/license/generator/data version) in every manifest; OSM ships ODbL defaults.
  • Release structure: conditional exports with node-only guards, TypeScript declarations, rangefind/osm/extract API.

See docs/sharded-osm.md for the architecture, benchmarks (Québec, 6.1M places), and planet workflow. Full details in the CHANGELOG.