Arrow 57 / DataFusion 51 / Lance 2 + BlasGraph Algebra + SPO Triple Store

[AdaWorldAPI]

PR: Arrow 57 / DataFusion 51 / Lance 2 + BlasGraph Algebra + SPO Triple Store

Title

feat: arrow 57, datafusion 51, lance 2 + BlasGraph semiring algebra + SPO triple store

Body

---

Follows up on lance-format#146 (closed — split was planned but the pieces are interdependent, so shipping as one clean PR rebased on current main).

Summary

Three additions in one PR because they share the dependency bump and build on each other:

1. Dependency alignment — arrow 57, datafusion 51, lance 2, deltalake 0.30, pyo3 0.26
2. BlasGraph — GraphBLAS-inspired sparse linear algebra over hyperdimensional bit vectors (3,173 lines, 81 tests)
3. SPO triple store — Subject-Predicate-Object graph primitives with bitmap ANN, NARS truth gating, and Merkle integrity (1,443 lines, 38 tests)

All 119 new tests pass. Clippy clean across all crates. No breaking changes to existing APIs.

---

1. Dependency Upgrades

Dependency	From	To	Crates
arrow / arrow-array / arrow-schema	56.2	57	lance-graph, catalog, python
datafusion (+ subcrates)	50.3	51	lance-graph, catalog, python
lance / lance-linalg / lance-namespace	1.x	2	lance-graph
deltalake	0.29	0.30	lance-graph
pyo3	0.25	0.26	lance-graph-python

---

What This Enables

With these three additions, lance-graph gains:

• Graph algorithms as linear algebra — BFS, SSSP, PageRank expressed as semiring-parameterized matrix multiplications, extensible to custom algorithms by defining new semirings
• Content-addressable triple storage — knowledge graph operations via bitmap fingerprints with sub-millisecond approximate matching
• Confidence-gated queries — NARS truth values allow filtering unreliable edges before they enter the computation, reducing noise in multi-hop traversals
• Integrity verification — Merkle stamping detects data corruption without full table scans

These compose naturally: the SPO store uses the HammingMin semiring from BlasGraph for chain traversal, and the bitmap fingerprints share the same bit-vector primitives as BlasGraph's BitVec type.

---

Migration Notes

• No breaking changes to existing public APIs
• Existing tests pass without modification
• New graph module is additive — accessed via lance_graph::graph::{blasgraph, spo}
• New dev dependency: blake3 (for Merkle hashing)
• CI: added clippy + cargo check for lance-graph-python crate

---

Stats

New code:    ~5,000 lines of Rust
New tests:   119 (81 BlasGraph + 31 SPO unit + 7 SPO integration)
All passing: ✓
Clippy:      clean across all crates