Skip to content

v0.4.0b1 — Beta: Incremental & Parallel Indexing

Pre-release
Pre-release

Choose a tag to compare

@NeelPrime NeelPrime released this 07 Jul 23:11
· 11 commits to main since this release

⚠️ Beta Release

This is a beta release. Please report any issues.

New Features

Incremental Indexing (default)

  • Only re-indexes files that changed since last run
  • Unchanged files are skipped via content hash comparison
  • Deleted files are automatically removed from the map
  • Second run on same codebase completes in milliseconds

Parallel Indexing (opt-in)

  • Multi-core parsing for large monorepos
  • Each worker gets its own tree-sitter parser
  • Single-writer SQLite merge (no concurrency issues)

Usage

# Incremental (default)
arbiterx map

# Force full re-index
arbiterx map --force

# Parallel (8 cores)
arbiterx map --workers 8

# Auto-detect cores
arbiterx map --workers 0

Install

pip install arbiterx-gate==0.4.0b1

Performance

Scenario Before After
First run (300 files) 3s 3s
Second run (nothing changed) 3s 0.05s
Edit 2 files, re-run 3s 0.1s
1000 files, 8 workers 50s ~8s