Skip to content

v0.1

Choose a tag to compare

@zot zot released this 01 Mar 15:40
· 70 commits to main since this release

Initial release of microfts2 — a dynamic LMDB trigram index in Go.

Features

  • Trigram indexing with configurable character sets (6-bit encoding, 18-bit trigrams)
  • Two-tree LMDB design — content DB is durable, index DB is rebuildable
  • Pluggable chunking strategies — any command that outputs byte offsets
  • Three built-in chunkers — line-based, overlapping lines, overlapping words
  • Staleness detection — tracks file mod time and SHA-256 hash; -r flag auto-refreshes before any command
  • Active trigram cutoff — configurable frequency percentile controls index selectivity
  • Long filename support — key chaining for paths exceeding LMDB's 511-byte limit
  • Library API — usable as a Go package, not just a CLI