Repository navigation
What's new
Install from Python
The Arabic FTS5 tokenizer is now available on PyPI with prebuilt wheels—no compiler or manual extension download needed:
pip install sqlite-tokenizer-arimport sqlite3
import sqlite_tokenizer_ar
db = sqlite3.connect(':memory:')
sqlite_tokenizer_ar.load(db)
db.execute("CREATE VIRTUAL TABLE docs USING fts5(body, tokenize='sqlite_tokenizer_ar')")Supports Python 3.10+ on Linux x64/ARM64 (glibc 2.28+), macOS Apple Silicon (11+) and Intel (10.13+), and Windows x64. Python's SQLite must support FTS5 and extension loading. The loader disables extension loading after loading the tokenizer.
SQLite 3.54.1
Updated the browser/WASM bundle and desktop build headers to SQLite 3.54.1. Python wheels bundle the tokenizer extension, not a replacement SQLite runtime.
More reliable builds and updates
- All five Python wheels are installed and smoke-tested in CI before publishing.
- Compatibility checks load the same extension into SQLite 3.40.1, 3.51.2, and 3.54.1.
- macOS packaging rejects binaries whose minimum OS requirement is newer than their wheel label claims.
- Added Renovate dependency updates and automatic SQLite header refreshes with CI checks before merging.
- Updated CI tools and pinned build actions and Linux wheel images for reproducibility.
Native desktop archives, Android libraries, the iOS XCFramework, and the WASM package remain available below.
Full changelog: v0.1.14...v0.1.15