You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This commit was created on GitHub.com and signed with GitHub鈥檚 verified signature.
Chunks are now buffered across documents and sent to the embedding server in batches instead of one request per document, cutting HTTP round trips on remote embedding endpoints.
Added IndexOptions.EmbedBatchSize to control the batch size. Leave it nil for the default of 50; set a positive value to override (1 sends one chunk per request). Zero or negative is rejected.
Batches contain whole documents and succeed or fail as a unit. A failed batch leaves its documents in the chunked state for the next run to retry.
Added IndexOptions.OnProgress to report indexing progress as (phase, done, total) across the scanning, indexing, and cleanup phases.
Added the examples/progress program showing progress reporting during an index run.
Documented batching, change detection, and file identity behavior in docs/architecture.md.
Raised the fingerprint and process document page sizes from 1 to 100, reducing per document database round trips during indexing.
Expanded test coverage of storage, search, and fingerprint error paths.