Repository navigation
Highlights
-
Index SharePoint and OneDrive. A
clouddriveWarehouse connects to Microsoft 365 through an Entra app registration with the Graph application permissionSites.Read.Alland admin consent, authenticating by certificate (the default) or client secret. The operator verifies access before any pipeline runs and reports the token's granted roles. AclouddrivePipeline source then syncs selected sites, libraries, folders or individual items through Graph delta, and keeps deselected rows until you remove them. PDFs, Office documents and scanned images extract once per content version; photos embed with CLIP and deduplicate by content. Originals are retained independently of indexing. Cloud drives / Microsoft Graph, Cloud drive sources and Warehouse originals. (#693, #695, #697, #698, #852, #853, #866, #876, #1023) -
Python SDK path parameters. The client now percent-encodes path parameters. Pass raw namespace names and other path arguments; remove caller-side URL encoding to avoid double encoding.
-
Stage and restore record revisions. Pgvector namespaces can opt into immutable record history with automatic activation or explicit publishing. Search and normal reads use only the active revision; inactive revisions stay outside candidate retrieval. Activation supports expected-current-version conflict checks and a separate event history. Revisions remain until namespace deletion; named record deletion preserves history for restoration. This first slice supports string IDs and full upserts. Record versions. (#1025)
-
PDF pages embed in full.
layer-extract writereplaces the extractor's CPU sidecar embedding stage. It writes staged page rows with a nativetextembedding schema, preserving page provenance and removing the 1,500-character cap. On a targeted 30-question long-page regression set, top-five page hits improved from 16/30 to 26/30 withvoyage/voyage-4; this is not a production-wide quality estimate. (layer-pro#711) -
Functions rerun on changed inputs. Same-version source changes requeue completed rows, including pipeline metadata writes. Claims return
input_revision; completion items echo it so delayed outputs cannot overwrite a newer source revision. The generated Python worker forwards revisions automatically. Manual workers must forward claim receipts after inputs change. (layer-pro#721) -
MCP discovers and searches your namespaces. Minted keys authenticate on pass-through gateways;
list_namespacesexposes readable namespaces, and generic tools support larger namespace sets. Text search selects BM25 for non-fuzzy fields and hybrid ranking for fuzzy fields; declared CLIP profiles support image search. The Desktop extension connects these tools to Claude Desktop. MCP reference and Desktop setup. (layer-pro#741, #754, #745, #743, #749; docs #814) -
Collapse returns one result per document. Add
collapse: {by: "document"}to a ranked query and the gateway readstop_k × expansionrows, groups them, and returns the besttop_kgroups with their matching rows."document"uses_hevlayer_parent_idor a schema attribute markeddocument: true, and returns 400 when a namespace has neither.missingtakesown,together,drop, or{"mode", "values"}, so a["job", "folder"]list can fall back past a "No job" placeholder. It works on turbopuffer and Postgres, grouping in the gateway on both. The tunableexpansiondefaults to 10. A larger candidate window can expose more distinct groups at increased store work, response size and latency; reads are capped at 10,000 rows. Paging withcursoris not supported yet. Collapse reference. (#827, #824, #833) -
Field stats describe filterable attributes. Pro metadata accepts
field_stats=truefor missing counts, distinct values and numeric ranges, plusfield_stats_top=Nfor common values.Index.spec.fieldStatsdefaults to automatic coverage and supports lists, exclusions, a value cap and an interval. Reads never start scans; stats and snapshot facets share one reconcile projection. Initial coverage remains explicit rather than reporting an exact zero. Namespace metadata. (#825)
Deferred
High-cardinality estimates above the exact-value cap and measured latency, accuracy and scan-byte acceptance remain for later increments. This increment reports a conservative lower bound above the cap.
Clients
- The Python, TypeScript and Go clients are published at 0.8.0.
Merged since v0.7.3: auto-generated ledger
Release branch: v0.8
Docs preview:
- Agentic search — https://v0.8.x.hevlayer.com/docs/api/agents/
- Blobs — https://v0.8.x.hevlayer.com/docs/api/blobs/
- Checkpoints — https://v0.8.x.hevlayer.com/docs/api/checkpoints/
- Embed — https://v0.8.x.hevlayer.com/docs/api/embed/
- Federated query — https://v0.8.x.hevlayer.com/docs/api/federated-query/
- Introduction — https://v0.8.x.hevlayer.com/docs/api/introduction/
- API keys — https://v0.8.x.hevlayer.com/docs/api/keys/
- Latest-row aggregates — https://v0.8.x.hevlayer.com/docs/api/latest-relation/
- Lattice — https://v0.8.x.hevlayer.com/docs/api/lattice/
- MCP server — https://v0.8.x.hevlayer.com/docs/api/mcp/
- Namespace metadata — https://v0.8.x.hevlayer.com/docs/api/namespace-metadata/
- Pipelines — https://v0.8.x.hevlayer.com/docs/api/pipelines/
- Query & Fetch — https://v0.8.x.hevlayer.com/docs/api/query/
- Record versions — https://v0.8.x.hevlayer.com/docs/api/record-versions/
- Response Headers — https://v0.8.x.hevlayer.com/docs/api/response-headers/
- Scan — https://v0.8.x.hevlayer.com/docs/api/scans/
- Query History — https://v0.8.x.hevlayer.com/docs/api/search-history/
- Search — https://v0.8.x.hevlayer.com/docs/api/search/
- Snapshot History — https://v0.8.x.hevlayer.com/docs/api/snapshots/
- Turbopuffer passthrough — https://v0.8.x.hevlayer.com/docs/api/upstream-features/
- Vector stores — https://v0.8.x.hevlayer.com/docs/api/vectorstores/
- Warehouses — https://v0.8.x.hevlayer.com/docs/api/warehouses/
- Warm cache — https://v0.8.x.hevlayer.com/docs/api/warm-cache/
- Write & Stage — https://v0.8.x.hevlayer.com/docs/api/write/
- CLI retrieval — https://v0.8.x.hevlayer.com/docs/cli-retrieval/
- Layer CLI — https://v0.8.x.hevlayer.com/docs/cli/
- Concepts — https://v0.8.x.hevlayer.com/docs/concepts/
- Dashboard — https://v0.8.x.hevlayer.com/docs/dashboard/
- Demos — https://v0.8.x.hevlayer.com/docs/demos/
- Document model — https://v0.8.x.hevlayer.com/docs/document-model/
- Failure Modes — https://v0.8.x.hevlayer.com/docs/failure-modes/
- Functions — https://v0.8.x.hevlayer.com/docs/functions/
- No Guarantees — https://v0.8.x.hevlayer.com/docs/guarantees/
- Retain Warehouse originals — https://v0.8.x.hevlayer.com/docs/guides/warehouse-originals/
- Introduction — https://v0.8.x.hevlayer.com/docs/
- Indexes — https://v0.8.x.hevlayer.com/docs/indexes/
- Install — https://v0.8.x.hevlayer.com/docs/install/
- Backfill a Function over existing rows — https://v0.8.x.hevlayer.com/docs/kubernetes/backfill-a-function/
- Operator Overview — https://v0.8.x.hevlayer.com/docs/kubernetes/operator/
- Licensing — https://v0.8.x.hevlayer.com/docs/licensing/
- Health and metrics — https://v0.8.x.hevlayer.com/docs/observability/
- PDF extraction — https://v0.8.x.hevlayer.com/docs/pdf-extraction/
- Quickstart — https://v0.8.x.hevlayer.com/docs/quickstart/
- Changelog — https://v0.8.x.hevlayer.com/docs/roadmap/
- Scaling — https://v0.8.x.hevlayer.com/docs/scaling/
- Store capability matrix — https://v0.8.x.hevlayer.com/docs/stores/
- Tradeoffs — https://v0.8.x.hevlayer.com/docs/tradeoffs/
Added
- feat: serve seeded MCP search and get tools (LYR-166) (layer-pro#704) — mirror commit
- feat(rest): page-number pagination and single-partition snapshots (layer-pro#708) — mirror commit
- feat: embed clouddrive photos with CLIP and content deduplication (layer-pro#698) — mirror commit
- feat(operator): run declared embedders with scale-to-zero (LYR-174) (layer-pro#710) — mirror commit
- feat(embed): route worker embeddings to declared containers (layer-pro#714) — mirror commit
- feat: extract SharePoint PDFs once per content (LYR-149) (layer-pro#697) — mirror commit
- feat(extract): scanned images and TIFFs as clouddrive documents (layer-pro#853) — mirror commit
- feat(mcp): pinned where filter and the story MCP server (layer-pro#970) — mirror commit
- feat(functions): bulk backfill over existing rows (LYR-312) (layer-pro#972) — mirror commit
- feat: retain record revisions with atomic activation on pgvector (LYR-319) (layer-pro#1025) — mirror commit
Changed
- [impl] chore(release): advance to 0.8.0-dev (layer-pro#691) — mirror commit
- [impl] layer-extract: stock PDF extract worker (LYR-142) (layer-pro#692) — mirror commit
- Add Microsoft Graph clouddrive Warehouse access (LYR-147) (layer-pro#693) — mirror commit
- Export CI-built operator images for authorized ECR publication (layer-pro#696) — mirror commit
- Sync cloud drive metadata through Graph delta (LYR-148) (layer-pro#695) — mirror commit
- Recover /search with Postgres schema embeddings (LYR-90) (layer-pro#694) — mirror commit
- release-captain: post to #factory, one thread per release, @mention on ready/blocked (layer-pro#707) — mirror commit
- Add REST Warehouse login and token renewal (layer-pro#705) — mirror commit
- Make turbopuffer a first-class embedding route (LYR-176) (layer-pro#709) — mirror commit
- Write full PDF pages with native embeddings (LYR-175) (layer-pro#711) — mirror commit
- Requeue Functions on declared input changes and fence stale completions (layer-pro#721) — mirror commit
- Refresh PDF source timestamps on metadata-only replay (layer-pro#720) — mirror commit
- ci: pgvector uses gateway-mirror's images from the shared runner daemon (LYR-196) (layer-pro#726) — mirror commit
- ci: operator-ecr-build saves to Depot's registry, not a GitHub artifact (layer-pro#727) — mirror commit
- Complete MCP Desktop onboarding and Compose acceptance (LYR-166) (layer-pro#706) — mirror commit
- Gate Function recovery acceptance on persistence, ACK and both collections (layer-pro#724) — mirror commit
- Test timestamp invalidation and safe completion patch retries (layer-pro#722) — mirror commit
- Recover expired Function claims after workers scale to zero (layer-pro#716) — mirror commit
- Clarify namespace bootstrap before schema update and readback (layer-pro#725) — mirror commit
- Make Function persistence and owned ACK retries consistent (layer-pro#723) — mirror commit
- Document BCC recovery receipts and remaining live acceptance gates (layer-pro#728) — mirror commit
- Add reproducible synthetic Function completion acceptance runner (layer-pro#729) — mirror commit
- Preserve strong consistency for native metadata censuses (layer-pro#730) — mirror commit
- Use strong canonical source reads for Function inputs (layer-pro#731) — mirror commit
- LYR-162: measure Lattice WASM and micropuffer edge replica parity (layer-pro#699) — mirror commit
- Rebase cargo-minor group of nine updates onto current main (layer-pro#732) — mirror commit
- Quarantine absent Function sources before returning claims (layer-pro#733) — mirror commit
- Rebase npm-minor group of three updates onto current main (layer-pro#734) — mirror commit
- Verify protected REST acquisition and document KI access handoff (layer-pro#738) — mirror commit
- Recover large PNG photos in the stock image worker (layer-pro#746) — mirror commit
- Fix minted ApiKeys on deriveFromStore gateways (LYR-218) (layer-pro#741) — mirror commit
- MCP servers discover scoped namespaces and scale past eight (layer-pro#744) — mirror commit
- test: verify MCP discovery against real BCC metadata (LYR-219) (layer-pro#754) — mirror commit
- perf(functions): bound ordered completion batches under namespace locks (layer-pro#756) — mirror commit
- Bound Function discovery with durable namespace progress and fair claims (layer-pro#757) — mirror commit
- Configure hosted kit namespace family (LYR-226) (layer-pro#759) — mirror commit
- LYR-231: Manage kit invites from the dashboard (layer-pro#760) — mirror commit
- Constrain key minting and namespace deletion to issuer prefixes (layer-pro#761) — mirror commit
- Add kit invite redemption, admin routes and one-time sessions (layer-pro#762) — mirror commit
- LYR-229: prove invite lifecycle with local Pro gateway and Worker/D1 (layer-pro#765) — mirror commit
- Verify dashboard invites against real local Worker and Pro gateway (layer-pro#766) — mirror commit
- Complete kit minter acceptance tests and provisioning docs (layer-pro#767) — mirror commit
- Host kit dashboard with isolated tester sessions (LYR-232) (layer-pro#763) — mirror commit
- Export kit invite monitor cohorts with honest redemption timestamps (layer-pro#771) — mirror commit
- Provision BCC MCP and route dedicated hosts through shared auth (LYR-220) (layer-pro#751) — mirror commit
- Measure gateway BM25 and hybrid on ParadeDB 0.18 and 0.26 RC (layer-pro#776) — mirror commit
- Define capacity lifecycle and durable notification contract (layer-pro#775) — mirror commit
- Validate ParadeDB benchmark methodology in CI and reject unmatched tuning (layer-pro#778) — mirror commit
- Observe capacity lifecycle with durable notifications (layer-pro#779) — mirror commit
- LYR-213: benchmark and serve licensed GPU OCR backends (layer-pro#737) — mirror commit
- Exclude CPU claim alerts and preserve GPU request discovery baselines (layer-pro#784) — mirror commit
- Build saved capacity monitor images from exact source revisions (layer-pro#782) — mirror commit
- Correct termination stall onset clocks and legacy timer provenance (layer-pro#786) — mirror commit
- Activate hosted kit dashboard and record live rollout acceptance (layer-pro#773) — mirror commit
- Serialize measured capacity source lag as a JSON number (layer-pro#787) — mirror commit
- Route eligible PDF pages to PP-OCRv5 with recorded provenance (layer-pro#783) — mirror commit
- Record matched gateway BM25 and hybrid benchmark on ParadeDB RC (layer-pro#788) — mirror commit
- Fix OCR replay after indexed manifests retire (layer-pro#789) — mirror commit
- LYR-246: Add reproducible private repeat-failure archive analyzer (layer-pro#791) — mirror commit
- LYR-246: Disclose source consistency and archive apply ownership (layer-pro#793) — mirror commit
- Label archived session outcomes in private RFC 0005 evals (layer-pro#792) — mirror commit
- Measure the private repeat-failure baseline for LYR-246 (layer-pro#794) — mirror commit
- Prepare captured-cohort archive audit and immutable eval readback (layer-pro#795) — mirror commit
- Make tracing capture tests deterministic (LYR-127) (layer-pro#797) — mirror commit
- test(pgvector): verify multi-field FTS gateway acceptance (LYR-87) (layer-pro#796) — mirror commit
- test: gate shelf empty matches and corpus health with read-only smoke (layer-pro#803) — mirror commit
- test(pgvector): verify LYR-112 server capability contract (layer-pro#801) — mirror commit
- Measure Nightly cleanup outcomes and preserve deployed runtime receipts (layer-pro#805) — mirror commit
- Preserve immutable Nightly runtime evidence when collection fails (layer-pro#806) — mirror commit
- Bound Cargo concurrency in scheduled Nightly (layer-pro#809) — mirror commit
- Remove offline shop from live demo links (LYR-254) (layer-pro#810) — mirror commit
- Capture LYR-255 production before billing evidence (layer-pro#812) — mirror commit
- Meter Turbopuffer billing by operation and bounded caller (LYR-256) (layer-pro#811) — mirror commit
- Document historical Turbopuffer billing coverage boundary (layer-pro#818) — mirror commit
- Bound Function discovery scans and failure retries (LYR-255) (layer-pro#813) — mirror commit
- Dashboard queried-byte attribution by namespace and window (LYR-256) (layer-pro#819) — mirror commit
- Reconcile flagged-only BCC OCR replay and searchable coverage (layer-pro#790) — mirror commit
- Desktop MCP extension: accept dedicated-host URLs, surface config errors (LYR-250) (layer-pro#823) — mirror commit
- Dashboard: show historical-coverage caveat on cost attribution (LYR-256) (layer-pro#820) — mirror commit
- Rename BCC photos MCP tool to images (LYR-251) (layer-pro#822) — mirror commit
- Measure foreground namespace DELETE latency phases (layer-pro#817) — mirror commit
- Add candidate runs for Functions (LYR-157) (layer-pro#829) — mirror commit
- LYR-243: verify production namespace discovery with real keys and cleanup (layer-pro#785) — mirror commit
- Function option groupByParent: claim one item per document (LYR-156) (layer-pro#828) — mirror commit
- Collapse: one result per document on ranked queries (LYR-264) (layer-pro#827) — mirror commit
- Add private authenticated archive outcome review (layer-pro#831) — mirror commit
- Make GPU lifecycle Slack notifications readable and actionable (layer-pro#830) — mirror commit
- Deliver private review local launch and executable authentication checks (layer-pro#834) — mirror commit
- Collapse on /search (rerank, then group) (layer-pro#824) — mirror commit
- Give the original row of a chunked write a vector so Turbopuffer accepts it (LYR-237) (layer-pro#826) — mirror commit
- Expose retrieval APIs and capability receipts in the Layer CLI (layer-pro#836) — mirror commit
- Field stats on namespace metadata (?field_stats=true) (layer-pro#825) — mirror commit
- Trim the Rust job's Cargo target in a last step so runners stop filling the VM disk (layer-pro#835) — mirror commit
- Fix native form login origin in private outcome review (layer-pro#838) — mirror commit
- LYR-264: document tunable Collapse defaults and verify grouping options (layer-pro#833) — mirror commit
- Support normalized document originals and independent Story text profiles (layer-pro#839) — mirror commit
- Bind cached document manifests and reused pages to original provenance (layer-pro#842) — mirror commit
- LYR-255 acceptance receipt (OPEN: no causal production AFTER) (layer-pro#821) — mirror commit
- Land accepted outcome-label kinds; correction and imprint experimental (layer-pro#798) — mirror commit
- Fix private outcome review startup and indexed context on real archives (layer-pro#846) — mirror commit
- Prevent catchable cancellation from leaking owned CE Compose stacks (layer-pro#832) — mirror commit
- Persist exact ownership for Compose acceptance invocations (layer-pro#847) — mirror commit
- Return distinct document groups from the BCC MCP (layer-pro#837) — mirror commit
- Make Function document reads cacheable and enforce per-item query budgets (layer-pro#816) — mirror commit
- operator: admit sourceRef.extract on clouddrive Pipelines (layer-pro#850) — mirror commit
- Isolate Compose fault fixtures from hosted credentials and daemon settings (layer-pro#848) — mirror commit
- layer-extract: Office documents via include.mimeTypes (docx/xlsx/pptx/doc/xls/ppt) (layer-pro#852) — mirror commit
- clouddrive: case-insensitive multi-folder selection (include.paths) (layer-pro#856) — mirror commit
- layer-extract: offline Office clouddrive proof (LYR-280) (layer-pro#857) — mirror commit
- Keep Compose inventory strict under concurrent disappearance and retain error receipts (layer-pro#854) — mirror commit
- BCC MCP: Story documents (pov-bcc-story-pages) with five filters and page links (layer-pro#859) — mirror commit
- Recover workers and record owned production scratch cleanup (layer-pro#844) — mirror commit
- Index title and description on spec.metadata, served by the gateway (layer-pro#862) — mirror commit
- extract: priority ordering for source items (ordering only) (layer-pro#863) — mirror commit
- extract: drive-scoped priority selectors (layer-pro#864) — mirror commit
- Dispose exact registered acceptance volumes after teardown (layer-pro#860) — mirror commit
- Align local Compose registration with installed recovery hooks (layer-pro#865) — mirror commit
- clouddrive: several roots per library (drives.sites[].roots) (layer-pro#866) — mirror commit
- extract: native PDFs keep their parse identity when conversion is enabled (layer-pro#868) — mirror commit
- clouddrive: exclude exact items by driveId and itemId (layer-pro#870) — mirror commit
- extract: native PDF identity ignores the converter segment main joins to the parser id (layer-pro#871) — mirror commit
- Support Bookworm pikepdf in stock document normalization (layer-pro#851) — mirror commit
- extract: share converter id composition between main and the identity test (layer-pro#873) — mirror commit
- Pin mirror BSL change date across midnight (layer-pro#869) — mirror commit
- Share namespace spend admission with metadata reads (layer-pro#849) — mirror commit
- Validate and archive Nightly DELETE acceptance evidence (layer-pro#804) — mirror commit
- LYR-269: Declare Index field statistics coverage and share reconciliation (layer-pro#841) — mirror commit
- extract: classify OCR failures and retry transient backend restarts (layer-pro#874) — mirror commit
- LYR-242: upgrade Layer CE to ParadeDB 0.26.0 GA (layer-pro#777) — mirror commit
- LYR-242: final ParadeDB 0.18.0 vs 0.26.0 GA gateway benchmark (layer-pro#877) — mirror commit
- clouddrive: exact item selection by reference and retention of deselected rows (layer-pro#876) — mirror commit
- LYR-269: field stats distinct estimate above valueCap and as_of contract (layer-pro#875) — mirror commit
- Gateway telemetry reports license issuance id and tier (LYR-278) (layer-pro#878) — mirror commit
- LYR-269: BCC fieldStats declaration, LYR-265 acceptance tooling and evidence (layer-pro#880) — mirror commit
- LYR-269: read-only live rollout and scan-budget proposal for pov-bcc-pages (layer-pro#881) — mirror commit
- LYR-269: correct operator claim, delta from actual runtime, rollout timing (layer-pro#882) — mirror commit
- gateway + extract: retained rows preserved without new work; process/runtime metrics; visible clouddrive walk (layer-pro#879) — mirror commit
- LYR-269: readiness for the operator decision (runtime reconcile, review inputs, enforced budget) (layer-pro#883) — mirror commit
- LYR-288: rest Warehouses stay in sync on a loop (layer-pro#885) — mirror commit
- rest-source: change_fingerprint seam for LYR-292 (layer-pro#887) — mirror commit
- LYR-290: MCP search paging (total, next_cursor, cursor), typed argument errors (layer-pro#886) — mirror commit
- rest attachments: layer-extract turns a REST row's file into page rows (layer-pro#888) — mirror commit
- bcc MCP seed: add ki-invoices (LYR-168) (layer-pro#891) — mirror commit
- LYR-168: rest forEach values from a list endpoint (from: api), nested forEach (layer-pro#889) — mirror commit
- LYR-291: MCP aggregate tool with bounded cost and billed bytes per call (layer-pro#890) — mirror commit
- LYR-291: learnings for the MCP aggregate wire and cost (layer-pro#893) — mirror commit
- LYR-290: MCP paging ranks a fixed id-only window per page (layer-pro#892) — mirror commit
- bcc MCP seed: serve ki-invoice-pages (LYR-168) (layer-pro#894) — mirror commit
- bcc MCP seed: KI id filters on pages and photos, and the KI id namespaces (pov-bcc LYR-289) (layer-pro#896) — mirror commit
- LYR-301: layer-extract merges a rest source into a clouddrive source by content (layer-pro#895) — mirror commit
- values-mcp-bcc: drop array ki_ filters (match live bcc MCP config) (layer-pro#897) — mirror commit
- bcc MCP seed: KI booked costs, pay apps, cost code on invoices (pov-bcc LYR-291) (layer-pro#898) — mirror commit
- Pipeline staging: skip the manifest scan for documents that are not queued (LYR-208) (layer-pro#901) — mirror commit
- LYR-301: values-mcp-bcc mirror for pov-bcc-invoice-docs (layer-pro#899) — mirror commit
- Pipeline chunk lookup: read claimed segments before the pending queue (LYR-208) (layer-pro#902) — mirror commit
- MCP: []string filters, and one cost-code filter per catalog on the bcc seed (pov-bcc) (layer-pro#900) — mirror commit
- Support numeric REST estimate mappings for MCP ranges (LYR-304) (layer-pro#904) — mirror commit
- Field stats: enforce the approved 0.963 USD/day reserved scan ceiling (layer-pro#905) — mirror commit
- Shared-fenced Function cache startup and bounded read receipts (layer-pro#858) — mirror commit
- LYR-287: MCP fetch_original: authorized original PDFs and page images (layer-pro#884) — mirror commit
- LYR-287: retainOriginals on by default (false opts out) (layer-pro#907) — mirror commit
- Expose KI estimate numeric range in BCC MCP (LYR-304) (layer-pro#906) — mirror commit
- Prepare inactive shared cache authority and explicit drain bootstrap (layer-pro#908) — mirror commit
- LYR-287: BCC MCP seed originals config + rollout plan (layer-pro#910) — mirror commit
- Field stats: cap the shared snapshot scan with the approved spend ledger (layer-pro#909) — mirror commit
- extract: reap orphaned converter helpers, retry crashes once, sanitized failure causes (layer-pro#903) — mirror commit
- Field stats: log installed snapshot budgets; render and validate the BCC budget configuration (layer-pro#912) — mirror commit
- LYR-287: backfill Function bounded Graph coexistence and no-resubmit completions (layer-pro#911) — mirror commit
- LYR-287: BCC backfill declaration rateLimit 2 rps (contract) (layer-pro#913) — mirror commit
- LYR-269: cover the two new BCC cost-code filters (16 fields) under the existing cap (layer-pro#915) — mirror commit
- LYR-287: Function backfill for legacy rows (content_hash proof, webUrl mapping) (layer-pro#916) — mirror commit
- LYR-287: bounded-run watcher for the original-refs Function; oversize options (layer-pro#918) — mirror commit
- LYR-287: synthetic test for watch-run.sh stop paths (layer-pro#919) — mirror commit
- gateway: time the namespace write mutex; diagnosis of the Story write ceiling (layer-pro#917) — mirror commit
- LYR-287: watcher: worker-gone only after a pod was seen (layer-pro#920) — mirror commit
- LYR-287: Function resolves REST-attachment copies (invoice docs) with the content_hash proof (layer-pro#921) — mirror commit
- Field stats snapshot budget: pin projected attributes only; lapsed review no longer blocks startup (layer-pro#923) — mirror commit
- pipeline: bulk page-row write route and write-stage packing (amortize the namespace write cost) (layer-pro#922) — mirror commit
- LYR-287: REST copies: tolerate junk before %PDF- (as the connector does); count ambiguity reasons (layer-pro#924) — mirror commit
- LYR-287: size never overrides an equal hash; watcher reads the real Coverage format (layer-pro#925) — mirror commit
- LYR-287: worker-side run cap (exact docs + restart-proof rows); provider errors classified (layer-pro#926) — mirror commit
- write stage backoff + say why the store refused a write (writer and gateway logs) (layer-pro#927) — mirror commit
- LYR-287: Function patch must not cache a partial row; fetch_original source link independent of the cache (layer-pro#928) — mirror commit
- LYR-287: durable run limits: outage breaker, restart-safe pause, doc cap requires row target (layer-pro#929) — mirror commit
- LYR-287: oversize originals are skipped-oversize (completed with a record), not failed (layer-pro#930) — mirror commit
- LYR-287: refused self-pause fails closed (hold), durable hold marker across restarts (layer-pro#931) — mirror commit
- Discovery lease binds the stored spec jsonb (fixes moment-* lease spin) (layer-pro#932) — mirror commit
- LYR-287: the run watcher detects a same-pod gateway restart and lost health (layer-pro#934) — mirror commit
- LYR-287: missing originals are counted by reason (layer-pro#933) — mirror commit
- Consistency watcher stops polling namespaces that 404 upstream (layer-pro#935) — mirror commit
- LYR-287: stale queue input no longer makes a document 'missing' (layer-pro#936) — mirror commit
- LYR-287: count what the claim re-read found; log claim key names for no-candidate (layer-pro#937) — mirror commit
- Extractor: an OCR-empty page is text-free, not a failed document (layer-pro#940) — mirror commit
- LYR-287: a Function claims only from its current targetNamespaces (layer-pro#941) — mirror commit
- LYR-287: REST-only documents are rest-copy-only; runbook states the actual cause of the pages 'missing' (layer-pro#939) — mirror commit
- LYR-287: a Graph 403 on one file is refused (that document), not a run-wide denial (layer-pro#942) — mirror commit
- Gateway: do not hold a DashMap read guard across an await (leading cause of the liveness hangs) (layer-pro#943) — mirror commit
- Function workers survive a planned gateway roll; document the single-replica topology (layer-pro#946) — mirror commit
- Recover abandoned scan reservations conservatively with a durable audit (layer-pro#945) — mirror commit
- LYR-287: a Function completion 409 (discard/reclaim) no longer exits the worker (layer-pro#947) — mirror commit
- Gateway ingress: tighter ALB health check; measured 40.5s roll baseline (layer-pro#949) — mirror commit
- Fence ownerless scan admission and retain conservative charges (layer-pro#948) — mirror commit
- Chart: external queue Postgres + standalone queue Postgres (decouple storage from gateway rolls) (layer-pro#950) — mirror commit
- Ship the scan recovery tool in the gateway target architecture (layer-pro#951) — mirror commit
- LYR-287: adopt a prepared completion receipt on re-claim (fixes the prepared_receipt_mismatch crash loop) (layer-pro#953) — mirror commit
- Chart: optional surge Deployment gateway; roll script WORKLOAD_KIND (layer-pro#952) — mirror commit
- LYR-287: watch-run.sh --planned-roll observes one named gateway replacement (layer-pro#956) — mirror commit
- Chart: do not force LAYER_MCP_ENABLED=false; helm post-renderer to hold objects; cutover diff + rollback (layer-pro#955) — mirror commit
- Learning: corrections to the gateway cutover proposal (layer-pro#957) — mirror commit
- Recover interrupted scan owners before metadata bootstrap admission (layer-pro#954) — mirror commit
- Field stats: skip a capped snapshot scan when the namespace was written in the last 15 s (layer-pro#958) — mirror commit
- Extend stock extraction to Story document formats (layer-pro#962) — mirror commit
- Repair oversized OCR extraction and bound failed sweep retries (layer-pro#963) — mirror commit
- Preserve extraction caches when adding formats and skip identical page writes (layer-pro#965) — mirror commit
- Bulk hydrate Story Function inputs for zero billed document reads (LYR-261) (layer-pro#964) — mirror commit
- ci: route Linux jobs to Oven and retain Rust build outputs (layer-pro#967) — mirror commit
- Move remaining Linux CI and Rust release stages to Oven (layer-pro#969) — mirror commit
- LYR-313: keep turbopuffer blobs in S3; paged move of existing blob sets (layer-pro#978) — mirror commit
- Start Layer work from docs and describe staging accurately (layer-pro#1010) — mirror commit
- Require real measured LYR-313 window evidence (layer-pro#1011) — mirror commit
- Report backfill completion for the current Function definition (layer-pro#1013) — mirror commit
- Document Warehouse-to-S3 originals reconciliation acceptance (layer-pro#1022) — mirror commit
- Retain cloud-drive Warehouse originals independently of indexing (layer-pro#1023) — mirror commit
- Add read-only metadata inspection for selected originals (layer-pro#1026) — mirror commit
- Bind gateway edition checks to ECR registry and preserve lookup failures (layer-pro#735) — mirror commit
- Retain site deployment evidence without artifact storage (layer-pro#1028) — mirror commit
- Retain snapshot originals and opt-in unclassified source bytes (layer-pro#1027) — mirror commit
- Prepare CDC contract and Kit parity validation (LYR-320) (layer-pro#1024) — mirror commit
- Add bounded latest-row scalar and grouped aggregate relations (layer-pro#1036) — mirror commit
- Share backend docs and localize Luxir capability gaps (layer-pro#1033) — mirror commit
- Deploy complete parallel source scans for internal Kit Stats (layer-pro#1042) — mirror commit
- Add 0.8 preview Luxir benchmark plan and dev log (layer-pro#1047) — mirror commit
- CDC observe capture: record Kit writes in the Aerospike buffer, no destination writes (LYR-320) (layer-pro#1048) — mirror commit
- site: 0.8 hero leads with SharePoint and MCP (layer-pro#1052) — mirror commit
- chore(release): 0.8.0 (layer-pro#1054) — mirror commit
- Support collapsed BM25 type-ahead and job link payloads on Postgres (layer-pro#1057) — mirror commit
- Add the UAT and delivery runbook (layer-pro#1056) — mirror commit
- Move image builds and compiler caching to Oven (layer-pro#1059) — mirror commit
Fixed
- fix(query): preserve the origin's rank order (LYR-158) (layer-pro#700) — mirror commit
- fix(scans): report correct UTC job timestamps (layer-pro#702) — mirror commit
- fix(gateway): preserve upstream error text and caller status (layer-pro#703) — mirror commit
- fix(gateway): trigger Functions on pipeline vector completion (layer-pro#713) — mirror commit
- fix: preserve namespace ID types in generated filters (layer-pro#701) — mirror commit
- fix: run Function discovery automatically (LYR-163) (layer-pro#712) — mirror commit
- fix(extract): preserve staged rows, retry raised limits, isolate dry runs (layer-pro#715) — mirror commit
- fix(extract): reject incomplete PDF page sets (LYR-179) (layer-pro#717) — mirror commit
- fix: route stock worker publishing to the authorized mesh publisher (layer-pro#739) — mirror commit
- fix(extract): enable fuzzy search for PDF page text (LYR-216) (layer-pro#742) — mirror commit
- fix: declare and discover stock CLIP namespace embeddings (LYR-217) (layer-pro#743) — mirror commit
- fix: search non-fuzzy text attributes with BM25 (LYR-215) (layer-pro#745) — mirror commit
- fix: support safe per-item Function completion recovery (layer-pro#747) — mirror commit
- fix: keep legacy local text embedding schemas round-trippable (layer-pro#750) — mirror commit
- fix(rest-source): preserve wildcard array cardinality (layer-pro#752) — mirror commit
- fix(rest-source): send explicitly configured GET JSON bodies (layer-pro#753) — mirror commit
- fix: safely adopt durable prepared Function receipts (layer-pro#755) — mirror commit
- fix(functions): batch claim hydration and identify completion contention (layer-pro#758) — mirror commit
- fix(functions): prevent namespace admission pool and partial-lock convoys (layer-pro#770) — mirror commit
- fix: start stock photo ingestion on absent namespaces (layer-pro#772) — mirror commit
- fix: namespace discovery respects store entitlements (LYR-243) (layer-pro#781) — mirror commit
- fix(ci): verify current gateway before pgvector fixtures (layer-pro#799) — mirror commit
- fix: return empty search HybridText and Auto results (LYR-131) (layer-pro#802) — mirror commit
- fix: drain namespace purges blocked by oversized Aerospike sets (LYR-126) (layer-pro#800) — mirror commit
- fix: telemetry delivery acknowledgement and internal attribution (LYR-277) (layer-pro#845) — mirror commit
- fix: let document cache finish cold startup before liveness (layer-pro#914) — mirror commit
- fix(extract): qualify historical converter receipts across Debian revision rebuilds (layer-pro#971) — mirror commit
- fix(functions): backfill leaves legacy queue rows untouched (LYR-312) (layer-pro#975) — mirror commit
- fix(functions): backfill status from one snapshot; pause is not a discovery failure (LYR-312) (layer-pro#976) — mirror commit
- fix(functions): no per-document blob/row reads in backfill workers; worker billing labels; metadata apart from scan queries (LYR-312) (layer-pro#977) — mirror commit
- fix(functions): pausing mid backfill scan stops at a page boundary, not Conflict (LYR-315) (layer-pro#979) — mirror commit
- fix(functions): backfill parent lookup answers from held sibling groups, no provider reads (LYR-316) (layer-pro#981) — mirror commit
- fix(functions): backfill status counts agree mid-scan; a failed check keeps its snapshot (LYR-314) (layer-pro#980) — mirror commit
- fix(functions): backfill scans a namespace without _hevlayer_parent_id (LYR-315 UAT) (layer-pro#992) — mirror commit
- fix(functions): backfill page queues, counts and checkpoints in one commit (LYR-315 UAT) (layer-pro#997) — mirror commit
- fix(functions): deleting a Function with a large queue no longer times out (LYR-315 UAT cleanup) (layer-pro#999) — mirror commit
- fix(functions): backfills are not charged for write-path reads; per-Function read metrics (LYR-316) (layer-pro#1000) — mirror commit
- fix(functions): patch-only writes read nothing for Functions they cannot concern or that are paused (LYR-316) (layer-pro#1004) — mirror commit
- fix(compose): sweep registered fixture volumes after killed CE runs (layer-pro#1009) — mirror commit
- fix(mcp): restore Claude discovery and link missing originals (layer-pro#1012) — mirror commit
- fix(mcp): retain lexical names in long semantic questions (layer-pro#1015) — mirror commit
- fix(ci): keep field stats latency acceptance off shared Rust runners (layer-pro#1016) — mirror commit
- fix(mcp): rank document titles alongside sparse page text (layer-pro#1017) — mirror commit
- fix(mcp): combine title evidence with retrieval relevance (layer-pro#1018) — mirror commit
- fix(mcp): read current original retention metadata (layer-pro#1019) — mirror commit
- fix(mcp): expose search scope and qualified source links (layer-pro#1020) — mirror commit
- fix(mcp): retain semantic recall for short searches (layer-pro#1021) — mirror commit
- fix(infra): expire noncurrent S3 versions bucket-wide in the Layer prod bucket (layer-pro#1049) — mirror commit
Docs
- [docs] 0.8: MCP server, PDF extraction, cloud drives, GPU embedders (layer-pro#718) — mirror commit
- docs: diagnose missing BCC photos as SR-only selection (layer-pro#736) — mirror commit
- docs: record actual cloud-drive folder refresh diagnosis (layer-pro#740) — mirror commit
- docs: verify LYR-226 hosted kit acceptance after merge (layer-pro#764) — mirror commit
- docs(functions): record independent PR758 runtime acceptance (layer-pro#768) — mirror commit
- docs: record live BCC MCP endpoint acceptance and Desktop setup (layer-pro#774) — mirror commit
- docs: record LYR-217 stock CLIP live acceptance (layer-pro#749) — mirror commit
- docs: align v0.8 MCP documentation with implemented behavior (layer-pro#814) — mirror commit
- docs: add shipped MCP to v0.8.0 release highlights (layer-pro#815) — mirror commit
- docs: scanned-image runtime acceptance inventory, HEIC behavior (layer-pro#855) — mirror commit
- docs(functions): backfill needs a current CRD and operator; operator rollout runbook (LYR-312) (layer-pro#973) — mirror commit
- docs(runbooks): LYR-312 Story originals backfill UAT recipe (layer-pro#974) — mirror commit
- docs(runbooks): executable LYR-316 Mini UAT for backfill lookups (layer-pro#984) — mirror commit
- docs(runbooks): executable LYR-313 Mini UAT (layer-pro#986) — mirror commit
- docs(runbooks): final LYR-314 scan-only invocation for Mini (layer-pro#985) — mirror commit
- docs(runbooks): bind the LYR-313 UAT to Kitchen's agent-uat route (layer-pro#987) — mirror commit
- docs(runbooks): LYR-313 Kitchen binding uses Mini's mesh-916 profile and layer-factory key (layer-pro#988) — mirror commit
- docs(runbooks): LYR-316 scan stops derived from rows per document and cost (layer-pro#989) — mirror commit
- docs(runbooks): LYR-316 scan stop as a total group_queries ceiling (layer-pro#990) — mirror commit
- docs(runbooks): LYR-313 window on a retained completed traversal (layer-pro#991) — mirror commit
- docs(runbooks): LYR-316 scan bounds from observed cost and the old traversal's size; 100-document window (layer-pro#993) — mirror commit
- docs(runbooks): LYR-315 UAT setup uses Mini's mesh-916 AWS profile (layer-pro#994) — mirror commit
- docs(runbooks): LYR-313 report reads N reliably and reruns without a move (layer-pro#995) — mirror commit
- docs(runbooks): LYR-313 wrapper validates the exact deployed candidate (layer-pro#996) — mirror commit
- docs(runbooks): LYR-316 preflight grants the existing gateway key layer read (layer-pro#998) — mirror commit
- docs(runbooks): LYR-315 UAT r2 uses fresh scratch names; name-scoped cleanup (layer-pro#1001) — mirror commit
- docs(runbooks): LYR-315 UAT on the retained 25,000-row scratch-lyr315-uat namespace (layer-pro#1002) — mirror commit
- docs(runbooks): LYR-316 billing counters through the gateway pod sidecar; abort before unpause when unreadable (layer-pro#1003) — mirror commit
- docs(runbooks): LYR-316 window is 40 to 44 documents; verdict from the actual count (layer-pro#1005) — mirror commit
- docs(runbooks): LYR-316 2a0 label-only worker, Mini build/deploy; image swap restarts the traversal (layer-pro#1006) — mirror commit
- docs(site): Move group, no CRD pages, staging-only Pangram slop score (0.8 docs) (layer-pro#982) — mirror commit
- docs(runbooks): LYR-316 window is about 20 documents; pass is <= 2.2 GB/doc and 0 reads per lookup (layer-pro#1007) — mirror commit
- docs(runbooks): LYR-316 verdict on any settled N from 20 to 100; poll every 2 s (layer-pro#1008) — mirror commit
- docs: back Luxir out of the 0.8 docs (returns in 0.9) (layer-pro#1050) — mirror commit
- docs: SharePoint/OneDrive highlight in v0.8.0 notes; placeholder Graph IDs (layer-pro#1051) — mirror commit
- [docs] Release notes v0.8.0 (layer-pro#1053) — mirror commit
- docs: back CDC promotion out of v0.8.0 (layer-pro#1060) — mirror commit