Skip to content

Implement parsed storage result layout#115

Merged
suguanYang merged 1 commit into
mainfrom
sdk/wangbinqi/parsed-storage-result-layout
Jul 7, 2026
Merged

Implement parsed storage result layout#115
suguanYang merged 1 commit into
mainfrom
sdk/wangbinqi/parsed-storage-result-layout

Conversation

@suguanYang

Copy link
Copy Markdown
Contributor

Summary

  • Store parsed documents in storage using the expanded Knowhere result layout (manifest.json, chunks.json, doc_nav.json, sidecars/assets) instead of SDK-specific paged snapshots.
  • Replace the public ParsedDocumentStorage adapter surface with result-relative object operations (readObject, writeObject, optional headObject, getObjectUrl, deletePrefix) while keeping SDK-owned sync progress methods.
  • Add commit-marker based read validation, remote read-miss background sync, result ZIP sync, and fallback reconstruction from complete remote chunk pages.
  • Update disk parsed storage, SDK docs, tests, and add a changeset for the breaking adapter-interface change.

Verification

  • pnpm exec tsc --noEmit --pretty false
  • pnpm test -- --run
  • pnpm lint (passed with three pre-existing unrelated warnings in client/http-client tests)
  • pnpm build
  • git diff --check

Checklist

  • Tests were added or updated when behavior changed
  • Public docs or examples were updated when needed
  • A changeset was added when a release should be published

@suguanYang suguanYang force-pushed the sdk/wangbinqi/parsed-storage-result-layout branch 5 times, most recently from 4bd138d to 54ebea7 Compare July 7, 2026 14:58
@suguanYang suguanYang force-pushed the sdk/wangbinqi/parsed-storage-result-layout branch from 54ebea7 to 8b7ccca Compare July 7, 2026 15:28
@suguanYang suguanYang merged commit d5563c4 into main Jul 7, 2026
4 checks passed
@github-actions github-actions Bot mentioned this pull request Jul 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant