imrpovement(kb): added client-side store, shared utils, background processing, retry with exponential backoff to knowledge base#453
Merged
waleedlatif1 merged 7 commits intomainfrom Jun 3, 2025
Merged
Conversation
…retry with exponential backoff, individual file retry, statuses
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
1 Skipped Deployment
|
![greptile-apps[bot]](https://avatars.githubusercontent.com/in/867647?s=60&v=4){kind=small}
Contributor
There was a problem hiding this comment.
PR Summary
This PR introduces a comprehensive knowledge base system with background document processing, vector search capabilities, and improved state management. The changes span across multiple areas including API endpoints, database schema, UI components, and utilities.
- Added robust document processing with background tasks, status tracking, and retry mechanisms using exponential backoff for handling rate limits and transient failures
- Implemented centralized client-side state management using Zustand store with optimistic updates and proper caching
- Created new database schema for knowledge bases with vector search capabilities using HNSW indexing and metadata tracking
- Added user-friendly UI components including KnowledgeBaseSelector and EditChunkModal with proper error handling and loading states
- Improved file upload handling with S3 integration, proper filename encoding, and background processing
37 file(s) reviewed, 48 comment(s)
Edit PR Review Bot Settings | Greptile
arenadeveloper02
pushed a commit
to arenadeveloper02/p2-sim
that referenced
this pull request
Sep 19, 2025
…ocessing, retry with exponential backoff to knowledge base (simstudioai#453) * added background processing for file upload to knowledge base, added retry with exponential backoff, individual file retry, statuses * added knowledge store * added knowledge base selector and docs for knowledge block * fixed build * fix contributors page * significantly improved error handling, typing, fault tolerance * standardize file icon size
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Added client-side store, shared utils, background processing, retry with exponential backoff to knowledge base
Type of change
How Has This Been Tested?
Tested uploading multiple, confirmed the loading state is synced between frontend and store, confirmed exponential backoff works & background processing
Checklist:
bun run test)Security Considerations: