Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request takes a long time for sessions with large chat history #355

Closed
alvinho917 opened this issue Aug 19, 2024 · 2 comments
Closed

Request takes a long time for sessions with large chat history #355

alvinho917 opened this issue Aug 19, 2024 · 2 comments

Comments

@alvinho917
Copy link

I am using Zep Memory - Open Source in Flowise as the long-term memory system and hosting Zep on my server. The Message Window is set to be 6. Recently, a player with a long chat history session (~9000 messages) experience that requesting a message takes a long time (>30 seconds). I tried sending a request with a brand new session (0 message) and the response time is almost instant. So I want to ask:

  • Does the Summarizer read every messages in the session every time it summarize?
  • If so, is there a way to configure Zep so that only the recent messages within the Message Window and the last summarize message are summarized?
@danielchalef
Copy link
Member

The summarizer runs asynchronously to the memory request API. Your Postgres database infrastructure may need to be resized, and/or some indexes added to the database schema. Where are you running your database? And how have you sized it? i.e. cpu, memory, disk.

@alvinho917
Copy link
Author

I resized the database and the problem is fixed. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants