Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates made to ingested files are not reflected in the chat message responses . #33

Closed
sangee2004 opened this issue Jun 20, 2024 · 0 comments · Fixed by #58
Closed
Labels
bug Something isn't working
Milestone

Comments

@sangee2004
Copy link

Steps to reproduce the problem:

  1. Create a file - names.txt under knowledge with following content
    My pets name is foo

  2. Run the following script to launch knowledge chat agent using workspace that has k8s documentation - gptscript --workspace ./knowledge knowledge_remote.gpt

tools: github.com/gptscript-ai/knowledge
context: github.com/gptscript-ai/context/workspace
chat: true

You are a helpful assistant that can retrieve information and answer questions using your tools. When you strat just introduce yourself and wait for the user to prompt you. 
You must use the knowledge tool to look up answers to your questions. Do NOT use the read tool. You may only answer questions with information you retrieve from the knowledge tool.
When you give answers, always give a proper citation to the best of your abilities.
  1. Ask for "my pets name" and you get the right answer.
  2. Modify names.txt to My pets name is bar
  3. In the same chat session, ask again for "my pets name".
    Sometimes you will get the right answer which is bar and sometime you will get the answer as foo.

Sometimes we get this answer:

It seems there are two entries for your pet's name: Foo and Bar.
Could you please confirm which one is correct, or if you have multiple pets?

Knowledge tool actually returns the old and new information in this case:

Retrieved the following 2 sources for the query "pet's name" from path "/Users/sangeethahariharan/gptscript/knowledge": [{"content":"My pets name is bar\n","metadata":{"filename":"names.txt"},"similarity_score":0.8726927},{"content":"My pets name is foo\n","metadata":{"filename":"names.txt"},"similarity_score":0.863201}]

Expected Behavior:
Only the updated contents should be made available .

@sangee2004 sangee2004 added the bug Something isn't working label Jun 20, 2024
@sangee2004 sangee2004 changed the title Updates made to existing ingested files are not reflected in the chat message responses . Updates made to ingested files are not reflected in the chat message responses . Jun 20, 2024
@iwilltry42 iwilltry42 added this to the v0.4.3 milestone Aug 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants