Skip to content
Discussion options

You must be logged in to vote

A few things are working against you here, and the 9B model is only part of it.

1. Hindsight doesn't know the assistant is the bank. In the extraction prompt, "experience" facts are what it calls assistant facts: things the agent whose memory this is actually did, recommended, decided or answered, ideally first person ("I suggested X"). Retain no longer passes a narrator or the bank name into the extraction prompt (it was removed because bank names were leaking into stored facts). So the only way the model learns that role: "assistant" means "me" is your context. With "Conversation between user and [bank name]", a small model just sees two third parties, which is how you end up with world…

Replies: 3 comments 7 replies

Comment options

You must be logged in to vote
1 reply
@jenks6797
Comment options

Answer selected by jenks6797
Comment options

You must be logged in to vote
1 reply
@jenks6797
Comment options

Comment options

You must be logged in to vote
5 replies
@harshitgupta31415
Comment options

@jenks6797
Comment options

@harshitgupta31415
Comment options

@jenks6797
Comment options

@harshitgupta31415
Comment options

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
3 participants