AI Chat: only load history since most recent clear event

[bencodeorg]

Instead of showing a user their entire history on a level, only include the history that will be included in the subsequent conversation history sent to the model.

This currently does not include the reset event itself in what the user sees. I'm a bit torn on this, but it seems sensible for the majority case at least (ie, the top-most message will likely be a message that a user sent that marks the beginning of the current conversation). Decided to include this, see discussion below.

Links

• Slack discussion

[fisher-alice]

I wonder if it would be useful for the user to see the clear chat notification to remind them that they took that user action, especially if they leave and then go back to the level.

[bencodeorg]

Yeah I was torn on this -- the clear chat event seems like it would be somewhat clear to users, but changing the model ID, temperature, etc also resets the conversation, which feels like it would be less clear to see at the top of the conversation? Checking in Slack here.

[fisher-alice]

Oh interesting - I didn't realize that we're clearing back to any event that clears the chat context.

I wonder if it would make sense to add a reminder within the model customization update:

code-dot-org/apps/i18n/aichat/en_us.json

Lines 82 to 83 in dfe8d1c

	"modelUpdateText": "{fieldLabel} has been updated to {updatedText}. {timestamp}",
	"modelUpdateText2": "{fieldLabel} has been updated. {timestamp}",

Maybe something like, 'Reminder that your chat history has been cleared.'?
cc: @dju90

[bencodeorg]

Updated to include the clear event, per Slack discussion.

I think there are a handful of changes/improvements that could be made now that we're showing history across page loads to users (I just jotted down a few, will share in Slack later). Maybe we could include this suggestion in that discussion?

[fisher-alice]

Looks good! Thanks for asking product about my question.