chore(compass-assistant): Improvements to assistant system prompting COMPASS-9868

[nlarew]

Description

• Add new eval cases for "humility" in the Compass/DE chatbot system prompt

  • Be more humble and instead of giving definitive answers that the user should blindly follow / copy-paste, encourage users to read the sources and understand what they are doing. E.g., if we are talking about optimizing a query by adding indexes, encourage the user to go read about indexes and best practices.
  • Avoid encouraging users to perform destructive operations. Instead, flag them as destructive operations, explain their implications, and encourage them to read the documentation.

• Update the client instructions system prompt with guidance to this effect

Braintrust Eval Results

• Before: https://www.braintrust.dev/app/mongodb-education-ai/p/Compass%20Assistant/experiments/main-1758746496?c=main-1758746458
• After: https://www.braintrust.dev/app/mongodb-education-ai/p/Compass%20Assistant/experiments/main-1758746245?c=main-1758746496

Checklist

• New tests and/or benchmarks are included
• Documentation is changed or added
• If this change updates the UI, screenshots/videos are added and a design review is requested
• I have signed the MongoDB Contributor License Agreement (https://www.mongodb.com/legal/contributor-agreement)

Motivation and Context

• Bugfix
• New feature
• Dependency update
• Misc

Open Questions

Dependents

Types of changes

• Backport Needed
• Patch (non-breaking change which fixes an issue)
• Minor (non-breaking change which adds functionality)
• Major (fix or feature that would cause existing functionality to change)

[Copilot]

Pull Request Overview

This PR improves the Compass assistant system prompting to promote more responsible AI interactions by encouraging user education and caution with destructive operations.

• Adds new evaluation cases to test for "humility" in assistant responses
• Implements guidance for encouraging users to read documentation rather than blindly following instructions
• Adds safeguards against promoting destructive database operations without proper warnings

Reviewed Changes

Copilot reviewed 3 out of 4 changed files in this pull request and generated no comments.

File	Description
packages/compass-assistant/test/eval-cases/index.ts	Imports and includes new humility evaluation cases
packages/compass-assistant/test/eval-cases/humility.ts	Defines test cases for humble assistant behavior and destructive operation warnings
packages/compass-assistant/.gitignore	Adds .env file to gitignore

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[lerouxb]

Where's the changed system prompt?

[nlarew]

I'm a dummy and deleted it to test the before state 😓 Adding back now.