Skip to content

fix: add strict data grounding rules to prevent hallucination#4323

Merged
sauravpanda merged 2 commits into
mainfrom
fix-hallucination-ssies
Mar 11, 2026
Merged

fix: add strict data grounding rules to prevent hallucination#4323
sauravpanda merged 2 commits into
mainfrom
fix-hallucination-ssies

Conversation

@sauravpanda
Copy link
Copy Markdown
Collaborator

@sauravpanda sauravpanda commented Mar 11, 2026

Summary by cubic

Add strict data grounding rules across all agent prompts to block fabricated data and reduce hallucinations. Prompts now only report values seen in tool outputs or browser state, and must say “not found” when data isn’t extracted.

  • Bug Fixes
    • Added DATA GROUNDING to core, Anthropic/Flash, and no-thinking prompts, plus output blocks; forbids fabricated URLs, prices, values (including “representative” ones).
    • Replaced pre-done verification with a grounding check: every URL/price/name/value must appear verbatim in tool outputs or browser_state; never construct URLs; if missing, say “not found”.
    • Added a critical reminder across prompts: never fabricate URLs, image links, prices, or any data; prefer partial results with success=false when uncertain.
    • Inserted a grounding note into all system_prompt_browser_use* and system_prompt_flash* output sections.

Written for commit 3479041. Summary will update on new commits.

Copy link
Copy Markdown
Contributor

@cubic-dev-ai cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 8 files

@github-actions
Copy link
Copy Markdown

Agent Task Evaluation Results: 2/2 (100%)

View detailed results
Task Result Reason
amazon_laptop ✅ Pass Skipped - API key not available (fork PR or missing secret)
browser_use_pip ✅ Pass Skipped - API key not available (fork PR or missing secret)

Check the evaluate-tasks job for detailed task execution logs.

@sauravpanda sauravpanda merged commit 83c9d63 into main Mar 11, 2026
79 checks passed
@sauravpanda sauravpanda deleted the fix-hallucination-ssies branch March 11, 2026 03:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant