Skip to content

Added pairwise evaluation for the dimension - Breadth [#34]#39

Merged
HamedBabaei merged 11 commits into
devfrom
feature/integrate-llm-as-judge-rubrics
Apr 20, 2026
Merged

Added pairwise evaluation for the dimension - Breadth [#34]#39
HamedBabaei merged 11 commits into
devfrom
feature/integrate-llm-as-judge-rubrics

Conversation

@MikeACedric
Copy link
Copy Markdown
Collaborator

This PR references the issue [#34], and it includes the following changes:

Changes:

  • Prompts – Integrated pairwise prompt templates for the deep research dimension: Breadth that includes the rubrics Context Coverage, Scale Coverage, Method Coverage, Dimension Coverage, Scope Coverage.

  • Examples – Introduced NLP & Ecology-specific pairwise examples for each rubric.

  • Documentation – Added the pairwise evaluation information for the dimension: Breadth.

@MikeACedric MikeACedric requested a review from HamedBabaei April 14, 2026 14:18
@MikeACedric MikeACedric self-assigned this Apr 14, 2026
Comment thread README.md Outdated
Copy link
Copy Markdown
Member

@HamedBabaei HamedBabaei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @MikeACedric , i have added only two comments, one is the major, and another is the minimum! Please let me know if you have any questions.

Comment thread docs/source/rubrics.rst Outdated
Copy link
Copy Markdown
Member

@HamedBabaei HamedBabaei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@MikeACedric Everything seems to be ok. Please keep an eye on the rubric documentation page. The page should be crystal clear to anyone who visits it. The user should immediately know that there are two categories of rubrics, what is in each category, and how to use them.

@HamedBabaei HamedBabaei merged commit 2d31a3f into dev Apr 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants