Skip to content

Document ThinkingBox-Bench result aggregation - #14

Merged
Liang-Chun Tsai (ltsai-dev) merged 1 commit into
mainfrom
ltsai-microsoft-document-benchmark-aggregation
Aug 17, 2026
Merged

Document ThinkingBox-Bench result aggregation#14
Liang-Chun Tsai (ltsai-dev) merged 1 commit into
mainfrom
ltsai-microsoft-document-benchmark-aggregation

Conversation

@ltsai-dev

Copy link
Copy Markdown
Contributor

Summary

  • explain that b infer writes one JSON object per trial
  • document b agg aggregate metrics for equal-attempt result sets
  • clarify pass@20 and pass^20 semantics and omission conditions

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@ltsai-dev
Liang-Chun Tsai (ltsai-dev) merged commit f914797 into main Aug 17, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant