Skip to content

feat(benchmarks): add SURDS - #1670

Merged
Yunnglin merged 3 commits into
mainfrom
feat/surds-eval
Aug 28, 2026
Merged

feat(benchmarks): add SURDS#1670
Yunnglin merged 3 commits into
mainfrom
feat/surds-eval

Conversation

@Yunnglin

@Yunnglin Yunnglin commented Aug 28, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • add official SURDS VQA generation for six spatial tasks
  • implement normalized exact-match, pixel centerness, and complementary-prompt aggregation
  • add bilingual docs, metadata, and regression tests

Validation

  • make lint
  • pytest tests/benchmark/test_surds.py -q
  • SURDS mock end-to-end test
  • CI lite smoke test

Copilot AI lite review requested due to automatic review settings August 28, 2026 06:55
Copilot AI reviewed Aug 28, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@Yunnglin
Yunnglin merged commit aea1b5a into main Aug 28, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot
Copilot review effort, defaults to Lite
Applies to this pull request for everyone.Learn more about Copilot code review.
Copilot left review comments

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Yunnglin