Skip to content

Comments

feat: extract variants and match to annotation type#12

Merged
shloknatarajan merged 28 commits intomainfrom
shlok/feat/benchmark
Jun 28, 2025
Merged

feat: extract variants and match to annotation type#12
shloknatarajan merged 28 commits intomainfrom
shlok/feat/benchmark

Conversation

@shloknatarajan
Copy link
Member

  • Basic functionality for extracting a list of variants (Not working incredible well/reliably but we could take a pass@k fuser approach
  • Basic functionality for matching each variant with an annotation type
  • Need to switch the evidence to quote + explanation format in the next PR

@shloknatarajan shloknatarajan merged commit 0756745 into main Jun 28, 2025
3 of 7 checks passed
@shloknatarajan shloknatarajan deleted the shlok/feat/benchmark branch July 2, 2025 15:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant