Skip to content

Fix LongBench-v2#161

Merged
SimJeg merged 4 commits intomainfrom
simon/update-longbench-v2
Nov 21, 2025
Merged

Fix LongBench-v2#161
SimJeg merged 4 commits intomainfrom
simon/update-longbench-v2

Conversation

@SimJeg
Copy link
Copy Markdown
Collaborator

@SimJeg SimJeg commented Nov 21, 2025

In the current preprocessed LongBench-v2 dataset, the end of the question Format your response as follows: "The correct answer is (insert answer here). is used as an answer prefix which is incorrect.

I fixed this issue and greatly simplified the code, both for dataset creation and evaluation

Signed-off-by: SimJeg <sjegou@nvidia.com>
Signed-off-by: SimJeg <sjegou@nvidia.com>
Signed-off-by: SimJeg <sjegou@nvidia.com>
@copy-pr-bot
Copy link
Copy Markdown

copy-pr-bot Bot commented Nov 21, 2025

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

Signed-off-by: SimJeg <sjegou@nvidia.com>
@SimJeg SimJeg merged commit dd45c79 into main Nov 21, 2025
2 checks passed
@SimJeg SimJeg deleted the simon/update-longbench-v2 branch November 21, 2025 19:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants