Skip to content

Conversation

jamesbraza
Copy link
Collaborator

During normal PaperQAEnvironment.step, we call tools using exec_tool_calls(..., handle_tool_exc=True). This means we don't crash on tool failures.

During the rollout's truncation's failover gen_answer invocation, we didn't have the same handle_tool_exc=True protection in place, so we could crash. This PR just moves the failover gen_answer invocation to use exec_tool_calls for the same safety.

@jamesbraza jamesbraza added the bug Something isn't working label Jan 10, 2025
@jamesbraza jamesbraza requested a review from a team January 10, 2025 22:18
@jamesbraza jamesbraza self-assigned this Jan 10, 2025
@dosubot dosubot bot added the size:XS This PR changes 0-9 lines, ignoring generated files. label Jan 10, 2025
Copy link
Collaborator

@mskarlin mskarlin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice catch!

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Jan 10, 2025
@jamesbraza jamesbraza merged commit af2871e into main Jan 10, 2025
5 checks passed
@jamesbraza jamesbraza deleted the handling-failover-answer branch January 10, 2025 22:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working lgtm This PR has been approved by a maintainer size:XS This PR changes 0-9 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants