-
Notifications
You must be signed in to change notification settings - Fork 2.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Process thinking blocks for Anthropic with Bedrock provider #4453
base: main
Are you sure you want to change the base?
Conversation
…seLLM` and `Anthropic` classes
…s2' into bedrock_reasoning_2
…update Bedrock to handle reasoning for Anthropic Claude models
✅ Deploy Preview for continuedev canceled.
|
@chezsmithy I created an issue for tool support: #4470, since you were working on it with bedrock, would you mind to check it? |
@sestinj Can you look into this? Until we don't have a shared implementation, this PR contains solution for extended thinking for both the Anthropic and Bedrock provider, and it's now working well with tools. |
…s2' into anthropic_process_thinking_blocks2
…thinking state and elapsed time
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@ferenci84 and @sestinj: I've reviewed this locally and tested it against Claude 3.7 with thinking enabled on AWS Bedrock and it is functioning as expected. Great work!
Description
This is a continuation of PR #4426 with implementation for Bedrock.
Replacement of PR #4444
Checklist
(No docs have been updated because I believe more has to be done before this feature becomes public)
Testing instructions
It can be tested the same way as the PR 4426 with the following config: