-
Notifications
You must be signed in to change notification settings - Fork 1.3k
docs: Added Amazon Nova provider documentation #1696
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
❌ Import check failedThis PR contains imports from Detailed issuesWhy this is a problemThe
How to fixReplace the imports as suggested above. For example:
🤖 Automated checkThis check is based on the latest analysis of |
Co-authored-by: Mason Daugherty <github@mdrxy.com>
ccurme
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Might be worth adding an entry to this page for discoverability (possibly re-naming it Amazon from AWS, I'm not very clear about the relation between the Amazon Nova and AWS).
Left some questions / nits that can be done in follow-up PRs if desired!
| | Model | [Tool calling](/oss/langchain/tools) | [Structured output](/oss/langchain/structured-output/) | JSON mode | Local | [Multimodal](/oss/langchain/messages#multimodal) | | ||
| |-|-|-|-|-|-| | ||
| | [`ChatAnthropic`](/oss/integrations/chat/anthropic) | ✅ | ✅ | ✅ | ❌ | ✅ | | ||
| | [`ChatAmazonNova`](/oss/integrations/chat/amazon_nova) | ✅ | ❌ | ❌ | ❌ | Model-dependent | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| | [`ChatAmazonNova`](/oss/integrations/chat/amazon_nova) | ✅ | ❌ | ❌ | ❌ | Model-dependent | | |
| | [`ChatAmazonNova`](/oss/integrations/chat/amazon_nova) | ✅ | ❌ | ❌ | ❌ | ✅ | |
(I think we tend to say it's supported if the chat model supports it generally)
| By default, @[`BaseChatModel.bind_tools`] validates that the model supports tool calling. To disable this validation: | ||
|
|
||
| ```python | ||
| model_with_tools = model.bind_tools([GetWeather], strict=False) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
From what I see in the implementation, strict is propagated as a kwarg, so it ends up in invocation params. Is it true that it validates model support for tool calling? If strict is False and the model does not support tool calling, do we get a different error than we otherwise would?
Typically strict in bind_tools engages schema adherence for tool calls (see docs here).
| | [`ChatGoogleGenerativeAI`](/oss/integrations/chat/google_generative_ai) | ✅ | ✅ | ✅ | ❌ | ✅ | | ||
| | [`ChatGroq`](/oss/integrations/chat/groq) | ✅ | ✅ | ✅ | ❌ | ❌ | | ||
| | [`ChatBedrock`](/oss/integrations/chat/bedrock) | ✅ | ✅ | ❌ | ❌ | ❌ | | ||
| | [`ChatAmazonNova`](/oss/integrations/chat/amazon_nova) | ✅ | ❌ | ❌ | ❌ | ✅ | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
structured output may be supported already with the base implementation if you support the tool_choice param, might be worth a try.
|
@ccurme -- Thanks for the inputs. Already working on v1.1.0 of the provider -- structured output mode is definitely on the table, I also need to clean up / modify some of the tool use functionality because it's a little different because of it's dependency on Bedrock. Will also likely have JS supported in due time. |
Overview
Documentation for Amazon Nova Provider
Type of change
Type: New Documentation Page
Checklist
docs devsrc/docs.jsonif needed(Internal team members only / optional): Create a preview deployment as necessary using the Create Preview Branch workflow
Additional notes
@ccurme -- thank you so much for your support.