Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added llama2-13b-chat-v1 on bedrock #13322

Closed

Conversation

sungeuns
Copy link

Please make sure your PR is passing linting and testing before submitting. Run make format, make lint and make test to check this locally.

See contribution guidelines for more information on how to write/run tests, lint, etc:
https://github.com/langchain-ai/langchain/blob/master/.github/CONTRIBUTING.md

If you're adding a new integration, please include:

  1. a test for the integration, preferably unit tests that do not rely on network access,
  2. an example notebook showing its use. It lives in docs/extras directory.

If no one reviews your PR within a few days, please @-mention one of @baskaryan, @eyurtsev, @hwchase17.

Copy link

vercel bot commented Nov 14, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
langchain ⬜️ Ignored (Inspect) Visit Preview Nov 14, 2023 3:21am

@dosubot dosubot bot added Ɑ: models Related to LLMs or chat model modules 🤖:enhancement A large net-new component, integration, or chain. Use sparingly. The largest features labels Nov 14, 2023
@jonathancaevans
Copy link
Contributor

Looks like you beat me to it, exactly the same changes I'd staged! Looks good to me +1! @3coins @hwchase17

@diegogsoares
Copy link

+1

Copy link
Contributor

@3coins 3coins left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@sungeuns
Thanks for adding Llama2 support. LGTM! 🚀

@prakass1
Copy link

prakass1 commented Nov 14, 2023

This was fast, I did the exact changes :) looks good

@WouterDurnez
Copy link
Contributor

WouterDurnez commented Nov 15, 2023

Open question: shouldn't this technically (also) be in BedrockChat, since it's a chat model? https://github.com/langchain-ai/langchain/blob/master/libs/langchain/langchain/chat_models/bedrock.py

Update: Added a PR to do this ourselves (@bockaerts)

@prakass1
Copy link

Open question: shouldn't this technically (also) be in BedrockChat, since it's a chat model? https://github.com/langchain-ai/langchain/blob/master/libs/langchain/langchain/chat_models/bedrock.py

Yes it should be

@marcio-ch
Copy link

Hi there, when can we get a new release with this change? I have been using a manually updated version of langchain for that, will feel more comfortable when we get the official update. Thanks!

@3coins
Copy link
Contributor

3coins commented Nov 17, 2023

@baskaryan
Can you help with merging this.

@@ -80,7 +81,7 @@ def prepare_input(
input_body = {**model_kwargs}
if provider == "anthropic":
input_body["prompt"] = _human_assistant_format(prompt)
elif provider == "ai21" or provider == "cohere":
elif provider == "ai21" or provider == "cohere" or provider == "meta":
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggesting a minor update to simplify the check. Accepting this should also kick in the CI.

Suggested change
elif provider == "ai21" or provider == "cohere" or provider == "meta":
elif provider in ["ai21", "cohere", "meta"]:

baskaryan pushed a commit that referenced this pull request Nov 20, 2023
Hi 👋 We are working with Llama2 on Bedrock, and would like to add it to
Langchain. We saw a [pull
request](#13322) to add it
to the `llm.Bedrock` class, but since it concerns a chat model, we would
like to add it to `BedrockChat` as well.

- **Description:** Add support for Llama2 to `BedrockChat` in
`chat_models`
- **Issue:** the issue # it fixes (if applicable)
[#13316](#13316)
  - **Dependencies:** any dependencies required for this change `None`
  - **Tag maintainer:** /
  - **Twitter handle:** `@SimonBockaert @WouterDurnez`

---------

Co-authored-by: wouter.durnez <wouter.durnez@showpad.com>
Co-authored-by: Simon Bockaert <simon.bockaert@showpad.com>
pprados pushed a commit to pprados/langchain that referenced this pull request Nov 20, 2023
…n-ai#13403)

Hi 👋 We are working with Llama2 on Bedrock, and would like to add it to
Langchain. We saw a [pull
request](langchain-ai#13322) to add it
to the `llm.Bedrock` class, but since it concerns a chat model, we would
like to add it to `BedrockChat` as well.

- **Description:** Add support for Llama2 to `BedrockChat` in
`chat_models`
- **Issue:** the issue # it fixes (if applicable)
[langchain-ai#13316](langchain-ai#13316)
  - **Dependencies:** any dependencies required for this change `None`
  - **Tag maintainer:** /
  - **Twitter handle:** `@SimonBockaert @WouterDurnez`

---------

Co-authored-by: wouter.durnez <wouter.durnez@showpad.com>
Co-authored-by: Simon Bockaert <simon.bockaert@showpad.com>
amiaxys pushed a commit to Haoming-jpg/team-skill-issue-langchain that referenced this pull request Nov 23, 2023
…n-ai#13403)

Hi 👋 We are working with Llama2 on Bedrock, and would like to add it to
Langchain. We saw a [pull
request](langchain-ai#13322) to add it
to the `llm.Bedrock` class, but since it concerns a chat model, we would
like to add it to `BedrockChat` as well.

- **Description:** Add support for Llama2 to `BedrockChat` in
`chat_models`
- **Issue:** the issue # it fixes (if applicable)
[langchain-ai#13316](langchain-ai#13316)
  - **Dependencies:** any dependencies required for this change `None`
  - **Tag maintainer:** /
  - **Twitter handle:** `@SimonBockaert @WouterDurnez`

---------

Co-authored-by: wouter.durnez <wouter.durnez@showpad.com>
Co-authored-by: Simon Bockaert <simon.bockaert@showpad.com>
@baskaryan
Copy link
Collaborator

believe all functionality was covered in #13403 so closing this pr, let me know if i'm missing something!

@baskaryan baskaryan closed this Nov 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🤖:enhancement A large net-new component, integration, or chain. Use sparingly. The largest features Ɑ: models Related to LLMs or chat model modules
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

8 participants