Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Sagemaker Batch Endpoints #3249

Merged
merged 4 commits into from Apr 22, 2023
Merged

Fix Sagemaker Batch Endpoints #3249

merged 4 commits into from Apr 22, 2023

Conversation

vowelparrot
Copy link
Contributor

Add different typing for @evandiewald 's heplful PR


from pydantic import Extra, root_validator

from langchain.llms.base import LLM
from langchain.llms.utils import enforce_stop_tokens

INPUT_TYPE = TypeVar("INPUT_TYPE", bound=Union[str, List[str]])
OUTPUT_TYPE = TypeVar("OUTPUT_TYPE", bound=Union[str, List[List[float]]])
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

shouldn't these be used in ContentHandlerBase? prompt: INPUT_TYPE, -> OUTPUT_TYPE

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes indeed - seems to have been a tragedy of the merge

@hwchase17 hwchase17 merged commit 61d40ba into master Apr 22, 2023
9 checks passed
@hwchase17 hwchase17 deleted the vwp/sagemaker-endpoints-fix branch April 22, 2023 15:49
vowelparrot added a commit that referenced this pull request Apr 26, 2023
Add different typing for @evandiewald 's heplful PR

---------

Co-authored-by: Evan Diewald <evandiewald@gmail.com>
vowelparrot added a commit that referenced this pull request Apr 28, 2023
Add different typing for @evandiewald 's heplful PR

---------

Co-authored-by: Evan Diewald <evandiewald@gmail.com>
samching pushed a commit to samching/langchain that referenced this pull request May 1, 2023
Add different typing for @evandiewald 's heplful PR

---------

Co-authored-by: Evan Diewald <evandiewald@gmail.com>
yanghua pushed a commit to yanghua/langchain that referenced this pull request May 9, 2023
Add different typing for @evandiewald 's heplful PR

---------

Co-authored-by: Evan Diewald <evandiewald@gmail.com>
dev2049 pushed a commit that referenced this pull request May 17, 2023
# Fix SageMaker example typing

Since #3249 a new type
`LLMContentHandler` is enforced for SageMaker Endpoints

Fixes #4168
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants