We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Sagemaker Endpoints have the option of adding multiple models in a single endpoint.
Here is the resource they provide: https://docs.aws.amazon.com/sagemaker/latest/dg/multi-model-endpoints.html
This will enable users to deploy multiple LLM models (for example Llama2 7B and Llama3 8B) in a single endpoint.
Happy to help anyway I can.
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Feature request
Sagemaker Endpoints have the option of adding multiple models in a single endpoint.
Here is the resource they provide: https://docs.aws.amazon.com/sagemaker/latest/dg/multi-model-endpoints.html
Motivation
This will enable users to deploy multiple LLM models (for example Llama2 7B and Llama3 8B) in a single endpoint.
Your contribution
Happy to help anyway I can.
The text was updated successfully, but these errors were encountered: