Skip to content

awslabs/llm-hosting-container

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

48 Commits

.github/workflows

.github/workflows

 
 

docs/huggingface

docs/huggingface

 
 

examples/huggingface

examples/huggingface

 
 

huggingface/pytorch

huggingface/pytorch

 
 

tests/huggingface

tests/huggingface

 
 

.gitignore

.gitignore

 
 

CODEOWNERS

CODEOWNERS

 
 

CODE_OF_CONDUCT.md

CODE_OF_CONDUCT.md

 
 

CONTRIBUTING.md

CONTRIBUTING.md

 
 

LICENSE

LICENSE

 
 

NOTICE

NOTICE

 
 

README.md

README.md

 
 

releases.json

releases.json

 
 

Repository files navigation

LLM Hosting Container

Welcome to the LLM Hosting Container GitHub repository!

This repository contains Dockerfile and associated resources for building and hosting containers for large language models.

  • HuggingFace Text Generation Inference (TGI) container

Security

See CONTRIBUTING for more information.

License

This project is licensed under the Apache-2.0 License.

About

Large Language Model Hosting Container

Resources

Readme

License

Apache-2.0 license

Code of conduct

Code of conduct

Security policy

Security policy
Activity
Custom properties

Stars

71 stars

Watchers

6 watching

Forks

22 forks
Report repository

Releases

No releases published

Packages

No packages published

Contributors 13

Languages