Skip to content

huggingface/text-generation-inference

Error
Looks like something went wrong!

About

Large Language Model Text Generation Inference

hf.co/docs/text-generation-inference

Topics

nlp bloom deep-learning inference pytorch falcon transformer gpt starcoder

Resources

Readme

License

Apache-2.0 license

Code of conduct

Code of conduct
Activity
Custom properties

Stars

10.2k stars

Watchers

103 watching

Forks

1.2k forks
Report repository

Releases 62

v3.3.2 Latest
May 30, 2025
+ 61 releases

Packages

 
 
 

Contributors 164

+ 150 contributors

Languages