Truss is the simplest way to serve AI/ML models in production.
To get you started with Truss, this repository has dozens of example models, each ready to deploy as-is or adapt to your needs.
Get the repository with:
git clone https://github.com/basetenlabs/truss-examples
Install Truss with:
pip install --upgrade truss
Pick a model to deploy by passing a path to that model.
$ # From the truss-examples directory
$ truss push 02-llmThis will prompt you for an API Key -- fetch one from the Baseten API keys page.
Invocation depends on the model's input and output specifications. See individual model READMEs for invocation details.
We welcome contributions of new models and improvements to existing models. See CONTRIBUTING.md for details.