anhlbt / truss-examples

Examples of models deployable with Truss

Truss Examples

Truss is the simplest way to serve AI/ML models in production.

To get you started with Truss, this repository has dozens of example models, each ready to deploy as-is or adapt to your needs.

Installation

Get the repository with:

git clone https://github.com/basetenlabs/truss-examples

Install Truss with:

pip install --upgrade truss

Deployment

Pick a model to deploy by passing a path to that model.

$ # From the truss-examples directory
$ truss push 02-llm

This will prompt you for an API Key -- fetch one from the Baseten API keys page.

Invocation

Invocation depends on the model's input and output specifications. See individual model READMEs for invocation details.

Contibuting

We welcome contributions of new models and improvements to existing models. See CONTRIBUTING.md for details.