The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!
-
Updated
Aug 6, 2024 - Python
The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!
Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more
Add a description, image, and links to the model-inference-service topic page so that developers can more easily learn about it.
To associate your repository with the model-inference-service topic, visit your repo's landing page and select "manage topics."