Skip to content
This repository was archived by the owner on Nov 23, 2024. It is now read-only.

Latest commit

 

History

89 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Glide - An LLM Routing Engine

Achieve 100% uptime for your Generative AI applications. Glide sits between your applications and your API endpoint. Pass your model preferences to the API endpoint and your call will be routed to the correct model based on model availability.

Supported Providers

Provider Support Status
OpenAI ✅ Supported
Azure OpenAI 🏗️ Coming Soon
Anthropic 🏗️ Coming Soon
Cohere ✅ Supported
Google Bard 🏗️ Coming Soon
LocalAI 🏗️ Coming Soon

Roadmap

  • REST API to set primary and secondary models based on LLM API status
  • Open an issue if there is a feature you'd like to see

About

A Rusty LLM Router

Topics

Resources

Stars

1 star

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages