Skip to content
#

openai-compatible

Here are 18 public repositories matching this topic...

A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.

  • Updated Jul 12, 2025
  • Python

All-in-one local AI stack for Mistral-13B and Llama.cpp, with one-step CUDA wheel install, OpenAI-compatible API, and modern web dashboard. Switch between local and cloud chat, run on your own GPU, and deploy instantly—no API keys or paywalls. Designed for easy install, custom builds, and fast remote access. Enjoy!

  • Updated Jul 12, 2025
  • Python

Improve this page

Add a description, image, and links to the openai-compatible topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the openai-compatible topic, visit your repo's landing page and select "manage topics."

Learn more