Skip to content

Latest commit

 

History

History
37 lines (21 loc) · 1.09 KB

index.mdx

File metadata and controls

37 lines (21 loc) · 1.09 KB
Raw

Introduction

This Python library is the easist way to begin building on top of Apple's machine learning library, MLX.

Quick Example:

Python

from mlxserver import MLXServer

server = MLXServer(model="mlx-community/Nous-Hermes-2-Mistral-7B-DPO-4bit-MLX")

Curl

curl -X GET 'http://127.0.0.1:5000/generate?prompt=write%20me%20a%20poem%20about%the%20ocean&stream=true'

Get Started

Goals

This library's goal is to make it as easy as possible to build ML applications on top of the MLX library. The lower the barrier to entry for building in ML, the more great applications will be built.

Why MLX?

Picture of a cheetah

Because it's the fastest on Apple Silicon and it's going to be the best maintained for a while.

Credits & contributions

This library was created by Mustafa Aljadery and Siddharth Sharma.

If you would like to contribute to this library please visit the GitHub Repo.