Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
28 changes: 13 additions & 15 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,31 +1,29 @@
<div align="center">
<p align="center">
<img src="docs/images/parallax.jpg" width="720">
<img src="docs/images/parallax.png" width="720">
</p>
</div>

# Parallax
A fully decentralized inference engine developed by [Gradient](https://gradient.network). Parallax lets you build your own AI cluster for model inference onto a set of distributed nodes despite their varying configuration and physical location.
<!-- <h3> -->

| [**Gradient**](https://gradient.network)
| [**Blog**](https://gradient.network/blog/parallax-world-inference-engine)
| [**X(Twitter)**](https://x.com/Gradient_HQ)
| [**Discord**](https://discord.gg/gradientnetwork)
| [**Arxiv**](https://arxiv.org/pdf/2509.26182v1)

πŸ”₯ **NEW: Parallax version 0.0.1 has been released!**
## News
- [2025/10] πŸ”₯ Parallax version 0.0.01 has been released!

## About
A fully decentralized inference engine developed by [Gradient](https://gradient.network). Parallax lets you build your own AI cluster for model inference onto a set of distributed nodes despite their varying configuration and physical location. Its core features include:

<!-- </h3> -->
- **Host local LLM on personal devices**
- **Cross-platform support**
- **Pipeline parallel model sharding**
- **Dynamic KV cache management & continuous batching for Mac**
- **Dynamic request scheduling and routing for high performance**

## Features
* Run LLM at home with personal devices.
* Cross-platform support.
* Pipeline parallel model sharding.
* Dynamic KV cache management + continuous batching for MAC.
* Dynamic request scheduling and routing for high performance.
The backend architecture:

## Backend Architecture
* P2P communication powered by [Lattica](https://github.com/GradientHQ/lattica)
* GPU backend powered by [SGLang](https://github.com/sgl-project/sglang)
* MAC backend powered by [MLX LM](https://github.com/ml-explore/mlx-lm)
Expand Down Expand Up @@ -116,7 +114,7 @@ docker run -it --gpus all --network host gradientservice/parallax:latest-hopper
```
The container starts under parallax workspace and you should be able to run parallax directly.

## Getting started
## Getting Started

We will walk through you the easiest way to quickly set up your own AI cluster

Expand Down
Binary file removed docs/images/parallax.jpg
Binary file not shown.
Binary file added docs/images/parallax.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.