Skip to content

AirLLM v3.3.0 — Qwen3.8-Flash-Next on 5.95GB

Choose a tag to compare

View all tags
@lyogavin lyogavin released this 28 Aug 02:11
· 20 commits to main since this release
v3.3.0
c92cea6
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Qwen3.8-Flash-Next (Qwen/Qwen3.8-Flash-Next) streams on a single card in 5.95GB VRAM (RTX 4090). The ~51B n-gram table is file-mapped on the host; decoder layers stream.

pip install -U airllm
pip install git+https://github.com/huggingface/transformers.git

Flash-Next needs in-tree qwen4_exp (GitHub transformers main today). A 64GB RAM machine is enough; plan ~360GB disk, or pass delete_original=True to reclaim the originals after the split.

Assets 2
Loading