MoE Cache Drafting

moe-cache-drafting retirement notice

Do not use the retired moe-cache-drafting branch. Build moe-cache instead.

Use:

git clone --branch moe-cache https://github.com/GenerelSchwerz/llama.cpp.git

moe-cache now carries target caching, grouped verification, separate-model drafting, integrated MTP, retained state, graph variants, overlap, and prefetch. Experimental features remain opt-in.

Use old commit links only for historical evidence. Use moe-cache at 925933801 or newer for current behavior.

MoE Cache overview - MoE Cache flags and setup - Grouped MoE drafting - Feature index