Repository navigation
v0.3.2
Summary
Patch release: latest llama.cpp submodule, EAGLE-3 speculative decoding, multimodal video input for mtmd, and fixes for the reworked upstream mtmd helper API.
Changed
- llama.cpp: vendored submodule
94a220cd6→c57607016(#256). The publicllama.hC API is unchanged; themtmdhelper API was reworked (see Fixed).
Added
- EAGLE-3 speculative decoding (
llama-cpp-4): neweagle::Eagle3Sessiondriving upstreamCOMMON_SPECULATIVE_TYPE_DRAFT_EAGLE3. Pairs a target context with a separate EAGLE-3 draft-model context. Themtp_shimis generalised with aspec_typeselector shared by MTP and EAGLE-3 (MtpSessionunchanged). Verified end-to-end on Apple M4 Pro (Metal) with Qwen3-8B +RedHatAI/Qwen3-8B-speculator.eagle3at ~53% draft acceptance. - mtmd video input (
mtmdfeature):mtmd::MtmdVideo(+MtmdVideoParams,MtmdVideoInfo,MtmdVideoItem) wrapping the newmtmd_helper_video_*API for frame-by-frame decoding via ffmpeg, plusMtmdContext::supports_video()andMtmdContext::marker(). examples/eagle(+ README) withscripts/setup-eagle3.sh/scripts/fetch-eagle3.shto download + convert a target/draft pairing to GGUF.
Fixed
- mtmd bindings: adapt to the reworked helper API —
mtmd_helper_bitmap_init_from_file/_from_bufnow take aplaceholderflag and return amtmd_helper_bitmap_wrapper;mtmd_helper_decode_image_chunktakes a post-decode callback.MtmdBitmap::from_file/from_bufno longer leak thevideo_ctxreturned for video inputs.
Crates: llama-cpp-4 0.3.2 · llama-cpp-sys-4 0.3.2