v0.6.14

What's Changed

• Fix multimodal server prefill alignment by @Blaizzy in #1872
• Load pre-converted MLX Inkling checkpoints by @Lazarus-931 in #1880
• Skip conv transposes for pre-converted SAM 3.1 checkpoints (#1871) by @Lazarus-931 in #1877
• Add text and multimodal reranking endpoint by @Lazarus-931 in #1853
• Keep pending padding metadata aligned after filtering by @byoan in #1890
• Add PLaMo 2.1 VL support by @mitmul in #949
• Fix Idefics3/SmolVLM LoRA training crashes (#1830) by @Lazarus-931 in #1852
• Allow CacheList extraction with plain KVCache children by @byoan in #1870
• Add Nemotron-VoiceChat-11B full-duplex speech model by @lucasnewman in #1817
• Porting twenty four MLX-LM models by @Lazarus-931 in #1891
• Add native sequence classifier rerankers by @Lazarus-931 in #1893
• Add Nemotron-Parse (C-RADIO encoder + mBART decoder) model support by @axiom-of-choice in #1866
• Fix thinking_budget silently ignored for self-opening thinking models by @Lazarus-931 in #1912
• Fix SmolVLM inference with flattened image features by @Lazarus-931 in #1905
• Stop a short first prompt from disabling prefix caching by @Lazarus-931 in #1901
• Load text-only checkpoints of vision-language models by @Lazarus-931 in #1879
• Support per-generator prefill step size overrides by @byoan in #1895
• Fix zero-length rotating cache merge by @Lazarus-931 in #1916
• Add GOT-OCR 2.0 model support by @axiom-of-choice in #1908
• lfm2_vl: implement official image splitting (tiling) by @ivanfioravanti in #1885
• fix(rope): support per-batch array offsets in eager RoPE by @nazerim in #1883
• fix(molmo_point): honor point_color in draw_points_on_image by @Anai-Guo in #1887
• Fix SmolVLM split-image token expansion by @atirna in #1922
• feat(server): live runtime settings via /v1/settings (reload-on-change, no restart) by @Lazarus-931 in #1876
• fix(models): honor a caller-supplied attention mask in five language models by @Anai-Guo in #1913
• Use correct RoPE scaling for several models by @lucasnewman in #1927
• Add Ministral3 embedder: reuse backbone with bidirectional mask by @Aryagarg23 in #1851
• Add video subsampling to images fallback in the server by @lucasnewman in #1924
• Fix PoolingCache APC restoration by @byoan in #1929
• Fix EOS token for Idefics3 by @lucasnewman in #1936

New Contributors

• @mitmul made their first contribution in #949
• @axiom-of-choice made their first contribution in #1866
• @nazerim made their first contribution in #1883
• @Anai-Guo made their first contribution in #1887
• @atirna made their first contribution in #1922

Full Changelog: v0.6.13...v0.6.14