Jimwu.sync upstream 20260807 - #81

Merged

jimw567 merged 190 commits into

jimwu.sync-upstream-20260807

Aug 7, 2026

Commits on Jul 25, 2026

hexagon: partial im2col support (#26007)
tboinovski1
authored
355303e
server: support MCP stdio (#26062)

authored
20455a4
common : use-after-free when loading LoRA adapter fails (#25611)
nmouha
authored
8bb9093

Commits on Jul 26, 2026

ggml-webgpu: Fix WASM compilation with OpenMP (#25943)
reeselevine
authored
7cdd557
ui: fix context gauge card regressions and land at the conversation end (#26099)
ServeurpersoCom
authored
ff067f7
opencl: fix fused RMS norm mul view offset (#26085)
happyyzy
authored
42fc243
model: Add MiniMax-M3 (MSA: MiniMax Sparse Attention) support (#24908)

authored
b1d4c65
mtmd: add GLM-5.2-Vision (#26126)

ehartford
and
Eric Hartford
authored
af28502
common: add `subproc.h` wrapper, disabled on android/ios (#26102)
ngxson
authored
d2a8182
ui: detect the conversation import format from file contents (#26121)
ServeurpersoCom
authored
55b7d6c
Keep Minimax's indexer tensors at F32 for speed and accuracy (#26144)
bartowski1182
authored
7657a6c
ui: fix system message edit box not expanding to fit content (#26006)
pieroevcc
authored
d4d057b
mtmd: fix android build (#26150)
ngxson
authored
0d47ea7
mtmd: Add Vision Support for Minimax-M3 (#25113)

authored
3d1c3a8

Commits on Jul 27, 2026

Commits on Jul 28, 2026

Commits on Jul 29, 2026

Commits on Jul 30, 2026

mimo2: address MTP review feedback (#26228)
tnhnyzc
authored
64d528b
[UT] enhance UT to show all real unsupported backends (#25234)

arthw
and
ggerganov
authored
a6a77bc
ggml : Fix issue with kleidiai ci and stringop overflow warning (#26277)
JonathanC-ARM
authored
32703b4
ui: IndexedDB and Conversations data fixes (#26278)
allozaur
authored
21a5f5b
metal: fix memory unwire if model is freed without any GPU operations (#26082)

nikwen
and
forforever73
authored
d0bfb19
Remove custom cpu op from the M3 graph, express with stock ops (#26297)
timkhronos
authored
b2f2216
CUDA: add Q2_0 support (#25707)
khosravipasha
authored
9b2a088
ggml : bump version to 0.18.0 (ggml/1576)
ggerganov
committed
6a4c335
sync : ggml
ggerganov
committed
9ebfc3a
readme : refresh (#26280)
ggerganov
authored
6b36c23
ggml-cuda: Allow transpose-free gemmv computation (#26171)
roberteg16
authored
e1a1abb
tests : avoid building get-model.cpp many times (#26317)
ggerganov
authored
47f686f
llama-context : sync pending async copies before clearing embd_seq (#25676)
o7si
authored
432d7ff
Test support for alternative conv layout (#25617)
pmaybank
authored
958d9c0
vulkan: Support quantized concat (#25684)
jeffbolznv
authored
ea63b4d
server: support inp embd to generate next token (#26313)
ngxson
authored
b4ca032
mtmd: add lanczos resize method [no release] (#26341)
ngxson
authored
5f55650

Commits on Jul 31, 2026

ggml-webgpu: improve flash_attn_vec for quantized KV at long contexts (#25956)
yomaytk
authored
8f4646a
sycl: fuse RMS_NORM + MUL (#26015)
Titaniumtown
authored
1553725
[SYCL] Support q2 mul_mat (#26231)
arthw
authored
a2be61d
sycl : support dev2dev memcpy by DEV2DEV_MEMCPY_FORWARD (#26234)

arthw
and
NeoZhangJianyu
authored
1c5b89f
ggml-zendnn : group matmul direct API for mul_mat_id (#25918)
z-sachin
authored
1e22599
llama : enforce the same K and V cache types for DeepSeek V4; enable FA if V cache is quantized (#25871)

fairydreaming
and
sszymczy
authored
69e62fc
[SYCL] support the missed types in cpy (#26005)
arthw
authored
d5d3e05
SYCL: add oneMKL GEMM flash attention for XMX-accelerated prompt proc… (#25025)

authored
9d9a6d2
cuda: extract Q2_0 elements via __byte_perm (#25603)
dfriehs
authored
15e755f
server: correct accepted tokens when need draft token replay (#26320)

ruixiang63
and
ggerganov
authored
0005475
vulkan: update vulkan sdk to 1.4.357.0 (#26303)
jeffbolznv
authored
6f3c0a7
llama : load MTP tensors only if they are really used (#26296)

fairydreaming
and
sszymczy
authored
82dbc4f
Support rotated kv cache quant (#26180)
timkhronos
authored
a09d8ab
mtmd: add n_embd_head (#26342)

ngxson
and
shimmyshimmer
authored
db7d8b2
vulkan: Introduce driver version check for Windows Intel GPU to mitigate crashing (#25192)
rillomas
authored
eb41d50
vulkan: add POOL_1D op (#25431)
AnandPatil1
authored
876a432

Commits on Aug 1, 2026

chat : enable tool call in thinking for DS4 (#26269)
pwilkin
authored
ddd4ec1
mtmd: add minicpmv46 downsample (#25993)
tc-mb
authored
de69995
cli : persist reasoning_content in chat history (#26362)
ramicaza
authored
c629da5
agents: clarify comment style and jinja knowledge (#26405)
ngxson
authored
89482bd
vendor : update BoringSSL to 0.20260730.0 (#26353)
cabelo
authored
815a2a5
vulkan: extend topk_moe fusion to support sqrt(softplus) (#26124)
jeffbolznv
authored
a7a6d0d
test: fix some CI errors (#26415)
ngxson
authored
11924d4

Commits on Aug 2, 2026

ggml-webgpu: add support for f16 repeat (#26307)
yomaytk
authored
7a2db1a
model : load MiMo V2 MTP tensors only if used (#26412)
CISC
authored
75587a0
sycl: fix classification of iGPUs (#26105)
KyleHagy
authored
272700b
chat : add qwen3 specialized parser (#26252)

aldehir
and
bartdeboer
authored
f5919bf
DeepseekV4 MTP + DSpark (#25784)
am17an
authored
596a579
opencl: bugfix increment ref_count in ggml_backend_opencl_init() (#26162)
akleine
authored
c745be2
convert: add option to create separate dspark GGUF (#26452)
am17an
authored
3581ba0
common: support the DSpark sidecar resolution (#26458)
ServeurpersoCom
authored
bb4e0e1
metal: implement DeepSeek V4 hyper-connections (#26459)

ggerganov
and
tarruda
authored
fffbcbd
opencl: limit local workgroup size for GLU operation (#26383)
mgroeber9110
authored
0ab9d6f
metal : add F16 support for bin ops (#26465)
ggerganov
authored
9d21b57
metal : add SILU_BACK (#25982)
Blackcyan30
authored
221f0f6

Commits on Aug 3, 2026

metal: implement DSv4 Lightning Indexer (#25893)

authored
1464c62
llama : MTP support for DeepSeek V3.2 (#26457)

fairydreaming
and
sszymczy
authored
2b63e06
model: MTP support for Qwen3-Next (#25589)

yomaytk
and
CISC
authored
4ed2b13
server: (tools) add x-tool-cwd header (#26420)
ngxson
authored
f2b52a8
server: add notice for upcoming default port change 8080 --> 9931 (#26508)
ngxson
authored
0b14b87
CUDA: Fix data-races when reusing SMEM in block_reduce (#26385)
ORippler
authored
9bd4c09
CUDA: Add backend sampler for penalties sampler (#25262)
kmorennv
authored
96278e3
llama : allocate indexer cache only in "full" indexer layers (#26474)

fairydreaming
and
sszymczy
authored
563dec8
model: M3: Move MSA into a new memory implementation (#26338)

timkhronos
and
ggerganov
authored
67d5978
graph : fix unused input tensors in minimax m3 graph (#26519)
ggerganov
authored
c50b34a
opencl: route large q6_K lm_head to the flat GEMV (#26427)
wanghqc
authored
39eab74
ggml: use dynamic allocation for split graph inputs (#22789)

AgoraPete
and
ggerganov
authored
dbadb68
vocab : validate default special token ids (#26506)
CISC
authored
e8e06f7
server: add get_info tool (#26522)

ngxson
and
ServeurpersoCom
authored
99111b1
tests: add model resolution test on synthetic repo listings (#26172)

ServeurpersoCom
and
ngxson
authored
ee0445c
model : support MTP in GLM-4.7-Flash (#24868)
jacekpoplawski
authored
57c0921
vendor : update BoringSSL to 0.20260803.0 (#26523)
cabelo
authored
fe2adf0
vendor : update cpp-httplib to 0.52.0 (#26485)
cabelo
authored
94bc47f
chat : add new template for DeepSeek V4 Flash 0731 (#26398)
tarruda
authored
0ef6e55

Commits on Aug 4, 2026

Commits on Aug 5, 2026

Commits on Aug 6, 2026

Commits on Aug 7, 2026