Feature/ngram map reasoning #19253

srogmann · 2026-02-01T20:30:35Z

This pull request is a follow-up to #18471.

ngram-map: Remove outdated entries if reasoning of previous message has been removed.
ngram-map: An internal hash map which was missing in Add self‑speculative decoding (no draft model required) #18471 has been added.
statistics: Computation of t_begin and t_accept has been added.
docs/speculative.md: ngram-mod has been added (see spec : add ngram-mod #19164).

srogmann added 5 commits January 31, 2026 20:21

spec: ngram-map and reasoning chats

caec12a

spec: add t_begin and t_accept

a215937

ngram-map : add internal hash map

2c26f3c

docs : update ngram-map, add ngram-mod

a71f4a0

docs : fix ngram-map-k

067318e

srogmann requested a review from ggerganov as a code owner February 1, 2026 20:30

github-actions bot added the documentation Improvements or additions to documentation label Feb 1, 2026

loci-dev mentioned this pull request Feb 1, 2026

UPSTREAM PR #19253: Feature/ngram map reasoning auroralabs-loci/llama.cpp#1124

Open

docs : differences between implementations

c7f261a

ggerganov approved these changes Feb 2, 2026

View reviewed changes

ggerganov merged commit b4d05a3 into ggml-org:master Feb 2, 2026
74 of 78 checks passed

Provide feedback