Skip to content

Pull requests: huggingface/text-generation-inference

New pull request New
28 Open 1,573 Closed
28 Open 1,573 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Support flashinfer for Gemma3 prefill
#3167 opened Apr 11, 2025 by danieldk Loading…
5 tasks
1
Fix flashinfer plan call to use positional arguments for #3165
#3166 opened Apr 11, 2025 by ruckc Loading…
2 of 5 tasks
1
Update to flashinfer 0.2.5
#3164 opened Apr 11, 2025 by danieldk • Draft
5 tasks
Add chunked attn for L4
#3162 opened Apr 10, 2025 by mht-sharma • Draft
2 of 7 tasks
L4 fixes
#3161 opened Apr 10, 2025 by mht-sharma Loading…
5 tasks
Gaudi: add CI
#3160 opened Apr 10, 2025 by baptistecolle • Draft
5 tasks
Update links Inferentia refer docs
#3154 opened Apr 9, 2025 by guspan-tanadi Loading…
1 of 5 tasks
transformers flash llm/vlm enabling in xpu
#3152 opened Apr 9, 2025 by sywangyi Loading…
1
IPEX support FP8 kvcache/softcap/slidingwindow
#3144 opened Mar 31, 2025 by sywangyi • Draft
5 tasks
Gaudi: clean cuda/rocm code in hpu backend, enable flat_hpu gaudi Issues related to Intel Gaudi hardware
#3113 opened Mar 14, 2025 by sywangyi Loading…
5 tasks
23
feat: align function id with tool call response
#3111 opened Mar 13, 2025 by drbh Loading…
wip: comment out prepend full_text
#3079 opened Mar 7, 2025 by jrc2139 • Draft
1 of 5 tasks
1
3
Expose the real-time internal state of the batcher through SSE
#3065 opened Feb 27, 2025 by mfuntowicz • Draft
3
Added model name label to metrics and added an optional argument --served-model-name wontfix This will not be worked on
#3064 opened Feb 27, 2025 by yashaswipiplani Loading…
display available cached versions in TGI server error message of Neuron backend
#3063 opened Feb 26, 2025 by jimburtoft Loading…
4 tasks
2
Pr 2982 ci branch
#3046 opened Feb 20, 2025 by drbh Loading…
3
Support xccl distributed backend
#3034 opened Feb 18, 2025 by dvrogozh Loading…
4
Fix CPU and memory affinity under external resource management
#3012 opened Feb 11, 2025 by askervin Loading…
1
6
Add 'json_schema' alias to GrammarType.Json
#2982 opened Jan 31, 2025 by aW3st Loading…
2 of 5 tasks
1
[Backend] Introduce vLLM backend
#2976 opened Jan 31, 2025 by mfuntowicz Loading…
Kvrouter that will increase the kv-cache hits in case of multiple routing strategy
#2965 opened Jan 29, 2025 by Narsil Loading…
5 tasks
1
misc(gha): expose action cache url and runtime as secrets
#2964 opened Jan 29, 2025 by mfuntowicz Loading…
8
llava next image encoder to allow un-aligned patch / image sizes
#2936 opened Jan 22, 2025 by jimexist Loading…
5 tasks
5
Update Dockerfile to use devel image for compatibility
#2848 opened Dec 16, 2024 by YaserJaradeh Loading…
2 of 5 tasks
10
Enable qwen2vl video
#2756 opened Nov 18, 2024 by drbh Loading…
9 tasks done
24
ProTip! Updated in the last three days: updated:>2025-04-11.