Skip to content

Pull requests: huggingface/text-generation-inference

New pull request New
17 Open 1,300 Closed
17 Open 1,300 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Support continue final message
#2733 opened Nov 8, 2024 by drbh Loading…
feat: add payload limit
#2726 opened Nov 5, 2024 by OlivierDehaene Loading…
3
Upgrade outlines v2
#2724 opened Nov 4, 2024 by aW3st Loading…
3
Add llama.cpp backend
#2723 opened Nov 4, 2024 by mfuntowicz • Draft
feat: support flash attention 2 in qwen2 vl vision blocks
#2721 opened Nov 4, 2024 by drbh Loading…
Update to moe-kernels 0.7.0
#2720 opened Nov 4, 2024 by danieldk Loading…
5 tasks
add ipex moe implementation to support Mixtral and PhiMoe
#2707 opened Oct 30, 2024 by sywangyi Loading…
4
fix: improve find_segments via numpy diff
#2686 opened Oct 24, 2024 by drbh Loading…
feat: return streaming errors as an event formatted for openai's client
#2668 opened Oct 18, 2024 by drbh Loading…
Get opentelemetry trace id from request headers instead of creating a new trace
#2648 opened Oct 15, 2024 by kozistr Loading…
3 of 5 tasks
1
1
PR 2634 CI - Fix the tool_choice format for named choice by adapting OpenAIs scheme
#2645 opened Oct 14, 2024 by drbh Loading…
49
[WIP] Add gfx1100 support to AMD pytorch build
#2642 opened Oct 13, 2024 by cazlo • Draft
1 of 5 tasks
1
1
Fix the tool_choice format for named choice by adapting OpenAIs scheme
#2634 opened Oct 10, 2024 by linusbierhoff Loading…
[DOCS] Add Google Cloud TGI integration via dedicated DLCs
#2612 opened Oct 5, 2024 by alvarobartt • Draft
1 of 5 tasks
8
feat: Add automatic nightly benchmarks
#2591 opened Sep 30, 2024 by Hugoch Loading…
1 of 5 tasks
@Hugoch
Improve vlm support (add idefics3 support)
#2437 opened Aug 20, 2024 by drbh • Draft
4 tasks
Add model_load_time metric
#2311 opened Jul 26, 2024 by Edwinhr716 Loading…
2 of 5 tasks
2
ProTip! Adding no:label will show everything without a label.