Skip to content

Pull requests: openvinotoolkit/openvino.genai

New pull request New
28 Open 563 Closed
28 Open 563 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Correct samples requirements update
#653 opened Jul 19, 2024 by Wovchena Loading…
Update links in documentation, fix unzip command on Windows
#652 opened Jul 19, 2024 by helena-intel Loading…
9
Add infer request queue for tokenizers and enforce throughput hint
#651 opened Jul 19, 2024 by dkalinowski Loading…
7
[Continuous batching] Late token vector initialization in sampling
#649 opened Jul 19, 2024 by mzegla • Draft
@iefode
Fix chat templates with slices, add tokenizer config for mistralai/Mistral-7B-Instruct-v0.1
#648 opened Jul 19, 2024 by yatarkan • Draft
Apply todo, initialize detokenizer's cache
#647 opened Jul 19, 2024 by Wovchena Loading…
[master] Fix symbol encode error
#645 opened Jul 18, 2024 by yatarkan Loading…
2
Add CB naive chat
#644 opened Jul 18, 2024 by Wovchena • Draft
Add Cb streaming
#641 opened Jul 16, 2024 by Wovchena • Draft
Merge releases/2024/3 into master
#640 opened Jul 16, 2024 by Wovchena Loading…
Prefix caching.
#639 opened Jul 16, 2024 by popovaan • Draft
update llm bench optimum commit to include patch for llama/gemma llm_bench Label for llm_bench/ folder
#632 opened Jul 16, 2024 by eaidova Loading…
[2024.3] Fix symbol encode error
#629 opened Jul 15, 2024 by yatarkan Loading…
Bump versions
#627 opened Jul 15, 2024 by Wovchena Loading…
Test random gen by platform
#625 opened Jul 15, 2024 by as-suvorov • Draft
add generation time metrics
#613 opened Jul 12, 2024 by pavel-esir • Draft
1
Use CB as backend
#612 opened Jul 12, 2024 by Wovchena Loading…
11
Speculative decoding
#608 opened Jul 11, 2024 by iefode • Draft
[CI] OV local build
#602 opened Jul 10, 2024 by mryzhov Loading…
[Continuous Batching] Sampler optimizations
#587 opened Jul 8, 2024 by mzegla • Draft
@iefode
[PyPi] manylinux build
#581 opened Jul 5, 2024 by mryzhov • Draft
Optimize chat maintenance for LLM pipeline
#573 opened Jul 2, 2024 by TolyaTalamanov Loading…
5
Test FP16/BF16 models conversion llm_bench Label for llm_bench/ folder
#571 opened Jul 2, 2024 by eaidova • Draft
Update README.md for LCM with LoRA
#487 opened Jun 11, 2024 by zhuo-yoyowz Loading…
@Wovchena @yatarkan
8
multi thread for text gen do_not_merge llm_bench Label for llm_bench/ folder
#468 opened Jun 4, 2024 by wgzintel • Draft
ProTip! Updated in the last three days: updated:>2024-07-17.