Skip to content

Issues: microsoft/onnxruntime-genai

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
105 Open 311 Closed
105 Open 311 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[DML] Test that destroys a generator, tweaks GeneratorParams and then creates another generator throws a KV_Cache exception ep:DML platform:windows
#722 opened Jul 24, 2024 by yuslepukhin
How to modify the dtype of inputs?
#795 opened Aug 14, 2024 by trajepl
@baijumeswani
Update README to add git lfs and Windows long string guidance platform:windows
#877 opened Sep 5, 2024 by natke
@natke
Document past present shared buffer
#878 opened Sep 5, 2024 by natke
@natke
TheUnhandled exception. The parameter is incorrect. ep:DML platform:windows
#883 opened Sep 9, 2024 by sirredbeard
@PatriceVignola
887A0006 The GPU will not respond to more commands, most likely because of an invalid command passed by the calling application. ep:DML
#975 opened Oct 14, 2024 by elephantpanda
@PatriceVignola
Benchmark script crashes when trying to run Llama 3.2 1b DML model crash ep:DML
#982 opened Oct 14, 2024 by natke
@PatriceVignola
qwen2.5 output is not correct under dml ep ep:DML model quality
#1019 opened Oct 30, 2024 by cjsdurj
How to select NPU instead of GPU on Intel laptop? ep:DML
#1029 opened Nov 3, 2024 by mmaitre314
.Net After updating to .5, Phi3.5Mini outputs some meaningless characters model quality
#1109 opened Nov 30, 2024 by strikene
0.5.2 GPU crashes if initial input is 360 zeros. crash ep:DML
#1113 opened Dec 3, 2024 by elephantpanda
Cant add multiple images for conversation in c#
#1233 opened Feb 8, 2025 by Barshan-Mandal
Request for Direct Integration of TensorRT Execution Provider for INT8 Inference Acceleration ep:TensorRT
#1368 opened Apr 2, 2025 by Efan-Cui
Missing add_special_tokens option in tokenizer
#1397 opened Apr 14, 2025 by ramkrishna2910
@wenbingl
Leverage the latest opset and IR version in model builder
#1414 opened Apr 23, 2025 by justinchuby
1
🔧 Optimizing Phi-4 MM Instruct Vision Model (ONNX Inference)
#1423 opened Apr 24, 2025 by MeemankGupta
Phi-4 audio task prompts don't work at all (Apple, onnx, dotnet)
#1455 opened May 6, 2025 by Savvkin
How to build for iOS platform:mobile
#1484 opened May 15, 2025 by sahmed53
How to inference LLM models with OpenVino EP ep:DML
#1501 opened May 22, 2025 by ZhangWei125521
Automatically install java maven artifact in the local maven repository api:java
#1508 opened May 27, 2025 by asoldano
1
Fix default resource path to load native libraries for Java APIs api:java
#1509 opened May 27, 2025 by asoldano
1
How to release GPU memory after each inference? enhancement New feature or request ep:CUDA performance
#446 opened May 13, 2024 by nguyenthekhoig7
@baijumeswani
1
More API parameters could be const
#631 opened Jun 21, 2024 by skottmckay
1
[GPU Driver Error] Inference Phi-3 on Snapdragon X Elite ep:DML
#814 opened Aug 19, 2024 by KYUNGSOO-LEE
1
ONNX Runner: Quantized Model Execution Error api:java waiting-for-customer
#866 opened Sep 3, 2024 by Dave86ch
1
ProTip! Exclude everything labeled bug with -label:bug.