Skip to content

Issues: microsoft/onnxruntime-genai

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
105 Open 311 Closed
105 Open 311 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Certain prompts crash for Phi 3 mini int4 DML (with simpler example provided) crash ep:DML
#833 opened Aug 22, 2024 by elephantpanda
@PatriceVignola
22
Memory leak during back-to-back inferences ep:DML model:transformer performance
#590 opened Jun 10, 2024 by jeremyfowers
@PatriceVignola
20
[C#] Regression on 0.5.0 with DML ep:DML
#1071 opened Nov 19, 2024 by azchohfi
15
ORT-GenAI should ship ARM64EC binaries for AMD64 python running on ARM64 Windows platform:windows
#1417 opened Apr 23, 2025 by kory
14
Phi-3-Mini fails to execute on long prompts on Intel integrated GPU with DirectML ep:DML
#570 opened Jun 5, 2024 by ofirzaf
@PatriceVignola
13
With Latest GeForce Driver v555 - Microsoft.ML.OnnxRuntimeGenAI.OnnxRuntimeGenAIException: The GPU will not respond to more commands, most likely because of an invalid command passed by the calling application. ep:DML
#501 opened May 22, 2024 by AshD
@PatriceVignola
13
Microsoft.ML.OnnxRuntimeGenAI.OnnxRuntimeGenAIException: 'CUDA execution provider is not enabled in this build.' ep:CUDA
#1191 opened Jan 16, 2025 by karayakar
12
Phi-3-mini-4k-instruct-onnx model generates nonsensical results when prompt is longer than half of the context window length bug Something isn't working
#552 opened May 31, 2024 by jackylu0124
@baijumeswani
12
onnxruntime-genai generation speed very slow on int4 performance
#1098 opened Nov 23, 2024 by tarekziade
10
Application crashes on exit with v0.5.0 crash
#1056 opened Nov 9, 2024 by f2bo
10
Back-to-back inferences speed slowdown over time bug Something isn't working ep:DML model:transformer performance
#737 opened Jul 31, 2024 by xcmgttacct
10
[.NET] Genny chat-bot sample doesn't support DirectML and Phi-3 ep:DML
#569 opened Jun 5, 2024 by asmirnov82
1
@PatriceVignola
10
Endless response using the Phi-4-mini-instruct model
#1450 opened May 6, 2025 by f2bo
9
is there any exmaple of phi-3 vision model deploy on Android? platform:mobile
#608 opened Jun 14, 2024 by henrywang0314
9
.Net How to free GPU memory after each inference bug Something isn't working enhancement New feature or request performance
#1131 opened Dec 9, 2024 by strikene
@RyanUnderhill
8
Device API throws exception bug Something isn't working ep:DML
#488 opened May 21, 2024 by natke
@PatriceVignola
8
Querying the ids of all the DML devices and selecting a device for inference ep:DML
#360 opened Apr 30, 2024 by jojo1899
@PatriceVignola
8
GPU suspended (887A0005) while running example in DML ep:DML
#628 opened Jun 21, 2024 by skyline75489
@PatriceVignola
7
Incorrect output shape for logits output returned from get_output("logits")
#1385 opened Apr 8, 2025 by VishalX
6
Build for Android failing: error: no template named 'unordered_map' in namespace 'std' platform:mobile
#1291 opened Mar 2, 2025 by Danmoreng
6
[Linux] [C#] [0.5.2] Publish/Build Binaries with Microsoft.ML.OnnxRuntimeGenAI.Cuda on Linux containing unnecessary large DLL files ep:CUDA
#1135 opened Dec 10, 2024 by jiaxuwu2021
6
Receiving ROCm execution provider not supported in this build
#1130 opened Dec 9, 2024 by r4ghu
6
Cuda / DirectML question ep:CUDA ep:DML
#1037 opened Nov 6, 2024 by janjanusek
6
Running custom encoder-decoder models in onnxruntime-genai model:transformer
#875 opened Sep 5, 2024 by KarelZe
6
Nightly builds packaging
#772 opened Aug 9, 2024 by jarroddavis68
@baijumeswani
6
ProTip! Type g i on any issue or pull request to go back to the issue listing page.