Skip to content

Issues: microsoft/onnxruntime-genai

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
105 Open 311 Closed
105 Open 311 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Compiling ort_genai_c.h as a C file fails due to <cstddef> inclusion
#1512 opened May 28, 2025 by nizarbenalla
1
@Copilot
3
Fix default resource path to load native libraries for Java APIs api:java
#1509 opened May 27, 2025 by asoldano
1
Automatically install java maven artifact in the local maven repository api:java
#1508 opened May 27, 2025 by asoldano
1
Successful Source Build on ARM Windows 11, but pip/wheel cannot find onnxruntime-directml>=1.20.1 ep:DML platform:windows
#1507 opened May 26, 2025 by sourcesync
1
How to inference LLM models with OpenVino EP ep:DML
#1501 opened May 22, 2025 by ZhangWei125521
How to build for iOS platform:mobile
#1484 opened May 15, 2025 by sahmed53
Phi-4 audio task prompts don't work at all (Apple, onnx, dotnet)
#1455 opened May 6, 2025 by Savvkin
Endless response using the Phi-4-mini-instruct model
#1450 opened May 6, 2025 by f2bo
9
How to enable the Qwen3-30B-A3B
#1433 opened Apr 30, 2025 by ZhangWei125521
1
🔧 Optimizing Phi-4 MM Instruct Vision Model (ONNX Inference)
#1423 opened Apr 24, 2025 by MeemankGupta
ORT-GenAI should ship ARM64EC binaries for AMD64 python running on ARM64 Windows platform:windows
#1417 opened Apr 23, 2025 by kory
14
Leverage the latest opset and IR version in model builder
#1414 opened Apr 23, 2025 by justinchuby
1
libpng linking error: libonnxruntime-genai.so: undefined reference to `png_init_filter_functions_vsx'
#1407 opened Apr 18, 2025 by mgiessing
1
breaking api change on 0.5.2 -> 0.7.0
#1402 opened Apr 15, 2025 by natke
2
Missing add_special_tokens option in tokenizer
#1397 opened Apr 14, 2025 by ramkrishna2910
@wenbingl
Configuring SessionOptions programmatically ep:DML
#1393 opened Apr 10, 2025 by f2bo
5
Incorrect output shape for logits output returned from get_output("logits")
#1385 opened Apr 8, 2025 by VishalX
6
Phi-4 multi-modal produces unusually poor results
#1383 opened Apr 7, 2025 by mertalev
1
Performance
#1382 opened Apr 7, 2025 by naveen-kurra
5
OnnxRuntimeGenAIChatClientOptions support DeepSeek-r1-Distill-14b
#1380 opened Apr 7, 2025 by williamlzw
3
Request for Direct Integration of TensorRT Execution Provider for INT8 Inference Acceleration ep:TensorRT
#1368 opened Apr 2, 2025 by Efan-Cui
Phi-4-mini-instruct CPU int4 version produces incorrect output for a tool call prompt
#1334 opened Mar 18, 2025 by natke
4
support gemma 3
#1329 opened Mar 17, 2025 by circuluspibo
3
ORT Gen AI inference support for text component only enhancement New feature or request
#1325 opened Mar 14, 2025 by AhmedTElthakeb
@baijumeswani
1
How to implement a multiple loop chat with memory(chat context) using onnx.genai and deepseek reasonning model
#1312 opened Mar 8, 2025 by John0King
3
ProTip! What’s not been updated in a month: updated:<2025-04-30.