Discussions

• 19 You must be logged in to vote

  #️⃣

  Flash attention

  pfeatherstone asked Nov 3, 2023 in General · Unanswered

  

  

  

  

  3
• 17 You must be logged in to vote

  💡

  Plans for EP for GPU acceleration under macOS?

  j-paulus started Nov 16, 2020 in Ideas / Feature Requests

  

  

  0
• 10 You must be logged in to vote

  ❓

  Set Weights dynamically for the inference session

  fedemarche asked Nov 14, 2022 in Other Q&A · Unanswered

  

  

  1
• 8 You must be logged in to vote

  ❓

  How can OnnxRuntime load multi onnx files?

  shimoshida asked Dec 23, 2021 in Other Q&A · Unanswered

  

  

  

  

  3
• 7 You must be logged in to vote

  ❓

  CUDA vs WebGPU performance 6x to 14x slower

  frotaur asked Apr 2, 2024 in Web Q&A · Unanswered

  

  

  0
• 6 You must be logged in to vote

  #️⃣

  Opset Coverage - Binary Size Tradeoff

  adityagoel4512 asked Apr 4, 2023 in General · Unanswered

  

  

  0
• 6 You must be logged in to vote

  💡

  I ported ORT into Pascal ( FreePascal and Delphi ) and it works like a charm!

  hshatti started Apr 17, 2023 in Ideas / Feature Requests

  

  

  1
• 5 You must be logged in to vote

  ❓

  ONNX ops for training with PyTorch and TensorFlow

  kiszk asked Oct 17, 2022 in Other Q&A · Unanswered

  

  

  0
• 5 You must be logged in to vote

  #️⃣

  Writing an execution provider for TensorFlow Lite

  rgov asked Aug 9, 2022 in General · Unanswered

  

  

  0
• 5 You must be logged in to vote

  ❓

  Can ONNX get gradient directly through API like torch.autograd.grad(...)??

  training issues related to ONNX Runtime training; typically submitted using template

  FdyCN asked Apr 26, 2022 in Other Q&A · Unanswered

  

  

  

  

  2
• 5 You must be logged in to vote

  ❓

  Can we avoid allocating a significant amount of memory when executing in a multithreaded environment when precision is changed?

  tmbrye asked Jan 24, 2025 in Performance Q&A · Unanswered

  

  

  

  

  6
• 5 You must be logged in to vote

  ❓

  LoadLibrary Failed with Error 126 When Loading onnxruntime_providers_openvino.dll

  DavidLuong98 asked Jan 28, 2025 in EP Q&A · Unanswered

  

  

  0
• 5 You must be logged in to vote

  ❓

  Creating OpenCL provider for onnxruntime

  artyom-beilis asked Aug 28, 2024 in EP Q&A · Unanswered

  

  

  0
• 5 You must be logged in to vote

  ❓

  The requested API version [20] is not available, only API versions [1, 17]

  acastroceit asked Jan 28, 2025 in API Q&A · Unanswered

  

  

  0
• 4 You must be logged in to vote

  ❓

  What is the correct way to create an OrtValue from a pytorch tensor on CUDA?

  documentation improvements or additions to documentation; typically submitted using template

  mattroos asked Apr 30, 2021 in Other Q&A · Answered

  

  

  

  

  11
• 4 You must be logged in to vote

  ❓

  Is it possible to set disabled_optimizers with C# API?

  api:CSharp issues related to the C# API

  asvyazin asked Dec 13, 2023 in API Q&A · Unanswered

  

  

  2
• 4 You must be logged in to vote

  ❓

  Revised release date for onnxruntime 1.17

  release:1.17.0

  tdeboissiere asked Jan 17, 2024 in Release Q&A · Unanswered

  

  

  

  

  2
• 4 You must be logged in to vote

  ❓

  Does onnxruntime on macOS with apple silicon uses arm-specific instructions when running quantized models?

  quantization issues related to quantization

  Rexhaif asked Mar 5, 2023 in Other Q&A · Unanswered

  

  

  0
• 4 You must be logged in to vote

  ❓

  OpenCV OpenVINO backend runs model far faster than onnxruntime with OpenVINOExecutionProvider

  jbrownkramer asked Nov 16, 2021 in Other Q&A · Unanswered

  

  

  0
• 4 You must be logged in to vote

  ❓

  Use Onnxruntime in C# with Unity for iOS: Can't load DLL 'onnxruntime'

  digitalmonkey asked Mar 4, 2023 in Other Q&A · Unanswered

  

  

  0
• 4 You must be logged in to vote

  ❓

  What exactly do OrtArena, Ort::MemoryInfo::CreateCpu and Ort::Value::CreateTensor do?

  mmaras1999 asked Aug 30, 2022 in Other Q&A · Unanswered

  

  

  0
• 4 You must be logged in to vote

  ❓

  Difference between OrtAllocatorType

  minty99 asked Aug 23, 2022 in Other Q&A · Unanswered

  

  

  0
• 4 You must be logged in to vote

  ❓

  How to use Xnnpack EP through python?

  xujuntwt95329 asked Mar 27, 2024 in EP Q&A · Unanswered

  

  

  0
• 4 You must be logged in to vote

  ❓

  ROCm/MIGraphX in Windows/Linux

  ep:MIGraphX issues related to AMD MI GraphX execution provider ep:ROCm questions/issues related to ROCm execution provider

  lingzhengmoh-vitroxtr asked May 16, 2023 in Other Q&A · Unanswered

  

  

  1
• 3 You must be logged in to vote

  💡

  Inference on mac os 10.14

  xidiancpy started Sep 4, 2020 in Ideas / Feature Requests

  

  

  1