Skip to content
Permalink
Branch: master
Find file Copy path
Find file Copy path
Fetching contributors…
Cannot retrieve contributors at this time
48 lines (48 sloc) 2.37 KB
youtube_video_url amazon_s3_presentation_url amazon_s3_video_url categories description image session_attendee_num session_id session_room session_slot session_speakers session_track tag tags title
san19
Microsoft and a community of partners created ONNX as an open standard for representing machine learning models. Models from many frameworks including TensorFlow, PyTorch, SciKit-Learn, Keras, Chainer, MXNet, and MATLAB can be exported or converted to the standard ONNX format. Once the models are in the ONNX format, they can be run on a variety of platforms and devices.<br><br>ONNX Runtime is a high-performance inference engine for deploying ONNX models to production. Its optimized for both cloud and edge and works on Linux, Windows, and Mac. Written in C++, it also has C, Python, and C# APIs. ONNX Runtime provides support for all of the ONNX-ML specification and also integrates with accelerators on different hardware such as TensorRT on NVidia GPUs.<br><br>The ONNX Runtime is used in high scale Microsoft services such as Bing, Office, and Cognitive Services. Performance gains are dependent on a number of factors but these Microsoft services have seen an average 2x performance gain on CPU. ONNX Runtime is also used as part of Windows ML on hundreds of millions of devices. You can use the runtime with Azure Machine Learning services. By using ONNX Runtime, you can benefit from the extensive production-grade optimizations, testing, and ongoing improvements.
featured path
true
/assets/images/featured-images/san19/SAN19-211.png
39
SAN19-211
Sunset 3 (Session 3)
end_time start_time
2019-09-24 11:55:00
2019-09-24 11:30:00
speaker_bio speaker_company speaker_image speaker_location speaker_name speaker_position speaker_url speaker_username
Weixing Zhang is a Senior Software Engineer working in AI Framework Architecture team at Microsoft. His focus is optimization of AI framework, code generation and training in ONNX Runtime.
Microsoft
/assets/images/speakers/san19/weixing-zhang.jpg
Weixing Zhang
Senior Software Engineer
weixing.zhang
AI/Machine Learning
session
Machine Learning/AI
SAN19-211 - ONNX & ONNX Runtime
You can’t perform that action at this time.