Fast ML inference & training for Rust with ONNX Runtime

Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models.

Remove backgrounds from images with ease

pyannote audio diarization in rust

Only infer tts

Mid-Level Rust Bindings to the C API for Microsoft's ONNX Runtime

Proxy server for triton gRPC server that inferences embedding model in Rust

Speech detection using silero vad in Rust

Use vits tts models based on piper in Rust

Rust Onnx Runtime - a rust binding to onnx runtime

rust yolo onnxruntime yolov8 detection inference

ort (onnxruntime) plugin for bevy

⚡️ Blazingly fast machine learning predictions. Supports REST and gRPC

"Programmazione di sistema" project @ Politecnico di Torino, a.y. 2022/2023.

2024 SOTA object detector RT-DETR (CVPR2024, https://github.com/lyuwenyu/RT-DETR) inference using Rust + Ort

a bunch of microservices for self hosting that i use personally :)

This project implements semantic search using the CLIP model. It's a web service built with Rust and Actix-web.

Inference Package For Deep Learning Model Using Onnxruntime

"Programmazione di Sistema" project, a.y. 2022-2023 - Politecnico di Torino.