🛠 A lite C++ toolkit of awesome AI models, support ONNXRuntime, MNN, TNN, NCNN and TensorRT.

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.

Drop-in replacement for onnxruntime-node with GPU support using CUDA or DirectML

Perform inference with TwinLiteNet model using ONNX Runtime. TwinLiteNet is a lightweight and efficient deep learning model designed for drivable area and lane segmentation

A C++ project for running CUDA-accelerated ONNX model inference, using ONNX Runtime and OpenCV for image segmentation tasks.

Simple tool to profile onnx inference with C++ APIs.

simplest demo of onnxruntime gpu in c/cpp