A framework for few-shot evaluation of language models.

A high-throughput and memory-efficient inference and serving engine for LLMs

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./project/android/apps/MnnLlmA…

A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.

NEW - YOLOv8 🚀 in PyTorch > ONNX > OpenVINO > CoreML > TFLite

Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provide data annotation and synthesis tools, support training and…

Model compression for ONNX

ONNX Model Exporter for PaddlePaddle

real time face swap and one-click video deepfake with only a single image (uncensored)

YOLOv10: Real-Time End-to-End Object Detection

YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

llm-export can export llm model to onnx.

TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization and sparsity. It compresses deep learning models for downstream deployment frame…

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Implementation of paper - YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information

Tensors and Dynamic neural networks in Python with strong GPU acceleration

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.