🚀 全网效果最好的移动端【实时对话数字人】。 支持本地部署、多模态交互（语音、文本、表情），响应速度低于 1.5 秒，适用于直播、教学、客服、金融、政务等对隐私与实时性要求极高的场景。开箱即用，开发者友好。

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

Olares: An Open-Source Personal Cloud to Reclaim Your Data

[ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment

MicroPython for K210 RISC-V, let's play with edge AI easier

Deep learning gateway on Raspberry Pi and other edge devices

DefraDB is a Peer-to-Peer Edge-First Database. It's the core data storage system for the Source Ecosystem, built with IPLD, LibP2P, CRDTs, and Semantic open web properties.

speech to text benchmark framework

Real-time portrait segmentation for mobile devices

AI-in-a-Box leverages the expertise of Microsoft across the globe to develop and provide AI and ML solutions to the technical community. Our intent is to present a curated collection of solution accelerators that can help engineers establish their AI/ML environments and solutions rapidly and with minimal friction.

The Hailo Model Zoo includes pre-trained models and a full building and evaluation environment

On-Device Training Under 256KB Memory [NeurIPS'22]

A curated list of awesome edge computing, including Frameworks, Simulators, Tools, etc.

Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. This project provides researchers, developers, and engineers advanced quantization and compression tools for deploying state-of-the-art neural networks.

Easily create AI projects with Python on edge device

A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.

💜 The best free Telegram bot for ChatGPT, Microsoft Copilot (aka Bing AI / Sidney / EdgeGPT), Microsoft Copilot Designer (aka BingImageCreator), Gemini and Groq with stream writing, requests with images, multiple languages, admin control, data logging and more!

Dual Edge TPU Adapter to use it on a system with single PCIe port on m.2 A/B/E/M slot

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.

Jetson Nano-based smart camera system that measures crowd face mask usage in real-time.