edge-ai

FedML - The federated learning and analytics library enabling secure and collaborative machine learning on decentralized data anywhere at any scale. Supporting large-scale cross-silo federated learning, cross-device federated learning on smartphones/IoTs, and research simulation. MLOps and App Marketplace are also enabled (https://open.fedml.ai).

[ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment

Deep learning gateway on Raspberry Pi and other edge devices

MicroPython for K210 RISC-V, let's play with edge AI easier

🦖 Serverless Streaming Framework for low-latency geo-distributed system and realtime collaboration application, running atop QUIC protocol, as Metaverse infrastructure, engaging 5G technology.

Real-time portrait segmentation for mobile devices

speech to text benchmark framework

On-Device Training Under 256KB Memory [NeurIPS'22]

A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.

Neuralet is an open-source platform for edge deep learning models on edge TPU, Jetson Nano, and more.

Jetson Nano-based smart camera system that measures crowd face mask usage in real-time.

On-device, Offline Spleeter Solution For Mobile

A curated list of awesome edge computing, including Frameworks, Simulators, Tools, etc.

MaixPy for Linux Python3, let's play with edge AI easier!

Dual Edge TPU Adapter to use it on a system with single PCIe port on m.2 A/B/E/M slot

Social Distancing Detector using deep learning and capable to run on edge AI devices such as NVIDIA Jetson, Google Coral, and more.

Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. This project provides researchers, developers, and engineers advanced quantization and compression tools for deploying state-of-the-art neural networks.

Create a smart video application using the Intel Distribution of OpenVINO toolkit. The toolkit uses models and inference to run single-class object detection.

Demo for training a convolutional neural network to classify words and deploy the model to a Raspberry Pi using TensorFlow Lite.

Light Face Detection using PyTorch Lightning