LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Port of OpenAI's Whisper model in C/C++

Cross-platform, customizable ML solutions for live and streaming media.

DuckDB is an analytical in-process SQL database management system

MLX: An array framework for Apple silicon

12 Weeks, 24 Lessons, IoT for All!

Official inference framework for 1-bit LLMs

High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model

Wechat Chat History Exporter 微信聊天记录导出备份程序

Instructions on how to use the Realtime API on Microcontrollers and Embedded Platforms

青梧字幕是一款基于whisper的AI字幕提取工具

Efficient framework-agnostic data loading

Page turning via Bluetooth for Kobo eReaders