LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Port of OpenAI's Whisper model in C/C++

A library for efficient similarity search and clustering of dense vectors.

OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

DuckDB is an analytical in-process SQL database management system

A modern replacement for Redis and Memcached

Productive, portable, and performant GPU programming in Python.

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

Cloud-native high-performance edge/middle/service proxy

Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuzzy Search Engine for building delightful search experiences

Distribute and run LLMs with a single file.

An open source library for face detection in images. The face detection speed can reach 1000FPS.

A distributed, fast open-source graph database featuring horizontal scalability and high availability

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

A data visualization and analytics component, especially well-suited for large and/or streaming datasets.

A high-performance distributed file system designed to address the challenges of AI training and inference workloads.

High-speed Large Language Model Serving for Local Deployment

Cloud Native Runtime Security

The JavaScript / Wasm runtime that powers Cloudflare Workers

lightweight, standalone C++ inference engine for Google's Gemma models.

A Non-Euclidean Rendering Engine for 3D scenes.

A minimal, resource efficient unikernel for cloud services

Caffe: a fast open framework for deep learning.

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

YDB is an open source Distributed SQL Database that combines high availability and scalability with strong consistency and ACID transactions

Deep Scalable Sparse Tensor Network Engine (DSSTNE) is an Amazon developed library for building Deep Learning (DL) machine learning (ML) models

GTP engine and self-play learning in Go

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text

A composable and fully extensible C++ execution engine library for data management systems.