king0980692
Follow
Lists (2)
Starred repositories
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Developer-friendly, embedded retrieval engine for multimodal AI. Search More; Manage Less.
A lightweight, powerful framework for multi-agent workflows
OpenAI Assistants API quickstart with Next.js.
A framework for few-shot evaluation of language models.
OpenUI let's you describe UI using your imagination, then see it rendered live.
A guidance language for controlling large language models.
[NeurIPS'24] HippoRAG is a novel RAG framework inspired by human long-term memory that enables LLMs to continuously integrate knowledge across external documents. RAG + Knowledge Graphs + Personali…
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
Awesome Reasoning LLM Tutorial/Survey/Guide
Send push notifications to your phone or desktop using PUT/POST
FlashInfer: Kernel Library for LLM Serving
Toolkit for linearizing PDFs for LLM datasets/training
Lightweight yet powerful formatter plugin for Neovim
Watches files and records, or triggers actions, when they change.
CLIP model deploy in plain C/C++ using ggml machine learning library
Up to 10x faster strings for C, C++, Python, Rust, Swift & Go, leveraging NEON, AVX2, AVX-512, SVE, & SWAR to accelerate search, hashing, sort, edit distances, and memory ops 🦖
Up to 200x Faster Dot Products & Similarity Metrics — for Python, Rust, C, JS, and Swift, supporting f64, f32, f16 real & complex, i8, and bit vectors using SIMD for both AVX2, AVX-512, NEON, SVE, …
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
ncnn is a high-performance neural network inference framework optimized for the mobile platform
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
