Pinned Loading

1. KVSplit KVSplit Public

   Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality…

   Python 351 13

2. ray-project/ray ray-project/ray Public

   Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

   Python 37.6k 6.4k

3. jax-ml/jax jax-ml/jax Public

   Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

   Python 32.6k 3.1k

4. ComposioHQ/composio ComposioHQ/composio Public

   Composio equips your AI agents & LLMs with 100+ high-quality integrations via function calling

   Python 25.5k 4.4k

5. NVIDIA/NeMo NVIDIA/NeMo Public

   A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

   Python 14.8k 2.9k

6. synapz synapz Public

   synapz is a research prototype exploring how large language models can adapt teaching content to different cognitive styles. built over a 48-hour sprint with a strict $50 api budget, this project i…

   Python 2