Pinned Loading

1. cactus-compute/cactus cactus-compute/cactus Public

   Framework for running AI locally on mobile devices and wearables. Hardware-aware C/C++ backend with wrappers for Flutter & React Native. Kotlin & Swift coming soon.

   C++ 903 50

2. nanodl nanodl Public

   A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.

   Python 287 11

3. cuda-tutorials cuda-tutorials Public

   CUDA tutorials for Maths & ML tutorials with examples, covers multi-gpus, fused attention, winograd convolution, reinforcement learning.

   Cuda 182 5

4. super-lazy-autograd super-lazy-autograd Public

   Hand-derived memory-efficient super lazy PyTorch VJPs for training LLMs on laptop, all using one op (bundled scaled matmuls).

   Python 59 1

5. pete pete Public

   Parameter-efficient transformer embeddings replace learned embeddings with hardware-aware polynomial expansions of token IDs.

   Python 7

6. tango tango Public

   Decentralised ML engine, where tiny edge devices like smart watches, phones, VR headsets, game consoles etc., could contribute.

   Go 1