Skip to content
@HazyResearch

HazyResearch

We are a CS research group led by Prof. Chris Ré.

Pinned Loading

  1. ThunderKittens Public

    Tile primitives for speedy kernels

    Cuda 2.3k 139

  2. hyena-dna Public

    Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena

    Assembly 670 92

  3. minions Public

    Big & Small LLMs working together

    Python 727 92

  4. based Public

    Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"

    Python 232 14

Repositories

Showing 10 of 119 repositories
  • ThunderKittens Public

    Tile primitives for speedy kernels

    Cuda 2,310 MIT 139 32 12 Updated May 1, 2025
  • minions Public

    Big & Small LLMs working together

    Python 727 MIT 92 3 12 Updated May 1, 2025
  • hyena-dna Public

    Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena

    Assembly 670 Apache-2.0 92 31 6 Updated Apr 22, 2025
  • precision-ls Public
    Python 6 MIT 5 0 0 Updated Mar 18, 2025
  • zoology Public

    Understand and test language model architectures on synthetic tasks.

    Python 194 Apache-2.0 31 2 1 Updated Mar 6, 2025
  • based Public

    Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"

    Python 232 Apache-2.0 14 4 0 Updated Feb 17, 2025
  • lolcats Public

    Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"

    Python 231 Apache-2.0 24 7 0 Updated Jan 31, 2025
  • aioli Public

    Aioli: A unified optimization framework for language model data mixing

    Jupyter Notebook 25 Apache-2.0 4 1 0 Updated Jan 17, 2025
  • flash-fft-conv Public

    FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores

    C++ 316 Apache-2.0 28 18 (1 issue needs help) 3 Updated Dec 28, 2024
  • m2 Public

    Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"

    Assembly 549 Apache-2.0 41 25 2 Updated Dec 28, 2024