Building blocks for foundation models.

Resources for Data Centric AI

Understand and test language model architectures on synthetic tasks.

FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores

Prompt programming with FMs.

Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena

An open science effort to benchmark legal reasoning in foundation models

This repo contains data and code for the paper "Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes"

Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"

Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models