High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

Data-Driven NetHack Tools: Datasets (30+) and recurrent-baselines (AWAC, BC, CQL, IQL, REM)

High-quality single-file implementations of SOTA Offline and Offline-to-Online RL algorithms: AWAC, BC, CQL, DT, EDAC, IQL, SAC-N, TD3+BC, LB-SAC, SPOT, Cal-QL, ReBRAC

A curated list of resources for using LLMs to develop more competitive grant applications.

Online Bayesian Rate Estimation Theory

A library for seamless data logging, communication and control for Internet of Things

ESP8266 WiFi Connection manager with web captive portal

Log data from an ESP8266 device directly to Google Sheets without a third party service. Log sensor data, send data by pressing a button, and receive data from a Google spreadsheet. (NodeMCU, Wemos…

Resources to calculate how to become a carbon neutral lab.

A demonstration of the attention mechanism with some toy experiments and explanations.

Simple (but often Strong) Baselines for POMDPs in PyTorch, ICML 2022

🎨 A ridiculously elegant Jekyll theme.

Left is a clean, whitespace-happy layout for Jekyll.

CATNIP Laboratory website

Can stream an ~20 minutes ASCII movie via Telnet emulation as stand alone server or via xinetd daemon. Using famous ASCII art animation from www.asciimation.co.nz (Star ASCIIMATION Wars)

A collision detection library for 2D geometry in p5.js

A project to train a neural network to play Checkers through self-play combined with Monte Carlo Tree Search.

A clean implementation based on AlphaZero for any game in any framework + tutorial + Othello/Gobang/TicTacToe/Connect4 and more

Talk to ChatGPT AI using your voice and listen to its answers through a voice

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous …

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

A command line tool that recreates the famous data decryption effect seen in the 1992 movie Sneakers.

A package to train neural networks to perform various motor tasks

Analysis tools and models of mouse behavior in a two-armed bandit task as described in Beron et al., 2022

A collaboration friendly studio for NeRFs

Robust Speech Recognition via Large-Scale Weak Supervision

A curated collection of neuroscience tasks with a common interface.