A collection of command line scripts and utilities

A collection of scripts to download Audible audiobooks.

Scripts for working with PDFs-- comparing PDFs, extracting glyphs, that sort of thing.

Experimenting with some neural OCR models.

A comfy way convert Markdown to (PDF|HTML|whatever) using pandoc and Make.

Reinforcement learning variance comparison under function approximation.

Reinforcement learning algorithms

Markov Decision Processes in Python

Makefiles for common tasks.

Short programs for working with the FLIR Lepton.

Notes on reinforcement learning and related subjects.

Utilities for working with Markov Decision Processes.

Code for working with the iRobot Creates.

Benchmarking for reinforcement learning algorithms.

Experimenting with Emphatic Temporal Difference Learning (ETD) on Random MDPs.

Code for generating a simple wiki-style site using Python and Markdown

Comparison of solutions found by ETD and TD.