This repository contains experiments for Mamba and its performance on the long range arena (LRA) tasks, as well as a few other experiments related to Mamba.
A lot of the LRA code is taken from the repository not-from-scratch and Long-Range-Arena. We furthermore use the Mamba block from the Mamba paper.
A comprehensive summary of our results can be found in the article and a very brief summary in the presentation slides.