This repository documents a seven-round investigation into whether alternative computational geometries can improve upon the standard dot-product attention mechanism used in transformer language models.

Experiments in Non-Euclidean Geometry for Language Models