Popular repositories Loading

1. heinsen_routing heinsen_routing Public

   Reference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All Domains" (Heinsen, 2019), for composing deep neural networks.

   Python 169 17

2. heinsen_sequence heinsen_sequence Public

   Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)

   92 4

3. git-gpg git-gpg Public archive

   Use git on an untrusted server via a GPG-encrypted repository.

   Python 33 4

4. heinsen_attention heinsen_attention Public

   Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)

   Python 24 1

5. heinsen_tree heinsen_tree Public

   Reference implementation of "Tree Methods for Hierarchical Classification in Parallel" (Heinsen, 2022) in PyTorch.

   Python 14

6. heinsen_position_embeddings heinsen_position_embeddings Public

   Reference implementation of "Encoding Position by Decaying and Updating Different Exponentiated States Differently," as proposed by Franz A. Heinsen in March 2024

   Python 5