Expanding linear RNN state-transition matrix eigenvalues to include negatives improves state-tracking tasks and language modeling without added training or inference costs.
-
Updated
Mar 15, 2025 - Python
#
deltanet
Here are 3 public repositories matching this topic...
DeltaProduct is a new linear recurrent neural network architecture that uses products of generalized Householder matrices as state-transition matrices enabling better expressivity, state-tracking, and language modeling performance than DeltaNet.
-
Updated
Jun 6, 2025 - Python
Delta Coin(DTC) erc20 token
-
Updated
Dec 9, 2022 - JavaScript
Improve this page
Add a description, image, and links to the deltanet topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the deltanet topic, visit your repo's landing page and select "manage topics."