Expanding linear RNN state-transition matrix eigenvalues to include negatives improves state-tracking tasks and language modeling without added training or inference costs.
-
Updated
Mar 15, 2025 - Python
Expanding linear RNN state-transition matrix eigenvalues to include negatives improves state-tracking tasks and language modeling without added training or inference costs.
DeltaProduct is a new linear recurrent neural network architecture that uses products of generalized Householder matrices as state-transition matrices enabling better expressivity, state-tracking, and language modeling performance than DeltaNet.
Seamlessly track the visibility state of your document across different browsers. Know when your users switch to another window or tab.
Add a description, image, and links to the state-tracking topic page so that developers can more easily learn about it.
To associate your repository with the state-tracking topic, visit your repo's landing page and select "manage topics."