Skip to content

Limen-Neural/engram-parser

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 

Repository files navigation

engram-parser

Main role: Become an percise brain surgeon for Mixture-of Experts (MoE) layers, and extract the raw weights. This is gonna I am going learn much more about MoE architecture and how to extract the weights from it.

Engram Conversion from Static to Voltage: All about F16-FP32 casting logic belongs and quantization logic. Uses the static weight matrices and converts them into the exact "engram"structure-the raw voltage vectors-that the SNN requires.

About

An engram is the physical or biochemical trace of a memory in the brain. Extracting frozen "memories" (weights) from an MoE to feed into a live spiking network. Current formula—score = membrane - (adaptation_scale * adaptation)—is essentially a hardware-native way of performing dynamic range clipping.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors