Skip to content

Dead Latents

Jump to bottom
Sam edited this page Nov 26, 2025 · 6 revisions

ReLU + L1 sparsity penalty dead units throughout training on FishVista. ReLU + L1 sparsity penalty dead units throughout training on FishVista.

TopK dead units throughout training on FishVista. TopK dead units throughout training on FishVista.

Clone this wiki locally