Skip to content

Releases: HuFY-dev/SAELens

Release list

v1.0.0

v1.0.0 Latest
Latest

Choose a tag to compare

View all tags
@github-actions github-actions released this 03 May 12:47
v1.0.0
2da57a1

v1.0.0 (2024-05-03)

Breaking

  • chore: empty commit to bump release

BREAKING CHANGE: v1 release (2615a3e)

Chore

  • chore: fix outdated lr_scheduler_name in docs (decoderesearch#109)

  • chore: fix outdated lr_scheduler_name in docs

  • add tutorial hparams (7cba332)

  • chore: enabling pythong 3.12 checks for CI (25526ea)

  • chore: setting up precommit to be consistent with CI (18e706d)

  • chore: re-enabling isort in CI (decoderesearch#86) (9c44731)

  • chore: improving CI speed (9e3863c)

  • chore: updating README.md with pip install instructions and PyPI badge (682db80)

  • chore: adding more tests to ActivationsStore + light refactoring (cc9899c)

  • chore: running isort to fix imports (53853b9)

  • chore: setting up pyright type checking and fixing typing errors (351995c)

  • chore: enable full flake8 default rules list (19886e2)

  • chore: using poetry for dependency management (465e003)

  • chore: removing .DS_Store files (32f09b6)

Feature

  • feat: add activation bins for neuronpedia outputs, and allow customizing quantiles (decoderesearch#113) (05d650d)

  • feat: Update for Neuropedia auto-interp (decoderesearch#112)

  • cleanup Neuronpedia autointerp code

  • Fix logic bug with OpenAI key

Co-authored-by: Joseph Bloom <69127271+jbloomAus@users.noreply.github.com> (033283d)

  • feat: SparseAutoencoder.from_pretrained() similar to transformer lens (decoderesearch#111)

  • add partial work so David can continue

  • feat: adding a SparseAutoencoder.from_pretrained() function

Co-authored-by: jbloomaus <jbloomaus@gmail.com> (617d416)

  • feat: breaks up SAE.forward() into encode() and decode() (decoderesearch#107)

  • breaks up SAE.forward() into encode() and decode()

  • cleans up return typing of encode by splitting into a hidden and public function (7b4311b)

  • feat: API for generating autointerp + scoring for neuronpedia (decoderesearch#108)

  • API for generating autointerp for neuronpedia

  • Undo pytest vscode setting change

  • Fix autointerp import

  • Use pypi import for automated-interpretability (7c43c4c)

  • feat: make a neuronpedia list with features via api call (decoderesearch#101) (23e680d)

  • feat: Added tanh-relu activation fn and input noise options (decoderesearch#77)

  • Still need to pip-install from GitHub hufy implementation.

  • Added support for tanh_sae.

  • Added notebook for loading the tanh_sae

  • tweaking config options to be more declarating / composable

  • testing adding noise to SAE forward pass

  • updating notebook

Co-authored-by: David Chanin <chanindav@gmail.com> (551e94d)

  • feat: Mamba support vs mamba-lens (decoderesearch#79)

  • mamba support

  • added init

  • added optional model kwargs

  • Support transformers and mamba

  • forgot one model kwargs

  • failed opts

  • tokens input

  • hack to fix tokens, will look into fixing mambalens

  • fixed checkpoint

  • added sae group

  • removed some comments and fixed merge error

  • removed unneeded params since that issue is fixed in mambalens now

  • Unneded input param

  • removed debug checkpoing and eval

  • added refs to hookedrootmodule

  • feed linter

  • added example and fixed loading

  • made layer for eval change

  • fix linter issues

  • adding mamba-lens as optional dep, and fixing typing/linting

  • adding a test for loading mamba model

  • adding mamba-lens to dev for CI

  • updating min mamba-lens version

  • updating mamba-lens version

Co-authored-by: David Chanin <chanindav@gmail.com> (eea7db4)

  • feat: support orthogonal decoder init and no pre-decoder bias (ac606a3)

  • feat: add basic tutorial for training saes (1847280)

  • feat: overhaul saving and loading (004e8f6)

  • feat: release (c70b148)

Fix

  • fix: replace list_files_info with list_repo_tree (decoderesearch#117) (676062c)

  • fix: Improved activation initialization, fix using argument to pass in API key (decoderesearch#116) (7047bcc)

  • fix: pin pyzmq==26.0.1 temporarily (0094021)

  • fix: typing issue, temporary (25cebf1)

  • fix: sae dict bug (484163e)

  • fix: session loader wasn't working (a928d7e)

  • fix: dense batch dim mse norm optional (8018bc9)

  • fix: neuronpedia quicklist (6769466)

  • fix: removing paths-ignore from action to avoid blocking releases (28ff797)

  • fix: updating saevis version to use pypi (dbd96a2)

Unknown

  • BREAKING CHANGE: 1.0.0 release

BREAKING CHANGE: 1.0.0 release (c23098f)

Improvements to Neuronpedia Runner (5118f7f)

  • neuronpedia: save run settings to json file to avoid errors when resuming later. automatically skip batch files that already exist (4b5412b)

  • skip batch file if it already exists (7d0e396)

  • neuronpedia: include log sparsity threshold in skipped_indexes.json (5c967e7)

  • Update proposal.md (6d45b33)

  • Merge pull request decoderesearch#96 from jbloomAus/github-templates

add templates for PR's / issues (241a201)

  • add templates for PR's / issues (74ff597)

  • Merge pull request decoderesearch#95 from jbloomAus/load-state-dict-not-strict

Make load_state_dict use strict=False (4a9e274)

  • fix accidental bug (c22fbbd)

  • fix load pretrained legacy with state dict change (b5e97f8)

  • Make load_state_dict use strict=False (fdf7fe9)

  • Merge pull request decoderesearch#94 from jbloomAus/update-pre-commit

chore: setting up precommit to be consistent with CI (6a056b7)

Adds function that converts old .pt pretrained SAEs to new folder format (1cb1725)

chore: enabling python 3.12 check...

Read more
Assets 2
Loading