Skip to content

BerenMillidge/svd_directions

main
Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 

svd_directions

The data and notebook for the SVD directions LW post.

The accompanying google colab notebook can be found here: https://colab.research.google.com/drive/1G5e5I6zEKZUkuV6DR3yZEhiCoWCTLQdh?usp=sharing

The data consisting of the npy files of correct directions for the autolabelling experiments as well as json files of all prompts and model responses can be found in the data folder. The PySvelte code for the visualizations can be found in the visualizations folder (to get these visualizations working outside of the notebook, you will need to install pysvelte (from here and copy across the files. You can see how to do so in the installation cell in the notebook.

Setup:

  • You will need node, npm and pytorch installed before running the notebook.
  • Other dependencies should be installed by running ./setup.sh - this installs python dependencies and PySvelte for visualizations.

About

Repository for the SVD directions less wrong post

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published