induction

Causal scrubbing experiments on induction heads in various transformers.

Name		Name	Last commit message	Last commit date
Latest commit History 120 Commits
data		data
results		results
saved_figs		saved_figs
saved_logs/qk		saved_logs/qk
supsub		supsub
.gitignore		.gitignore
README.md		README.md
activations.py		activations.py
all.py		all.py
attn_weights.py		attn_weights.py
attns_cui.py		attns_cui.py
circuit_sub_all.txt		circuit_sub_all.txt
circuit_subbed.txt		circuit_subbed.txt
compare.py		compare.py
evaluate.py		evaluate.py
experiments.py		experiments.py
fuzzy.py		fuzzy.py
get_data.py		get_data.py
logs.csv		logs.csv
main.py		main.py
masks.py		masks.py
model.py		model.py
pairwise.py		pairwise.py
parrot.py		parrot.py
results.ipynb		results.ipynb
saa_cui.py		saa_cui.py
subspaces.py		subspaces.py
utils.py		utils.py
weights.py		weights.py

Provide feedback