v0.4.0

New Feature: Attribution Targets

Previously, circuit-tracer only allowed attribution back from either the top-n tokens or those tokens representing top-p of probability mass. Now, you can attribute back from a wider set of quantities! These include:

• Arbitrary tokens (as specified by either a list of token strings or tensor of token ids)
• Arbitrary d-model-size vectors (such as the difference between two logits' unembedding vectors)

Want to know more? Check out demos/attribution_targets_demo.ipynb

Thank a bunch to @speediedan for contributing this awesome feature!

Minor changes

• For GemmaScope-2 Transcoders and Gemma-3-IT models, prompts now must start with <bos><start_of_turn>user\n; otherwise, an error will be thrown.
• Circuit-tracer is now officially part of decode research! (thanks @hijohnnylin)
• Circuit-tracer's version in the pyproject.toml has been updated to match the tag (thanks @hijohnnylin!)