Skip to content

v0.2.0

Latest
Compare
Choose a tag to compare
@github-actions github-actions released this 18 Jul 17:03
· 13 commits to main since this release

Breaking changes

  • The from from_model_and_pretrained interface has been updated to take remove the slice option this has been moved to its own method slice_sequence method.

New features

  • Integration with transformer lens #103

    • This is probably the biggest new feature. We now support directly producing a PredictionTrajectory from a lens and an ActivationCache.
    • This means that you can visualize the effects of interventions made using the fantastic TransformerLens library using the full set of tools that come with the tuned-lens project.
    • There is a tutorial discussing this integration here
  • Rank visualization #105

    • Like in the original logit lens blog post we now support easily visualizing the rank of the target token in the prediction distribution. See

Full Changelog: v0.1.1...v0.2.0