AttriBoT: A Bag of Tricks for Efficiently Approximating Leave-One-Out Context Attribution

Install

pip install -e .

Installs the package in editable mode.

Example Usage

See example/example.py for an example which runs attribution with the specified model and attribution method (e.g., LOO, hierarchical, pruning) and prints the attribution results as a dataframe.

Leave-One-Out With Key-Value Cache:

python example/example.py --input example/aurora.json --dtype float16 --use-cache loo --model-name meta-llama/Llama-3.2-1B-Instruct

Hierarchical Attribution

python example/example.py --input example/aurora.json --dtype float16 --use-cache hierarchical --model-name meta-llama/Llama-3.2-1B-Instruct --keep-paragraphs 3

Proxy Model Pruning

python example/example.py --input example/aurora.json --dtype float16 --use-cache proxy --proxy-model-name meta-llama/Llama-3.2-1B-Instruct --target-model-name meta-llama/Llama-3.2-3B-Instruct

Proxy Model Pruning

python example/example.py --input example/aurora.json --dtype float16 --use-cache pruning --pruning-model-name meta-llama/Llama-3.2-1B-Instruct --rescoring-model-name meta-llama/Llama-3.2-3B-Instruct --keep-sentences 3

The code has been tested with Llama 3, Qwen 2, Mistral families.