Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add PartitionSHAP or other fast attribution method #1229

Open
LennardZuendorf opened this issue Jan 2, 2024 · 0 comments
Open

Add PartitionSHAP or other fast attribution method #1229

LennardZuendorf opened this issue Jan 2, 2024 · 0 comments

Comments

@LennardZuendorf
Copy link

LennardZuendorf commented Jan 2, 2024

馃殌 Feature

Please consider adding PartitionSHAP
(or another fast attribution method)

Motivation

The currently available attribution methods run very long for large models like llama2 or mistral.

Pitch

The PartitionSHAP implementation from shap runs only minutes on a model like Mistral or GPT-2.

It is their best-performing explainer (runtime-wise), especially for text generation. It runs significantly quicker than any other method. The attributions are a bit less accurate the performance is very good.

As far as I know, it's the fastest model-agnostic explanation approach. Anything else using owen values should also be very fast.

Alternatives

  • Any other super quick attribution method would be very welcome 馃槃
  • I've listed fastSHAP below, which is also very fast but not proven on any LLMs.

Additional context

This is the PartitionSHAP implementation from the shap package. There's also fastSHAP, though I am not sure how applicable it would be to LLMs.

@LennardZuendorf LennardZuendorf changed the title Add PartitionSHAP (owen based calculation of SHAP values) Add PartitionSHAP or other fast attribution method Jan 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant