Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ENH: Partition Explainer for Video Models #3596

Open
4 of 6 tasks
hex-plex opened this issue Mar 29, 2024 · 0 comments · May be fixed by #3597
Open
4 of 6 tasks

ENH: Partition Explainer for Video Models #3596

hex-plex opened this issue Mar 29, 2024 · 0 comments · May be fixed by #3597
Labels
enhancement Indicates new feature requests

Comments

@hex-plex
Copy link

Problem Description

While DeepExplainer can be better for the problem, with newer black box models demonstrating higher accuracy on Video Classification, Question Answering and Video Captioning, it would be interesting to learn the intrinsic behaviour of these models for Hallucination and susceptibility. I wanted to start out with the basic video classification models but the Image Masker are fixed for 2D inputs and require multiple alterations to adapt for a video.

Alternative Solutions

  • Extend the Partition tree to support video
  • Extend masker and Blur functionalities to support videos
  • Fix internal Plot to support video plotting
  • Optimize for both script/notebook execution

Additional Context

These are 3d plots for the implementation
Figure 12
for the following video
makeup

Feature request checklist

  • I have checked the issue tracker for duplicate issues.
  • I'd be interested in making a PR to implement this feature
@hex-plex hex-plex added the enhancement Indicates new feature requests label Mar 29, 2024
@hex-plex hex-plex linked a pull request Mar 29, 2024 that will close this issue
8 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Indicates new feature requests
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant