Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Addition of GradCAM visualization option for output visualization of CNNs #15704

Closed
MrinalTyagi opened this issue Nov 25, 2021 · 2 comments
Closed
Assignees
Labels
keras-team-review-pending Pending review by a Keras team member. type:feature The user is asking for a new feature.

Comments

@MrinalTyagi
Copy link

MrinalTyagi commented Nov 25, 2021

System information.

TensorFlow version (you are using): 2.7.0
Are you willing to contribute it (Yes/No) : Yes

Describe the feature and the current behavior/state.
GradCAM visualization is a great algorithm to showcase the activation part of an image from a CNN. As described in this paper(https://arxiv.org/pdf/1610.02391.pdf), it can allow users to visualize the issues their model is making in a more interactive way and fix the models. There are some 3rd party implementations (https://github.com/keisen/tf-keras-vis) but to have them on core API would be great.

Describe the feature clearly here. Be sure to convey here why the requested feature is needed. Any brief description about the use-case would help.

Will this change the current api? How?
Yes, it will change the current API by the addition of a GradCAM visualization function in utils or the addition of a new visualization module itself. Depends on the admins.

Who will benefit from this feature?
It will help users who are using CNN to visualize the issue their model is making in a more interactive way by looking at the class activation map of the image and having a look at which part of the image the model gets activated to predict the class.

Contributing

  • Do you want to contribute a PR? (yes/no): Yes
  • If yes, please read this page for instructions
  • Briefly describe your candidate solution(if contributing): Addition of a single function in utils or a new visualization section in which all these visualization techniques can be included in form of user handy functions.
@MrinalTyagi MrinalTyagi added the type:feature The user is asking for a new feature. label Nov 25, 2021
@MrinalTyagi
Copy link
Author

@jvishnuvardhan Please tell if should proceed with the feature addition or not as I think it will be a great addition to the library

@jvishnuvardhan jvishnuvardhan added the keras-team-review-pending Pending review by a Keras team member. label Nov 29, 2021
@mattdangerw
Copy link
Member

Triage notes: We don't have other visualization on image tools like this and would not want to add them into core Keras at this time. A 3rd party library for visualization on top of Keras seems like the correct place for this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
keras-team-review-pending Pending review by a Keras team member. type:feature The user is asking for a new feature.
Projects
None yet
Development

No branches or pull requests

4 participants