Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release of mask RCNN and multi head FisherPruning #14

Open
itsMorteza opened this issue Oct 29, 2021 · 6 comments
Open

Release of mask RCNN and multi head FisherPruning #14

itsMorteza opened this issue Oct 29, 2021 · 6 comments

Comments

@itsMorteza
Copy link

Hi, The loss in Groups is computed based on bbox loss; what is the best way to integrate it with mask loss? Thanks,
image

@liyangliu
Copy link

The loss is as usual, I think you can use the normal mask loss such as BCE.

@itsMorteza
Copy link
Author

I used forward_dummy format from mmdetection with using another fork however, it couldn't compute fisher in backward format(tensor size problem). is there any good implementation for two stage detector or segmentation loss? Thanks,
image

@mls1999725
Copy link

I used forward_dummy format from mmdetection with using another fork however, it couldn't compute fisher in backward format(tensor size problem). is there any good implementation for two stage detector or segmentation loss? Thanks, image

Hi, I have meet the same problem when compute fisher of faster rcnn. Have you solved this problem?

@itsMorteza
Copy link
Author

Unfortunately, no. Even with trial and error, the pruned model couldn't be fine-tuned. the problem initiated with the multi-pass loss; then it couldn't find the whole ancestors very well to make groups.

@liyangliu
Copy link

Have you checked whether all the layers that are supposed to be in one group are gathered correctly by the algorithm?

@itsMorteza
Copy link
Author

Inside compute fisher backward hook it couldn't update temp fisher info for mask head and linear side wherein the temp fisher info is not same as the result of computing fisher.
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants