Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluation of models based on mmflow #313

Closed
luis2r opened this issue Jun 6, 2022 · 2 comments
Closed

Evaluation of models based on mmflow #313

luis2r opened this issue Jun 6, 2022 · 2 comments

Comments

@luis2r
Copy link

luis2r commented Jun 6, 2022

I am using a model based on mmflow for the stereo challenge but I was not able to use the evaluation script provided for this challenge. So I adapted my evaluation script based on yours but I was not able to calculate two parameters:
flops = FlopCountAnalysis(model, inputs)
activations = ActivationCountAnalysis(model, inputs)
due to mmflow input format. Are my results acceptable without reporting flops and activations? Can you create a script to evaluate models based on mmflow?

@jhonykaesemodel
Copy link
Contributor

Hi Luis, thanks for reaching out.
Yes, please submit your results without flops and activations for now. We'll consider it.
I'll take a look at mmflow in the future and see if we can adapt to it.

@luis2r
Copy link
Author

luis2r commented Jun 6, 2022

Thank you @jhonykaesemodel

@luis2r luis2r closed this as completed Jun 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants