Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

It's better to distinguish "Micro-AUC" and "Macro-AUC" #12

Closed
zugexiaodui opened this issue Jun 6, 2022 · 2 comments
Closed

It's better to distinguish "Micro-AUC" and "Macro-AUC" #12

zugexiaodui opened this issue Jun 6, 2022 · 2 comments

Comments

@zugexiaodui
Copy link

In Table "Performance Comparison on ShanghaiTech", the AUC of SSMT is 90.2 as reported in its paper. However, the authors use the so called "Macro-AUC" (https://github.com/lilygeorgescu/AED-SSMTL#evaluation), which is not the way to calculate AUC in other papers. It's better to distinguish the two metrics.
Also, it is not the first time the authers of SSMT use Macro-AUC. In their previous papers, e.g. "Object-centric Auto-encoders and Dummy Anomalies for Abnormal Event Detection in Video", they use this metric and actually cause unfair comparisons.

@fjchange
Copy link
Owner

Thanks for your advice. I'll try to make the reported results "Micro-AUC", which is used more commonly.

@fjchange
Copy link
Owner

The table has been updated. If any other advice, feel free to raise another issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants