Can it be applied to multi-classification problems?

[bhdreamer]

for multi-classification, when p = softmax(x), Does GHMC_loss work?

[libuyu]

If applied on softmax cross entropy loss, the form needs modification. We haven't studied this yet. And if you have any good idea, welcome to discuss in mail. :)

[bhdreamer]

If applied on softmax cross entropy loss, the form needs modification. We haven't studied this yet. And if you have any good idea, welcome to discuss in mail. :)
Thanks for your quick reply. I know less about single-stage detector, but I meet similar issues when training text sequence task in NLP.

[xialuxi]

GD(g) = R ind(g) M
code： weights[inds] = tot / num_in_bin
where M？

[libuyu]

@xialuxi hello, M is the "n" in

GHM_Detection/mmdetection/mmdet/core/loss/ghm_loss.py

Line 41 in 0b3917d

n = 0 # n valid bins

and

GHM_Detection/mmdetection/mmdet/core/loss/ghm_loss.py

Line 54 in 0b3917d

weights = weights / n

Sorry for the different notation.

[xialuxi]

Thank you for your explanation.

[xialuxi]

momentum = 1.0

There will be problems with code calculation.

[libuyu]

Since the equation has the form sum[i+1] = mmt * sum[i] + (1 - mmt) * num[i],
momentum should have the range [0, 1). So if momentum = 1.0, the moving average will never be updated and is unresonable.

I will add a line to check if the value of momentum is valid. Thank you.

@xialuxi If you have more questions unrelated to "multi-classification", you'd better open a new issue :)

[xialuxi]

ok

[longchuan1985]

@xialuxi hello, M is the "n" in

GHM_Detection/mmdetection/mmdet/core/loss/ghm_loss.py

Line 41 in 0b3917d

n = 0 # n valid bins

and
GHM_Detection/mmdetection/mmdet/core/loss/ghm_loss.py

Line 54 in 0b3917d

weights = weights / n

Sorry for the different notation.

why the n is not a fixed value, since the bins (or M) is fixed