Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about the evidential loss term in Eq.(1) #1

Closed
HeimingX opened this issue Dec 5, 2021 · 2 comments
Closed

Question about the evidential loss term in Eq.(1) #1

HeimingX opened this issue Dec 5, 2021 · 2 comments

Comments

@HeimingX
Copy link

HeimingX commented Dec 5, 2021

Dear authors,

Thanks a lot for the interesting paper and open-resourced repo.

It is awesome to incorporate the evidential deep learning (EDL) trick into action recognition task. But I have a question about the EDL loss term, i.e., Eq. (1) in DEAR paper. In this repo, the EDL loss with log function is set to be the default choice for running DEAR algorithm. I wonder if the digamma function can work properly? For me, I have conducted some experiments about training a EDL loss with digamma function on CIFAR100 dataset (based on the implementation in this repo) and I just found that the EDL loss term decreases quite hard and slow and the model does not get well optimized. I am curious if it happens to you?

Look forward to you response.

Best,
Haiming

@Cogito2012
Copy link
Owner

@HeimingX Thanks for your interest in this work!
I encountered the same problem as yours. In my early trial, the digamma form was set as the default, but the model can hardly be trained no matter how I change the evidence function or tune training hyperparameters. I guess it is more difficult in optimization with the digamma function than the logarithm.

For the image dataset, I guess you could try the original implementation of EDL in https://github.com/dougbrion/pytorch-classification-uncertainty.

@HeimingX
Copy link
Author

HeimingX commented Dec 5, 2021

Hi, thanks a lot for the prompt response and kind suggestions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants