Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use sigmod or tempered_sigmoid for prediction? #12

Closed
jamesguoxin opened this issue Dec 19, 2021 · 4 comments
Closed

Use sigmod or tempered_sigmoid for prediction? #12

jamesguoxin opened this issue Dec 19, 2021 · 4 comments

Comments

@jamesguoxin
Copy link

Dear authors,

I'm encountering an issue regarding to the prediction phase. Assume we use bi_tempered_binary_logistic_loss as our loss function, should we still use sigmod as function used for probability calculation, or we should use tempered_sigmoid? Thanks for clarification!

@eamid
Copy link
Collaborator

eamid commented Dec 19, 2021

You should use the tempered_sigmoid function to calculate the class probabilities. However, to predict the class, you don't need to form the probabilities (i.e. pick the class with the larger logit value).

@jamesguoxin
Copy link
Author

Hello eamid,

Thank you for your reply. In our case, we would like to extract the probability to calculate AUC for the prediction. So for the t parameter in tempered_sigmoid, we should keep it consistent with bi_tempered_binary_logistic_loss t1?

@eamid
Copy link
Collaborator

eamid commented Dec 20, 2021

It should be consistent with t2. The other temperature t1 controls the boundedness of the loss

@jamesguoxin
Copy link
Author

I see, thank you eamid!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants