Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

06_multiclass accuracy_multi plot #281

Closed
grayskripko opened this issue Oct 2, 2020 · 9 comments
Closed

06_multiclass accuracy_multi plot #281

grayskripko opened this issue Oct 2, 2020 · 9 comments

Comments

@grayskripko
Copy link

In cell 35, there is a plot

image
Do I understand right that we have values of activations on the x-axis, not probabilities, as well as we pick sigmoid=False?
If so, why do limited with 0 and 1? Is it an unintentional error and they should have wide ranges?

@TannerGilbert
Copy link
Contributor

Actually the x axis are the values generated by linespace (20 points from 0.05 to 0.95 as specified in the first row). The y axis represents the accuracy calculated with accuracy_multi. The reason sigmoid is set to false is that get_preds by default already applies the activation function as mentioned in the text above cell 34.

@grayskripko
Copy link
Author

grayskripko commented Oct 5, 2020

thank you @TannerGilbert for explanations.
To be honest, I did understand everything you said.
I understand the idea of linespace as well as the idea of sigmoid argument.

Could you please help me answer the questions below in the form they are formulated?
Thank you.

@TannerGilbert
Copy link
Contributor

@grayskripko I'm not sure which questions you mean.

@grayskripko
Copy link
Author

@TannerGilbert I meant "questions above" :)
Are there probabilities on the x-axis?

@TannerGilbert
Copy link
Contributor

No, on the x-axis there are 29 points from 0.05 to 0.95 (created with linspace).

linspace_output

@grayskripko
Copy link
Author

@TannerGilbert yep, they are points. I clearly understand it. On the other hand, they have meaning. So each point is an observation of 2 features. The second dimension of each point, the y-axis, is the accuracy. The first dimension is threshold of "X".
What is X?

@TannerGilbert
Copy link
Contributor

The y-axis represents the accuracy and the x-axis represents the threshold used for the accuracy_multi method.

e.g. if you have three classes [car, dog, human], the threshold is 0.8 and your model outputs [0.9, 0.3, 0.85] you can say that you have a car and human in your image.

In the code in cell 35 we're trying out different threshold values to see which one gives the best accuracy for the task.

@grayskripko
Copy link
Author

grayskripko commented Oct 8, 2020

@TannerGilbert

your model outputs [0.9, 0.3, 0.85]

So it's a threshold of activations, not a threshold of probabilities, right?

@grayskripko
Copy link
Author

I understood, finally. Out predicted activations were "sigmoided" before, so they are probabilities.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants