Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[trainer] Add a loss recorder option #241

Closed
Tracked by #205
frgfm opened this issue Aug 28, 2022 · 0 comments · Fixed by #243
Closed
Tracked by #205

[trainer] Add a loss recorder option #241

frgfm opened this issue Aug 28, 2022 · 0 comments · Fixed by #243

Comments

@frgfm
Copy link
Owner

frgfm commented Aug 28, 2022

Once a model has been trained, it would be nice to analyze its main failures. For that, one could:

  • go through the training set computing the loss (unreduced on the batch dimension)
  • keep the N samples with the highest loss
  • plot the image, the loss, the prediction and the target

A later option would be to display the CAM to better understand the model behaviour.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant