Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MVP example for model validation every N training steps #40

Closed
pdogra89 opened this issue Jan 24, 2020 · 3 comments · Fixed by #66 or #73
Closed

MVP example for model validation every N training steps #40

pdogra89 opened this issue Jan 24, 2020 · 3 comments · Fixed by #66 or #73
Assignees
@wyli @atbenmurray @Nic-Ma
Projects
MONAI MVP

Comments

@pdogra89
Copy link

-Depends on task 2

  • Minimal evaluation metrics interface (or using ignite.metrics?)
    -Event handler for model validation and early stopping
@pdogra89 pdogra89 created this issue from a note in MONAI MVP (To Do (MVP - 24th Jan)) Jan 24, 2020
@Nic-Ma Nic-Ma mentioned this issue Feb 8, 2020
Merged
4 tasks
@Nic-Ma
Copy link
Contributor

Nic-Ma commented Feb 8, 2020

Hi @madil90 ,

I already submitted PR #66 to support mean_dice metric, could you please help add the validator handler and early-stop for training example based on ignite?
Thanks in advance.

@madil90
Copy link
Contributor

madil90 commented Feb 8, 2020

Sure. I can add these over the weekend.

@Nic-Ma
Copy link
Contributor

Nic-Ma commented Feb 9, 2020

Hi @madil90 ,

Thanks, I also update the PR to support both multi-labels and multi-classes outputs.

@wyli wyli closed this as completed in #66 Feb 10, 2020
MONAI MVP automation moved this from To Do (MVP) to Done (MVP) Feb 10, 2020
@wyli wyli reopened this Feb 10, 2020
MONAI MVP automation moved this from Done (MVP) to To Do (MVP) Feb 10, 2020
@wyli wyli moved this from To Do (MVP) to In progress in MONAI MVP Feb 11, 2020
@madil90 madil90 mentioned this issue Feb 12, 2020
Merged
4 tasks
@wyli wyli moved this from In progress to To be merged (MVP) in MONAI MVP Feb 13, 2020
MONAI MVP automation moved this from To be merged (MVP) to Done (MVP) Feb 13, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@wyli wyli

@atbenmurray atbenmurray

@Nic-Ma Nic-Ma

Labels
None yet
Projects
No open projects
MONAI MVP
  
Done (MVP)
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

40 mean_dice metric Project-MONAI/MONAI
40-validation-early-stop Project-MONAI/MONAI
5 participants
@wyli @madil90 @atbenmurray @Nic-Ma @pdogra89