Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ENH: eval should log computed metrics to screen #471

Closed
NickleDave opened this issue Mar 15, 2022 · 0 comments
Closed

ENH: eval should log computed metrics to screen #471

NickleDave opened this issue Mar 15, 2022 · 0 comments
Labels
ENH: enhancement enhancement; new feature or request
Projects

Comments

@NickleDave
Copy link
Collaborator

To get an initial sense of performance before loading .csv.

Currently the logger just reports that eval metrics were saved, as shown below

$ vak eval data/configs/gy6or6_eval.toml 
Logging results to results/gy6or6_eval
loading spect scaler from path: results/gy6or6_train/results_220315_122127/StandardizeSpect
loading labelmap from path: results/gy6or6_train/results_220315_122127/labelmap.json
creating dataset for evaluation from: data/prep/has_notmat_prep_220315_123036.csv
running evaluation for model: TweetyNet
Loading checkpoint from:
results/gy6or6_train/results_220315_122127/TweetyNet/checkpoints/max-val-acc-checkpoint.pt 
batch 206 / 207: 100%|███████████████████████████████████████████| 207/207 [00:06<00:00, 33.76it/s]
saving csv with evaluation metrics at: results/gy6or6_eval/eval_TweetyNet_220315_130531.csv
@NickleDave NickleDave added the ENH: enhancement enhancement; new feature or request label Mar 15, 2022
@NickleDave NickleDave added this to To do in ENH Dec 25, 2022
@NickleDave NickleDave moved this from To do to In progress in ENH Feb 9, 2023
@NickleDave NickleDave moved this from In progress to Done in ENH Feb 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ENH: enhancement enhancement; new feature or request
Projects
ENH
Done
Development

No branches or pull requests

1 participant