Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Evaluation] - Support multiple splits #244

Open
JuanSeBestia opened this issue Nov 13, 2018 · 1 comment
Open

[Evaluation] - Support multiple splits #244

JuanSeBestia opened this issue Nov 13, 2018 · 1 comment

Comments

@JuanSeBestia
Copy link

JuanSeBestia commented Nov 13, 2018

Feature Request

I want to obtain the evaluation of different datasets of a single job
lumi eval -h && lumi eval -c config_ssd.yml --split valid --split train --split test --watch --from-global-step 0

I understand that it is not so trivial because it was being kept as a summary of work scalars like this
image

sounds very crazy?

@dekked
Copy link
Member

dekked commented Nov 16, 2018

It's doable, and not crazy, to support multiple splits!

This looks to be a good first issue for contributing 🕺

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants