-
Notifications
You must be signed in to change notification settings - Fork 331
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Locating DVC Report #31
Comments
Quick followup: I found the reports once I made a PR! I think we may have to make it very clear in the docs that the report is made when a PR occurs, not automatically whenever a GitHub action runs (which is what I expected). Also, how can we generate a report comparing commits on the same branch? I might change some hyperparameters of my ML model on a single branch, rather than making a separate branch and PR for each experiment with a different set of hyperparameters. What makes sense for this case? |
Cool, thanks for pointing these out! One note on the Commits view: Only the commits with the message "dvc repro [ci skip]" generate a DVC report. As a person new to CI/CD, this was a bit confusing. Would it make sense to save the commit message as "Generate DVC report", or otherwise tag these commits somehow so I know to look here for the report? |
Thanks to you to point this to improve the docs!
every commit generates a DVC Report, if repro does not have reason to run DVC-cml still generates a report (if you click the green arrow you will see two reports).
It's a very nice idea. @shcheklein @dmpetrov ? |
like it! the only minor suggestion is to start with |
Good idea! I'd not use |
Now reports can be found as Github Checks or Github/Gitlab commit comments that appears in the PR/MR workflow or commit overview page. |
I've been able to make changes to my code, and then
git commit & git push
to initiate model retraining in the mnist example from the Wiki. For some reason, though, I'm not seeing reports visible.Here's a screenshot from a case where I made a new branch
mybranch
, changed the learning rate, and pushed. The CI ran, but no sign of a report. Any ideas?The text was updated successfully, but these errors were encountered: