[AUTO-MERGE] Updating the MLFlow backend from file to sqlite-based.#781
[AUTO-MERGE] Updating the MLFlow backend from file to sqlite-based.#781
Conversation
There was a problem hiding this comment.
Pull request overview
Updates Hyrax’s MLflow tracking configuration to avoid the deprecated filesystem backend by switching the tracking URI to a SQLite database under the configured results root directory.
Changes:
- Switch MLflow tracking URI in
traintosqlite://.../mlflow/mlflow.db. - Switch MLflow tracking URI in
testtosqlite://.../mlflow/mlflow.db.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.
| File | Description |
|---|---|
src/hyrax/verbs/train.py |
Points MLflow tracking to a SQLite DB under the results root. |
src/hyrax/verbs/test.py |
Points MLflow tracking to the same SQLite DB under the results root. |
You can also share your feedback on Copilot code review. Take the survey.
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #781 +/- ##
==========================================
+ Coverage 64.71% 64.73% +0.01%
==========================================
Files 61 61
Lines 5887 5890 +3
==========================================
+ Hits 3810 3813 +3
Misses 2077 2077 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
|
@copilot make the changes that are mentioned in the two comments, and be sure that the change is consistent in both train.py and test.py. Eventually we would like to abstract that logic out, but not in this PR. |
|
@drewoldag I've opened a new pull request, #782, to work on those changes. Once the pull request is ready, I'll request review from you. |
* Initial plan * Create mlflow directory before setting SQLite tracking URI in train and test Co-authored-by: drewoldag <47493171+drewoldag@users.noreply.github.com> --------- Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: drewoldag <47493171+drewoldag@users.noreply.github.com>
Click here to view all benchmarks. |
Change Description
Closes #780
Solution Description
Updating the default location for MLflow metrics to be tracked. Using SQLite database now instead of file-backed storage.
See this migration guide: https://mlflow.org/docs/latest/self-hosting/migrate-from-file-store