Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Modularize autologging utilities #4216

Merged
merged 17 commits into from
Mar 31, 2021
Merged

Modularize autologging utilities #4216

merged 17 commits into from
Mar 31, 2021

Conversation

dbczumar
Copy link
Collaborator

@dbczumar dbczumar commented Mar 30, 2021

What changes are proposed in this pull request?

This PR modularizes our autologging utilities, decomposing mlflow.utils.autologging_utils into 3 submodules: events, versioning, and safety. It also removes the leading underscore (_) prefix from certain autologging utilities that are consumed outside of the module in which they're defined.

How is this patch tested?

Unit tests

Release Notes

Is this a user-facing change?

  • No. You can skip the rest of this section.
  • Yes. Give a description of this change to be included in the release notes for MLflow users.

What component(s), interfaces, languages, and integrations does this PR affect?

Components

  • area/artifacts: Artifact stores and artifact logging
  • area/build: Build and test infrastructure for MLflow
  • area/docs: MLflow documentation pages
  • area/examples: Example code
  • area/model-registry: Model Registry service, APIs, and the fluent client calls for Model Registry
  • area/models: MLmodel format, model serialization/deserialization, flavors
  • area/projects: MLproject format, project running backends
  • area/scoring: Local serving, model deployment tools, spark UDFs
  • area/server-infra: MLflow server, JavaScript dev server
  • area/tracking: Tracking Service, tracking client APIs, autologging

Interface

  • area/uiux: Front-end, user experience, JavaScript, plotting
  • area/docker: Docker use across MLflow's components, such as MLflow Projects and MLflow Models
  • area/sqlalchemy: Use of SQLAlchemy in the Tracking Service or Model Registry
  • area/windows: Windows support

Language

  • language/r: R APIs and clients
  • language/java: Java APIs and clients
  • language/new: Proposals for new client languages

Integrations

  • integrations/azure: Azure and Azure ML integrations
  • integrations/sagemaker: SageMaker integrations
  • integrations/databricks: Databricks integrations

How should the PR be classified in the release notes? Choose one:

  • rn/breaking-change - The PR will be mentioned in the "Breaking Changes" section
  • rn/none - No description will be included. The PR will be mentioned only by the PR number in the "Small Bugfixes and Documentation Updates" section
  • rn/feature - A new user-facing feature worth mentioning in the release notes
  • rn/bug-fix - A user-facing bug fix worth mentioning in the release notes
  • rn/documentation - A user-facing documentation change worth mentioning in the release notes

Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: dbczumar <corey.zumar@databricks.com>
@github-actions github-actions bot added rn/none List under Small Changes in Changelogs. area/tracking Tracking service, tracking client APIs, autologging labels Mar 30, 2021
Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: dbczumar <corey.zumar@databricks.com>
@@ -0,0 +1,227 @@
import warnings
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Moved AutologgingEventLogger verbatim from mlflow/utils/autologging_utils/__init__.py.

@@ -0,0 +1,734 @@
import abc
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Moved safe_patch, exception-safe class/function, and other autologging safety utilities from mlflow/utils/autologging_utils/__init__.py. Moved _is_testing to is_testing since it's used outside of the autologging_utils module.

@@ -0,0 +1,50 @@
import importlib
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Moved supported version checking / validation logic from mlflow/utils/autologging_utils/__init__.py and updated some docstrings & variable / method names.

Copy link
Collaborator

@apurva-koti apurva-koti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not a blocking comment but this is just one of those PRs that's kind of author-heavy; the split looks good but the actual git diff is super hard to parse. So as long as this pr is cutting/pasting with import changes to match we should be good. (and tests pass of course)

@dbczumar
Copy link
Collaborator Author

Thanks for sifting through this @apurva-koti !

@dbczumar dbczumar merged commit 9e90282 into mlflow:master Mar 31, 2021
alkispoly-db pushed a commit to alkispoly-db/mlflow that referenced this pull request Apr 6, 2021
* rename back to autologging_utils

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Partial

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Add files

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Fixes

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* More

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Explanatory comment

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Test fixes

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Format

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Remove raise

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Import fix

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Test

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Lint

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Comment

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Modularize versions, format

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Add versioning

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Remove import

Signed-off-by: dbczumar <corey.zumar@databricks.com>
alkispoly-db pushed a commit to alkispoly-db/mlflow that referenced this pull request Apr 6, 2021
* rename back to autologging_utils

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Partial

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Add files

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Fixes

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* More

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Explanatory comment

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Test fixes

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Format

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Remove raise

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Import fix

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Test

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Lint

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Comment

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Modularize versions, format

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Add versioning

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Remove import

Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>
harupy added a commit that referenced this pull request Apr 7, 2021
* mlflow.sklearn.log_eval_metrics: implementation and tests

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Lint cleanups

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* address some review comments

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Addressed 2nd-round review comments

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Changes return to metrics only and allows non-keyword arguments for model, X, y_true

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Apply suggestions from code review

Co-authored-by: Siddharth Murching <smurching@gmail.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* [PyTorch] Adding Example for Ax Hyperparameter Optimization (#3885)

* Adding Example for Ax Hyperparameter Optimization

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Updating implementation to use Iris Classification example

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding Tests for ax example

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing Lint errors

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* removing print statements

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing parameters specific to Adam Optimizer

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding conditions for SGD parameters

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* removing prefix parameter

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixed Pythonpath issue

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Moving Iris Classification class to Ax Folder

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing the unused code

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Addressing review comments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Addressing review comments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing pandas from dependency

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* removing unused packages from conda.yaml

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing project name

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* reverting iris file changes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing filename

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Reverting iris files from upstream master branch

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Reverting pytorch autolog file from upstream master

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing doc strings

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing unused iris class

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding torchvision

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing iris.py

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
Co-authored-by: harupy <17039389+harupy@users.noreply.github.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Modularize autologging utilities (#4216)

* rename back to autologging_utils

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Partial

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Add files

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Fixes

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* More

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Explanatory comment

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Test fixes

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Format

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Remove raise

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Import fix

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Test

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Lint

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Comment

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Modularize versions, format

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Add versioning

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Remove import

Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Update MLflow version to 1.15.1 (#4209)

Signed-off-by: Jenkins <jenkins@databricks.com>

Co-authored-by: Jenkins <jenkins@databricks.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Fix 1.15 migration error (#4211)

* Fix 1.15 migration error

Signed-off-by: Мартынов Максим Сергеевич <msmarty5@mts.ru>

* remove server_deafult because it's False by default

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* Add migration file

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* add comment

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* fix

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* fix typo

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

Co-authored-by: harupy <17039389+harupy@users.noreply.github.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Fixes tests that were broken from changed error messages

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Update mlflow/sklearn/__init__.py for better doc formatting

Co-authored-by: Harutaka Kawamura <hkawamura0130@gmail.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Lint fixes.

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* mlflow.sklearn.log_eval_metrics: implementation and tests

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Lint cleanups

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* address some review comments

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Addressed 2nd-round review comments

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Changes return to metrics only and allows non-keyword arguments for model, X, y_true

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Apply suggestions from code review

Co-authored-by: Siddharth Murching <smurching@gmail.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Fixes tests that were broken from changed error messages

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Update mlflow/sklearn/__init__.py for better doc formatting

Co-authored-by: Harutaka Kawamura <hkawamura0130@gmail.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Lint fixes.

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

Co-authored-by: Alkis Polyzotis <alkis.polyzotis@gmail.com>
Co-authored-by: Siddharth Murching <smurching@gmail.com>
Co-authored-by: ankan94 <51693147+ankan94@users.noreply.github.com>
Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
Co-authored-by: harupy <17039389+harupy@users.noreply.github.com>
Co-authored-by: dbczumar <39497902+dbczumar@users.noreply.github.com>
Co-authored-by: mlflow-automation <61449322+mlflow-automation@users.noreply.github.com>
Co-authored-by: Jenkins <jenkins@databricks.com>
Co-authored-by: Martynov Maxim <msmarty5@mts.ru>
Co-authored-by: Harutaka Kawamura <hkawamura0130@gmail.com>
harupy pushed a commit to chauhang/mlflow that referenced this pull request Apr 8, 2021
* rename back to autologging_utils

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Partial

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Add files

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Fixes

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* More

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Explanatory comment

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Test fixes

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Format

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Remove raise

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Import fix

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Test

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Lint

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Comment

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Modularize versions, format

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Add versioning

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Remove import

Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>
harupy added a commit to chauhang/mlflow that referenced this pull request Apr 8, 2021
* mlflow.sklearn.log_eval_metrics: implementation and tests

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Lint cleanups

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* address some review comments

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Addressed 2nd-round review comments

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Changes return to metrics only and allows non-keyword arguments for model, X, y_true

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Apply suggestions from code review

Co-authored-by: Siddharth Murching <smurching@gmail.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* [PyTorch] Adding Example for Ax Hyperparameter Optimization (mlflow#3885)

* Adding Example for Ax Hyperparameter Optimization

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Updating implementation to use Iris Classification example

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding Tests for ax example

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing Lint errors

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* removing print statements

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing parameters specific to Adam Optimizer

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding conditions for SGD parameters

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* removing prefix parameter

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixed Pythonpath issue

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Moving Iris Classification class to Ax Folder

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing the unused code

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Addressing review comments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Addressing review comments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing pandas from dependency

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* removing unused packages from conda.yaml

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing project name

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* reverting iris file changes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing filename

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Reverting iris files from upstream master branch

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Reverting pytorch autolog file from upstream master

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing doc strings

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing unused iris class

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding torchvision

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing iris.py

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
Co-authored-by: harupy <17039389+harupy@users.noreply.github.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Modularize autologging utilities (mlflow#4216)

* rename back to autologging_utils

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Partial

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Add files

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Fixes

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* More

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Explanatory comment

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Test fixes

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Format

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Remove raise

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Import fix

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Test

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Lint

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Comment

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Modularize versions, format

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Add versioning

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Remove import

Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Update MLflow version to 1.15.1 (mlflow#4209)

Signed-off-by: Jenkins <jenkins@databricks.com>

Co-authored-by: Jenkins <jenkins@databricks.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Fix 1.15 migration error (mlflow#4211)

* Fix 1.15 migration error

Signed-off-by: Мартынов Максим Сергеевич <msmarty5@mts.ru>

* remove server_deafult because it's False by default

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* Add migration file

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* add comment

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* fix

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* fix typo

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

Co-authored-by: harupy <17039389+harupy@users.noreply.github.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Fixes tests that were broken from changed error messages

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Update mlflow/sklearn/__init__.py for better doc formatting

Co-authored-by: Harutaka Kawamura <hkawamura0130@gmail.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Lint fixes.

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* mlflow.sklearn.log_eval_metrics: implementation and tests

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Lint cleanups

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* address some review comments

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Addressed 2nd-round review comments

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Changes return to metrics only and allows non-keyword arguments for model, X, y_true

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Apply suggestions from code review

Co-authored-by: Siddharth Murching <smurching@gmail.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Fixes tests that were broken from changed error messages

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Update mlflow/sklearn/__init__.py for better doc formatting

Co-authored-by: Harutaka Kawamura <hkawamura0130@gmail.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Lint fixes.

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

Co-authored-by: Alkis Polyzotis <alkis.polyzotis@gmail.com>
Co-authored-by: Siddharth Murching <smurching@gmail.com>
Co-authored-by: ankan94 <51693147+ankan94@users.noreply.github.com>
Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
Co-authored-by: harupy <17039389+harupy@users.noreply.github.com>
Co-authored-by: dbczumar <39497902+dbczumar@users.noreply.github.com>
Co-authored-by: mlflow-automation <61449322+mlflow-automation@users.noreply.github.com>
Co-authored-by: Jenkins <jenkins@databricks.com>
Co-authored-by: Martynov Maxim <msmarty5@mts.ru>
Co-authored-by: Harutaka Kawamura <hkawamura0130@gmail.com>
Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>
harupy pushed a commit to wamartin-aml/mlflow that referenced this pull request Jun 7, 2021
* rename back to autologging_utils

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Partial

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Add files

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Fixes

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* More

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Explanatory comment

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Test fixes

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Format

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Remove raise

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Import fix

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Test

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Lint

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Comment

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Modularize versions, format

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Add versioning

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Remove import

Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>
harupy added a commit to wamartin-aml/mlflow that referenced this pull request Jun 7, 2021
* mlflow.sklearn.log_eval_metrics: implementation and tests

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Lint cleanups

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* address some review comments

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Addressed 2nd-round review comments

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Changes return to metrics only and allows non-keyword arguments for model, X, y_true

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Apply suggestions from code review

Co-authored-by: Siddharth Murching <smurching@gmail.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* [PyTorch] Adding Example for Ax Hyperparameter Optimization (mlflow#3885)

* Adding Example for Ax Hyperparameter Optimization

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Updating implementation to use Iris Classification example

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding Tests for ax example

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing Lint errors

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* removing print statements

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing parameters specific to Adam Optimizer

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding conditions for SGD parameters

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* removing prefix parameter

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixed Pythonpath issue

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Moving Iris Classification class to Ax Folder

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing the unused code

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Addressing review comments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Addressing review comments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing pandas from dependency

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* removing unused packages from conda.yaml

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing project name

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* reverting iris file changes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing filename

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Reverting iris files from upstream master branch

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Reverting pytorch autolog file from upstream master

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing doc strings

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing unused iris class

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding torchvision

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing iris.py

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
Co-authored-by: harupy <17039389+harupy@users.noreply.github.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Modularize autologging utilities (mlflow#4216)

* rename back to autologging_utils

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Partial

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Add files

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Fixes

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* More

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Explanatory comment

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Test fixes

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Format

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Remove raise

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Import fix

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Test

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Lint

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Comment

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Modularize versions, format

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Add versioning

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Remove import

Signed-off-by: dbczumar <corey.zumar@databricks.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Update MLflow version to 1.15.1 (mlflow#4209)

Signed-off-by: Jenkins <jenkins@databricks.com>

Co-authored-by: Jenkins <jenkins@databricks.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Fix 1.15 migration error (mlflow#4211)

* Fix 1.15 migration error

Signed-off-by: Мартынов Максим Сергеевич <msmarty5@mts.ru>

* remove server_deafult because it's False by default

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* Add migration file

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* add comment

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* fix

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* fix typo

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

Co-authored-by: harupy <17039389+harupy@users.noreply.github.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Fixes tests that were broken from changed error messages

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Update mlflow/sklearn/__init__.py for better doc formatting

Co-authored-by: Harutaka Kawamura <hkawamura0130@gmail.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Lint fixes.

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* mlflow.sklearn.log_eval_metrics: implementation and tests

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Lint cleanups

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* address some review comments

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Addressed 2nd-round review comments

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Changes return to metrics only and allows non-keyword arguments for model, X, y_true

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Apply suggestions from code review

Co-authored-by: Siddharth Murching <smurching@gmail.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Fixes tests that were broken from changed error messages

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Update mlflow/sklearn/__init__.py for better doc formatting

Co-authored-by: Harutaka Kawamura <hkawamura0130@gmail.com>
Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

* Lint fixes.

Signed-off-by: Alkis Polyzotis <alkis.polyzotis@databricks.com>

Co-authored-by: Alkis Polyzotis <alkis.polyzotis@gmail.com>
Co-authored-by: Siddharth Murching <smurching@gmail.com>
Co-authored-by: ankan94 <51693147+ankan94@users.noreply.github.com>
Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
Co-authored-by: harupy <17039389+harupy@users.noreply.github.com>
Co-authored-by: dbczumar <39497902+dbczumar@users.noreply.github.com>
Co-authored-by: mlflow-automation <61449322+mlflow-automation@users.noreply.github.com>
Co-authored-by: Jenkins <jenkins@databricks.com>
Co-authored-by: Martynov Maxim <msmarty5@mts.ru>
Co-authored-by: Harutaka Kawamura <hkawamura0130@gmail.com>
Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/tracking Tracking service, tracking client APIs, autologging rn/none List under Small Changes in Changelogs.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants