Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/ml flow integration #683

Merged
merged 15 commits into from
Aug 2, 2023
Merged

Conversation

ArshaanNazir
Copy link
Collaborator

@ArshaanNazir ArshaanNazir commented Jul 30, 2023

Description

This PR aims to add a new feature of enabling tracking the run metrics (logs) on mlflow. We just need to define a flag: mlflow_tracking = True in the report method and our metrics will be logged on local mlflow tracking server.
This is done as follows:

-> Load and run the model as usual. Define mlfow_tracling = True

image

-> You will get the normal report. To check the mlflow logs. Run !mlflow ui

image

-> This guides us to the local mlflow tracking server. It has the model-name as experiment name and task and date as a run-name.

image

-> To check the logs, select the run-name and check the metrics section.

image

-> It helps us to maintain and compare different configurations of same or different models. Let us run the same model again with different configuration.

image

image

-> In the mlflow tracking server, we can see a different run for the same model ( with different configuration )

image

-> We can select the compare button and compare the different runs.

image

Here we can compare the different run metrics.

image

Type of change

Please delete options that are not relevant.

  • New feature (non-breaking change which adds functionality)
  • This change requires a documentation update

Usage

Checklist:

  • I've added Google style docstrings to my code.
  • I've used pydantic for typing when/where necessary.
  • I have linted my code
  • I have added tests to cover my changes.

pyproject.toml Outdated Show resolved Hide resolved
langtest/langtest.py Show resolved Hide resolved
@ArshaanNazir ArshaanNazir self-assigned this Aug 1, 2023
@ArshaanNazir ArshaanNazir added the ⭐ Feature Indicates new feature requests label Aug 1, 2023
@ArshaanNazir ArshaanNazir linked an issue Aug 1, 2023 that may be closed by this pull request
@ArshaanNazir ArshaanNazir added the v2.1.0 Issue or request to be done in v2.1.0 release label Aug 1, 2023
@JulesBelveze JulesBelveze merged commit 12c9388 into release/1.2.0 Aug 2, 2023
3 checks passed
@ArshaanNazir ArshaanNazir deleted the feature/ml_flow_integration branch August 7, 2023 05:58
@ArshaanNazir ArshaanNazir removed the v2.1.0 Issue or request to be done in v2.1.0 release label Aug 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
⭐ Feature Indicates new feature requests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Integrate with ML Flow
2 participants