Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Big rework #32

Merged
merged 24 commits into from
Mar 14, 2024
Merged

Big rework #32

merged 24 commits into from
Mar 14, 2024

Conversation

avishniakov
Copy link
Contributor

@avishniakov avishniakov commented Feb 14, 2024

  • update to current zenml syntax
  • reworked to use a bit different flow
  • updated docs and images
  • added usage of MCP and links to Cloud for demoing

Copy link

Model gitflow_model version 2aef561a2ae8946c2c94e0c12f5d9e858ab9a9e0 training results ZenML Cloud

Overall decision: PASSED

Summary of checks

Model accuracy on training dataset

Description: Checks how well the model performs on the training dataset.
The model accuracy on the training set should be at least 0.9.

Result: PASSED

  • min. accuracy: 0.9
  • actual accuracy: 0.9912087912087912

Model accuracy on evaluation dataset

Description: Checks how well the model performs on the evaluation dataset.
The model accuracy on the evaluation set should be at least 0.9.

Result: PASSED

  • min. accuracy: 0.9
  • actual accuracy: 0.9649122807017544

Data integrity checks

Description: A set of data quality checks that verify whether the input data is
valid and can be used for training (no duplicate samples, no missing values or
problems with string or categorical features, no significant outliers, no
inconsistent labels, etc.).

Results: PASSED

  • passed checks: 9
  • failed checks: 0 []
  • checks with warnings: 0 []
  • skipped checks: 2

Train-test data drift checks

Description: Compares the training and evaluation datasets to verify that their
distributions are similar and there is no potential data leakage that may
contaminate your model or perceived results.

Results: PASSED

  • passed checks: 9
  • failed checks: 0 []
  • checks with warnings: 0 []
  • skipped checks: 3

Model evaluation checks

Description: Runs a set of checks to evaluate the model performance, detect
overfitting, and verify that the model is not biased.

Results: PASSED

  • passed checks: 2
  • failed checks: 0 []
  • checks with warnings: 0 []
  • skipped checks: 3

Train-test model comparison checks

Description: Runs a set of checks to compare the model performance between the
test dataset and the evaluation dataset.

Results: PASSED

  • passed checks: 3
  • failed checks: 0 []
  • checks with warnings: 1 [Unused Features]
  • skipped checks: 2

Other results

README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
Co-authored-by: Alex Strick van Linschoten <strickvl@users.noreply.github.com>
@avishniakov avishniakov merged commit 2756e7f into main Mar 14, 2024
1 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants