Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
37 changes: 33 additions & 4 deletions pyproject.toml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[project]
name = "validmind"
version = "2.13.3"
version = "2.13.4"
description = "ValidMind Library"
readme = "README.pypi.md"
requires-python = ">=3.9,<3.15"
Expand Down Expand Up @@ -141,13 +141,42 @@ dev = [
"twine>=4.0.2,<5",
]

[project.scripts]
vm-create-new-test = "scripts.create_new_test:generate_test"

[build-system]
requires = ["hatchling>=1.26.0"]
build-backend = "hatchling.build"

[tool.hatch.build.targets.sdist]
include = [
"/validmind",
"/README.pypi.md",
"/LICENSE",
"/pyproject.toml",
]

exclude = [
"/.github",
"/.vscode",
"/docs",
"/images",
"/notebooks",
"/tests",
"/scripts",
"/r",
"/dist",
"/build",
"/uv.lock",
"/.cursorrules",
"/.flake8",
"/.pre-commit-config.yaml",
"/Makefile",
"/disk_clean.sh",
"**/__pycache__",
"**/*.pyc",
]

[tool.hatch.build.targets.wheel]
packages = ["validmind"]

[tool.isort]
known_first_party = "validmind"
profile = "black"
Expand Down
2 changes: 1 addition & 1 deletion r/validmind/DESCRIPTION
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
Package: validmind
Type: Package
Title: Interface to the 'ValidMind' Platform
Version: 2.13.3
Version: 2.13.4
Authors@R: c(person("Andres", "Rodriguez", role = c("aut", "cre","cph"),
email = "andres@validmind.ai"))
Maintainer: Andres Rodriguez <andres@validmind.ai>
Expand Down
9 changes: 1 addition & 8 deletions scripts/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,11 +6,4 @@ The tests are separated into subdirectories based on the category and type of te

Please see the notebook `listing-and-loading-tests.ipynb` for more information and examples and to learn about how the directory relates to the test's ID which is used across the ValidMind Platform.

To create a new test, you can use the create_new_test.py script to generate a metric or threshold test. This script will create a new test file in the appropriate directory and will also create a new test class in that file. It is registered as a console script in `pyproject.toml` and it can be used as follows:

```bash
generate-test --help # see the usage instructions
generate-test # interactively create a new test (will prompt for the test type and ID)
generate-test --test_type metric --test_id validmind.model_validation.sklearn.MyNewMetric # create a new metric test for sklearn models
generate-test --test_type threshold_test --test_id validmind.data_validation.MyNewDataTest # create a new threshold test for data validation
```
New tests should currently be created manually by adding a new file in the appropriate `validmind/tests/` subdirectory and implementing the matching test class or function in that file. Use the surrounding tests in the target directory as templates for naming, structure, and registration patterns.
2 changes: 1 addition & 1 deletion uv.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion validmind/__version__.py
Original file line number Diff line number Diff line change
@@ -1 +1 @@
__version__ = "2.13.3"
__version__ = "2.13.4"
Loading