You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello, I'm trying to run the Test: TestAccuracyScore, manually, however I'm getting an Error using the earlier version 0.2
In the previous version the code was running fine.
In new version we changed internal structure because we have some dependencies between tests/metrics and other metrics.
So it is incorrect to call Test / Metric directly.
Can you describe why you want use Test / Metric directly without Reports / TestSuites?
I see,
First, we will add parameter to change this value in tests in future versions.
Second, for now you can use "hack" to alter behavior of test, for example using this code:
fromevidently.tests.base_testimportTestValueConditionfromevidently.tests.utilsimportapproxdeffixed_condition(obj):
ifobj.condition.has_condition():
returnobj.conditionresult=obj.metric.get_result()
ref_metrics=result.referenceifref_metricsisnotNone:
returnTestValueCondition(eq=approx(obj.get_value(ref_metrics), relative=0.1)) # here the fixdummy_result=obj.dummy_metric.get_result().dummyifobj.get_value(dummy_result) isNone:
raiseValueError("Neither required test parameters nor reference data has been provided.")
returnTestValueCondition(gt=obj.get_value(dummy_result))
TestAccuracyScore.get_condition=fixed_condition
This should change behavior on TestAccuracyScore globally.
Third, I'm still curious why you want to use Test without TestSuite/
Hello, I'm trying to run the Test: TestAccuracyScore, manually, however I'm getting an Error using the earlier version 0.2
In the previous version the code was running fine.
My code:
ERROR:
The text was updated successfully, but these errors were encountered: