You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Problem
We would like a new Evaluator for binary classification which bins the probabilities predicted for the data and compares it to the average outcome of values that fell in that bin.
Problem
We would like a new Evaluator for binary classification which bins the probabilities predicted for the data and compares it to the average outcome of values that fell in that bin.
Solution
This estimator should extend the
OpBinaryClassificationEvaluatorBase
class. It should return a new class extendingEvaluationMetrics
which contains the bins, the counts in each bin, the average outcome of records in each bin and the brier score https://en.wikipedia.org/wiki/Brier_score. Anexample of this kind of estimator can be found here: https://github.com/salesforce/TransmogrifAI/blob/master/core/src/main/scala/com/salesforce/op/evaluators/OpBinaryClassificationEvaluator.scala
The text was updated successfully, but these errors were encountered: