-
Notifications
You must be signed in to change notification settings - Fork 0
Metrics precision score
True positives over everything predicted into the class, reduced to one number by average.
public static double Score(ConfusionMatrix cm, Averaging average = Averaging.Binary, int posLabel = 1, ZeroDivision zeroDivision = ZeroDivision.Zero)
public static double Score(ReadOnlySpan<int> yTrue, ReadOnlySpan<int> yPred, Averaging average = Averaging.Binary, int posLabel = 1, ZeroDivision zeroDivision = ZeroDivision.Zero, ReadOnlySpan<int> labels = default, ReadOnlySpan<double> sampleWeight = default)Parameters — cm is a matrix already counted, or pass yTrue and yPred. average is how
the
per-class scores are reduced, Averaging.Binary by default. posLabel is the class reported
under
Averaging.Binary. zeroDivision decides what comes back when nothing at all was predicted into
the class. labels fixes the label set and its order, and sampleWeight weights the samples.
Returns — double in [0, 1], larger meaning fewer false alarms.
Exceptions — ArgumentNullException when cm is null; ArgumentException when
Averaging.Binary is used on more than two classes, or posLabel does not occur;
UndefinedMetricException when nothing was predicted into the class and zeroDivision is
ZeroDivision.Throw.
Example — the filter flagged three messages as spam and two of them were.
using Lodestar.Metrics;
int[] yTrue = [1, 1, 1, 1, 0, 0, 0, 0];
int[] yPred = [1, 1, 0, 0, 1, 0, 0, 0];
double precision = Precision.Score(yTrue, yPred); // => 0.6666…Remarks — report this when a false alarm is the expensive mistake: mail deleted that was not spam, a customer wrongly declined, a page taken down that was fine. It answers "when this thing fires, can I trust it", and says nothing at all about how much it missed.
Which is the trap, and it is not subtle: precision alone is trivially gamed. A model that
flags
exactly one sample, and is right about it, has a precision of 1.0. Precision is only a claim
about
a model when it is quoted next to a recall, or folded into F1.Score, which is why every report
on
this page carries both.
The undefined case is worth setting deliberately. A class nothing was predicted into has no
precision — the denominator is zero — and by default that returns 0.0, which is scikit-learn's
value and reads in a report as "terrible" rather than as "not asked". ZeroDivision.NaN keeps it
out of a macro average honestly; ZeroDivision.Throw tells you rather than letting a silent zero
drag a number down.
Applies to — net10.0, netstandard2.0.
See also — Precision.PerClass, Recall.Score, F1.Score, ZeroDivision,
the Python equivalence table.
- 0001-target-framework
- 0002-unicode-comparison-unit
- 0003-provenance-and-licensing
- 0004-levenshtein-myers-backlog
- 0005-hamming-jellyfish-divergence
- 0006-ratcliff-autojunk
- 0007-metaphone-scope
- 0008-italian-enza-nltk-divergence
- 0009-sample-consumes-a-local-feed
- 0010-stop-word-list-provenance
- 0011-persistence-format
- 0012-per-package-versioning
- 0013-sentencepiece-parity-scope
- 0014-precompiled-normalizer
- 0015-sonar-rules-in-the-build
- 0016-metrics-package-placement
- 0017-bpe-parity-scope
- 0018-multiclass-roc-auc-parallelism-is-opt-in
- 0019-the-net-analysers-run-in-the-build-too
- 0020-normalize-is-a-projection-not-a-parameter
- 0021-multioutput-is-a-method-not-an-enum
- 0022-added-token-matching-flags
- 0023-byte-level-decode-substitutes
- 0024-weighted-median-averages-within-scikit-learns-epsilon
- 0025-quickselect-replaces-a-full-sort-for-the-median
- 0026-r2-and-explainedvariance-split-their-undefined-cases-differently
- 0027-r2-and-explainedvariance-vectorize-only-a-single-output
- 0028-log1p-is-kahans-identity-not-math-log-1-plus-x
- 0029-balanced-accuracy-adjusted-is-left-to-ieee-754-at-the-edge
- 0030-cohen-kappa-keeps-scikit-learns-expected-matrix-orientation
- 0031-nosamplecorrect-mirrors-numpys-float64-upcast
- 0032-fbeta-substitutes-tp-predicted-and-support-algebraically
- 0033-compensated-sum-is-neumaiers-variant
- 0034-dropout-is-refused-for-want-of-a-user
- 0035-a-null-pre-split-is-removed-with-invert-not-isolated
- 0036-a-member-may-ship-without-an-oracle-if-it-says-so
- 0037-the-guards-run-before-the-commit
- 0038-the-gate-confronts-an-exception-tag-with-the-page-that-documents-it
- 0039-mutual-information-returns-zero-on-an-empty-input
- 0040-a-curve-is-a-sealed-class-per-curve
- 0041-one-sample-file-per-public-class
- 0042-phonetic-encoders-refuse-a-null-word
- 0043-the-equality-table-is-sized-to-the-pattern
- 0044-compression-belongs-to-the-caller
- 0045-a-console-call-carries-its-reason-on-the-line
- 0046-check-adr-immutable-runs-in-ci-only
- 0047-one-gate-per-kernel-not-one-per-alphabet
- 0048-the-gate-depends-on-the-kernel-and-the-alphabet
- 0049-two-gates-per-kernel-tested-where-the-width-is-known
- 0050-the-sentencepiece-bpe-lineage-stays-a-bpe-model
- benchmark_latest
- decisions
- equivalence
- matplotlib
- migration
- nightly_run
- numpy
- pandas
- performance
- pytorch
- seaborn
- sklearn
- statsmodels