Skip to content
This repository has been archived by the owner on Feb 26, 2023. It is now read-only.

Add more metrics #41

Open
12 tasks
anvelezec opened this issue Nov 15, 2021 · 1 comment
Open
12 tasks

Add more metrics #41

anvelezec opened this issue Nov 15, 2021 · 1 comment

Comments

@anvelezec
Copy link
Contributor

The idea is to add more metrics taking as basis torchmetrics and tf metrics implementation.

Guidelines

  • For implementation purposes reference to accuracy. Take into account each metric needs and update and compute method as does torchmetrics implementation.
  • Some of metrics can inherit from modules such as Mean, Reduce, Metric while others need an implementation from scratch.
  • Must add unit test for numerical equivalence with respect to torchmetrics or tf metrics

Regression metrics

  • R2
  • Root mean squared error
  • Mean squared error
  • Cosine similarity

Classification metrics

  • IOU
  • ROC
  • Specificity
  • AUC
  • Precision and recall
  • Cohen kappa
  • Confusion matrix
  • Hamming distance

If you want to work on a metric, feel free to "claim" it via a comment here so others know you are working on it. Additionally feel free to add as many metrics as desired, even from other tasks such as audio, language, image, etc.

@jmarrietar
Copy link
Contributor

I will take Mean squared error. I will post here any or in discord the challenges or doubts I face.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants