Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[LabelModel] Add metrics to LabelModel.score methods #953

Closed
dcfidalgo opened this issue Jan 13, 2022 · 2 comments · Fixed by #979
Closed

[LabelModel] Add metrics to LabelModel.score methods #953

dcfidalgo opened this issue Jan 13, 2022 · 2 comments · Fixed by #979
Assignees
@dcfidalgo
Projects
Release

Comments

@dcfidalgo
Copy link
Contributor

Add additional metrics (recall, precision, f1) to the output of the Snorkel.score() and FlyingSquid.score() methods. Also see #949
@dcfidalgo dcfidalgo self-assigned this Jan 13, 2022
@dcfidalgo dcfidalgo added this to To do in Release via automation Jan 13, 2022
@dcfidalgo dcfidalgo mentioned this issue Jan 17, 2022
Merged
@frascuchon frascuchon moved this from To do to In progress in Release Jan 17, 2022
Release automation moved this from In progress to Done Jan 17, 2022
dcfidalgo pushed a commit that referenced this issue Jan 17, 2022
feat(#953): add additional metrics to LabelModel.score method (#979)
b378d38 
* docs: update docstrings

* feat: add compute metrics to snorkel

* fix: compute metrics

* test: add compute metrics test

* docs: improve docstrings

* test: fix test
@dvsrepo
Copy link
Member

dvsrepo commented Jan 17, 2022

Hi, @dcfidalgo could you please add an issue to update the guide and the tutorial to show this feature? As a general workflow I'd recommend to update related docs when adding a new feature or improvement, otherwise we add feature that go unnoticed.

@dcfidalgo dcfidalgo mentioned this issue Jan 18, 2022
Closed
@dcfidalgo
Copy link
Contributor Author

See #995

dvsrepo added a commit that referenced this issue Jan 25, 2022
@dvsrepo
Merge branch 'master' of https://github.com/recognai/rubrix
8f89dda 
* 'master' of https://github.com/recognai/rubrix: (28 commits)
  chore(#994): simplify server start (#1014)
  refactor(#945): elasticsearch index configuration per task (#1018)
  docs(#980): Add majorityvote example to weak supervision guide (#1004)
  fix(#1015): manage emojis in Token Classification records (#1016)
  fix(#1010): fix WeakLabels when not providing rules (#1011)
  fix(Breadcrumbs): Copy text function (#1003)
  fix(statics): handle 404 errors for static files (#1006)
  refactor: Rename 'exclude_missing_annotation' argument for WeakLabels.annotation (#1005)
  docs: update video for spacy ner tutorial (#1000)
  fix(#977) Remove redirection when accessing login (#996)
  feat(#951): new uncovered_by_rules records filter (#991)
  feat(#735): add warning when agent but no prediction/annotation is provided (#987)
  fix(#800): limit number of metadata fields (#993)
  docs: improve annotate records section in web app reference (#985)
  fix(#844) Keep header layout when errors occurred in dataset view (#992)
  fix(#974): display the dropdown in the last record of the scroll (#986)
  refactor: compute common aggregations one by one (#990)
  feat(#953): add additional metrics to `LabelModel.score` method (#979)
  refactor(rules): using labeling rules management with vuex store (#878)
  feat(#955): add default for `rules` in WeakLabels (#976)
  ...
@frascuchon frascuchon moved this from Done to Dev deployment in Release Feb 2, 2022
@frascuchon frascuchon moved this from Dev deployment to Release Ready in Release Feb 2, 2022
frascuchon pushed a commit that referenced this issue Feb 2, 2022
@frascuchon
feat(#953): add additional metrics to LabelModel.score method (#979)
2887907 
* docs: update docstrings

* feat: add compute metrics to snorkel

* fix: compute metrics

* test: add compute metrics test

* docs: improve docstrings

* test: fix test

(cherry picked from commit b378d38)
@dcfidalgo dcfidalgo moved this from Release Ready to Closed in Release Feb 2, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dcfidalgo dcfidalgo

Labels
None yet
Projects
No open projects
Release
Approved Release QA
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat(#953): add additional metrics to LabelModel.score method argilla-io/argilla
3 participants
@dvsrepo @frascuchon @dcfidalgo