Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: annotator specific metrics #2134

Closed
davidberenstein1957 opened this issue Jan 4, 2023 · 1 comment
Closed

feat: annotator specific metrics #2134

davidberenstein1957 opened this issue Jan 4, 2023 · 1 comment
Assignees
@frascuchon @Amelie-V
Labels
type: enhancement Indicates new feature requests

Comments

@davidberenstein1957
Copy link
Member

davidberenstein1957 commented Jan 4, 2023 •
edited

Is your feature request related to a problem? Please describe.
N.A.

Describe the solution you'd like
Sometimes I want to see metrics for a specific annotator

  • alignment with predictions
  • alignment with other annotator
  • distribution of labels assigned
  • n_labels assigned
    • multi-label TextClassification
    • Token Classification
  • records discarded
  • annotation speed
  • time spend annotating

Describe alternatives you've considered
N.A.

Additional context
Add any other context or screenshots about the feature request here.
@davidberenstein1957 davidberenstein1957 added the type: enhancement Indicates new feature requests label Jan 4, 2023
@github-actions
Copy link

github-actions bot commented Apr 5, 2023

This issue is stale because it has been open for 90 days with no activity.

@github-actions github-actions bot added the status: stale Indicates that there is no activity on an issue or pull request label Apr 5, 2023
@davidberenstein1957 davidberenstein1957 removed the status: stale Indicates that there is no activity on an issue or pull request label Apr 5, 2023
@davidberenstein1957 davidberenstein1957 mentioned this issue Oct 30, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@frascuchon frascuchon

@Amelie-V Amelie-V

Labels
type: enhancement Indicates new feature requests
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@frascuchon @davidberenstein1957 @Amelie-V