Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Agreement report shows only "no position" #4590

Closed
reckart opened this issue Mar 5, 2024 · 0 comments
Closed

Agreement report shows only "no position" #4590

reckart opened this issue Mar 5, 2024 · 0 comments
Assignees
@reckart
Labels
🐛Bug Something isn't working Module: Agreement
Projects
Kanban
Milestone
31.2

Comments

@reckart
Copy link
Member

reckart commented Mar 5, 2024

Describe the bug
In some cases, the agreement report now only shows "no position".

To Reproduce
Not exactly sure. I think it happens when no agreement can be calculated for at least one document for a given pair of annotators.

Expected behavior
If there is agreement, it should be shown, even if it cannot be calculated for everything.

Please complete the following information:

  • Version and build ID: 31.1
@reckart reckart added 🐛Bug Something isn't working Module: Agreement labels Mar 5, 2024
@reckart reckart added this to the 31.2 milestone Mar 5, 2024
@reckart reckart added this to 🔖 To do in Kanban via automation Mar 5, 2024
@reckart reckart self-assigned this Mar 5, 2024
reckart added a commit that referenced this issue Mar 5, 2024
@reckart
#4590 - Agreement report shows only "no position"
eed64c3 
- Fix aggregation logic for "empty" and "all null" flags
- When calculating the macro average agreement, skip results for which agreement calculation was not possible (NaN)
- Display in the tooltip for how many documents agreement calculation was attempted and how many of those actually produced usable results
reckart added a commit that referenced this issue Mar 5, 2024
@reckart
Merge pull request #4593 from inception-project/bugfix/4590-Agreement…
2e6ff05 
…-report-shows-only-no-position

#4590 - Agreement report shows only "no position"
@reckart reckart closed this as completed Mar 5, 2024
Kanban automation moved this from 🔖 To do to 🍹 Done Mar 5, 2024
reckart added a commit that referenced this issue Mar 5, 2024
@reckart
Merge branch 'release/31.x'
1e5fc3e 
* release/31.x:
  #4590 - Agreement report shows only "no position"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@reckart reckart

Labels
🐛Bug Something isn't working Module: Agreement
Projects
Kanban
  
🍹 Done
Milestone
31.2
Development

No branches or pull requests
1 participant
@reckart