quica is a tool to run inter coder agreement pipelines in an easy and effective ways. Multiple measures are run and results are collected in a single table than can be easily exported in Latex
-
Updated
Nov 9, 2020 - Python
#
inter-rater-agreement
Here are 12 public repositories matching this topic...
Qualitative Coding Assistant for Google Sheets
google-sheets coding google-apps-script sheets inter-rater-agreement qualitative-analysis qualitative-research grounded-theory interrater-reliability
-
Updated
Apr 15, 2024 - TypeScript
Kupper-Hafner inter-rater agreement calculation library
-
Updated
Apr 3, 2022 - Python
The official Crowd Deliberation data set.
-
Updated
Sep 19, 2017
A python script to compute kappa-coefficient, which is a statistical measure of inter-rater agreement.
-
Updated
Sep 17, 2019 - Python
Evaluation and agreement scripts for the DISCOSUMO project. Each evaluation script takes both manual annotations as automatic summarization output. The formatting of these files is highly project-specific. However, the evaluation functions for precision, recall, ROUGE, Jaccard, Cohen's kappa and Fleiss' kappa may be applicable to other domains too.
evaluation recall precision extractive-summarization forum-threads automatic-summarization evaluation-metrics rouge-n rouge-l jaccard cohens-kappa fleiss-kappa inter-rater-agreement
-
Updated
Feb 10, 2017 - Python
Assessment of radiological abnormalities and prediction of lung function with AI-determined lung opacity
bootstrap neural-network random-forest artificial-intelligence gradient-boosting-machine support-vector-machines inter-rater-agreement computed-tomography receiver-operating-characteristic inter-rater covid-19 lung-function
-
Updated
Mar 15, 2025 - R
A calculator for two different inter-rater agreement statistics, generalized to any numbers of categories
-
Updated
Apr 3, 2024 - Python
[MICCAI ISIC 2024] Code for "Segmentation Style Discovery: Application to Skin Lesion Images"
inter-rater-agreement inter-annotator-agreement medical-image-segmentation skin-lesion-segmentation variability-modeling multi-rater
-
Updated
Jul 21, 2024
Replication package for the Archetypal Analysis conducted in the paper: Evaluating the Agreement among Technical Debt Measurement Tools: Building an Empirical Benchmark of Technical Debt Liabilities accepted at Springer's EMSE Journal.
-
Updated
Aug 11, 2020 - R
Python tool for calculating inter-rater reliability metrics and generating comprehensive reports for multi-rater datasets. Optionally have an LLM create an interpretation report.
statistics data-analysis inter-rater-agreement markdown-report research-tools metrics-calculator agreement-analysis rater-agreement
-
Updated
Jul 29, 2024 - Python
Improve this page
Add a description, image, and links to the inter-rater-agreement topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the inter-rater-agreement topic, visit your repo's landing page and select "manage topics."