The tool creates a visualization of the video annotation matrix. It also converts a labeled video matrix into a Fleiss Matrix. Finally, it calculates the Overall Fleiss Kappa Score, Percent Overall Agreement among raters above chance, Confidence Interval of Kappa & Significance Test
The program implements the calculus of the Fleiss' Kappa in the both the fixed and margin-free version. The data used are a collection of possible results of an analysis of 6 annotators on 100 texts.
Evaluation and agreement scripts for the DISCOSUMO project. Each evaluation script takes both manual annotations as automatic summarization output. The formatting of these files is highly project-specific. However, the evaluation functions for precision, recall, ROUGE, Jaccard, Cohen's kappa and Fleiss' kappa may be applicable to other domains too.
Using information retrieval to help an emerging local artist boost its streams
Multi-label inter rater agreement using fleiss kappa, krippendorff's alpha and the MASI similarity measure for set simmilarity. Written in R Quarto.
Data and codes for analysing an industry model Pacific oyster for sustainable aquaculture
Add a description, image, and links to the fleiss-kappa topic page so that developers can more easily learn about it.
To associate your repository with the fleiss-kappa topic, visit your repo's landing page and select "manage topics."