Repository navigation
IG Logico: Semantic and reference annotations
ubrady edited this page Jul 1, 2026
·
2 revisions
NOTE: Confidence measurement missing
<style> </style>| Annotation details | Definition | Example | Annotation type | Applicability |
|---|---|---|---|---|
| Accuracy (acc) Measurement: [acc=0-1] Value range: 0=low accuracy 1=high accuracy | Accuracy is defined as the degree of subjective certainty regarding an inference made when assessing statements in non-policy data. | Statement level: [acc=0.8] A(Department of Defense) D([shall]) I(obligate) Bdir(funds) Cex(based on contracts with Non-Governmental Organizations). Component level: A(Department of Defense) Dacc=0.3 I(obligate) Bdir(funds) Cex(based on contracts with Non-Governmental Organizations). | Semantic annotation | Statement level Component level |
| Truthfulness (tw) Measurement: [tw=0-1] Value range: 0=low truthfulness 1=high truthfulness | Truthfulness refers to the extent to which interview responses can be considered truthful. Truthfulness can include uncertainty (e.g., vague language or hesitation) and/or coherence (e.g., one interviewee providing contradicting statements during their interview), and/or participant-specific weighting (based on predefined Attributes such as age, gender, position, or experience). | Statement level: [tw=0.7] Cac(In case of a breakage in the water infrastructure){A(farmers) D(must) I(inform) the Bdir(president) [XOR] A(farmers) D(must) I(inform) the Bdir(watchman)} Component level: Cac(In case of a breakage in the water infrastructure) {A(farmers) Dtw=0.5 I(inform) the Bdir(president) [XOR] A(farmers) Dtw=1 I(inform) the Bdir(watchman)} | Semantic annotation | Statement level Component level |
| Consistency (con) Measurement: [con=0-1] Value range: 0=low consistency 1=high consistency | Consistency refers to the degree of agreement across responses from different interviewees. It can be measured by quantifying how frequently a given statement is repeated across interviews and how many contracting statements there are. | Statement level: [con=0.5] A(farmer) D(must not) I(cut off) Bdir(the water) O{{The A(community) D(must) I(fine) the Bdir(farmer) [AND] Cac(If the farmer does not pay the fine), the A(community) D(must) I(expel) the Bdir(farmer)}}. Nested Statement level: A(farmers) D(must not) I(cut off) Bdir(the water) O{{[con=0.8] The A(community) D(must) I(fine) the Bdir(farmers) [AND] [con=0.2] Cac(If the farmers do not pay the fine), the A(community) D(must) I(expel) the Bdir(farmers)}}. Component level: A(farmers) D(must not) I(cut off) Bdir(the water) O{{The A(community) D(must) Icon=0.9 the Bdir(farmers) [AND] Cac(If the farmers do not pay the fine), the A(community) D(must) Icon=0.3 the Bdir(farmers)}}. | Semantic annotation | Statement level Component level |
| Interviewee identification Measurement: [ref=P007] Value range: NA | Identification of Interviewee who is the source of the coded institutional statement Can be linked with high/low coding statement consistencies/inconsistencies or accuracies/inaccuracies of particular interviewees and paired with assessments of accuracy, truthfulness, and consistency | Statement level: [ref=P007] A(farmer) D(shall) I(pay) Bdir(fine) Component level (combining more than one interviewee): A(farmer) D[ref=P007,P011](shall [OR] may) I(pay) Bdir(fine) | Reference annotation | Statement level Component level |
| Institutional statement identification/linkage Notation: [ref=InTranscript-ISID] [ref=ExtTranscriptPID_ISID] Measurement: [ref=InTranscript003] [ref=ExtTranscript-P007_05] Value range: NA | Identification of / linkage to another statement within (InTranscript) or external (ExtTranscript) to the document | Statement level: [ref=InTranscript-003] A(farmer) D(shall) I(pay) Bdir(fine) =>refers to another statement in transcript of Interviewee 007 which outlines more information on the fine farmer shall pay, e.g., amount of the fine [ref=ExtTranscript-P007_005] A(farmer) D(shall) I(pay) Bdir(fine) => refers to another statement in another transcript that also provides information on farmer's requirement to pay fine | Reference annotation | Statement level |
| Coder identification Notation: [ref=coderID,CodingAssessmentValue] Measurement: [ref=coder011] Value range: NA | Identification of individual coder's assessment of their coding accuracy. Can be used by coders to identify elements of low/high confidence in their coding. Can be linked with high/low coding inconsistencies or inaccuracies to particular interviewees and used to target intercoder reliability training interventions. | Statement level: [ref=coder017] A(monitors) D(may) I(inform) Bdir(president) Component level: A(farmers) Dref=coder003 I(inform) Bdir(president) A(farmers) Dref=coder005 I(inform) Bdir(president) | Reference annotation | Statement level Component level |
| Delta parameters identification Notation: [contype=EmotionalValue;AssessmentValue] Measurement: [contype=emotional] Emotional value range: [contype=material, economic, action, legal, physical, positional, spiritual, emotional] | Identification of the complexity among automatic, emotional (both internal and external), and tangible consequences associated with strategies, norms, and rules in the Or Else component among respondents. Additionally, coders can rank accuracy of the assigned delta parameter | Statement/substatement level A(Farmers) D(must [NOT]) use Cex([using] boreholes) to I(extract) Bdir(water) or else O{O{A(watchman) D([may]) Icontype=warning Bdir,p(noncompliant) Bdir(farmer)} [AND] O{A,p([noncompliant]) A(farmer) D(may) I[contype=emotional](feel embarrassed)}} [XOR] O{O{Cac(If no compliance), A,p(noncompliant) A(farmer) D(must) Icontype=tangible Bdir(fine)} [AND] O[0.2]{A,p([noncompliant]) A([farmer]) D(may) Icontype=emotional}} | Reference annotation | Component level |