STEP 4: IG LOGICO & ANNOTATIONS

IG Logico provides a semantic overlay that facilitates annotating institutional statements at the statement or component level to enhance the institutional information extracted from the sentence and to facilitate downstream analyses. IG Logico allows the development of a systematic taxonomy to annotate more domain- or discipline-specific concepts embedded in individual institutional elements, which can be useful to answer the research questions and measure core concepts relevant to a particular research project.

Using IG Logico annotations, in STEP 4, we recommend conducting one or more of the following assessments within and across all documents:

• Assess the consistency of statements at the institutional statement level based on the frequency of occurrence (freq) of each statement.

• Assess the consistency of statements at the institutional statement level based on the weight (w) assigned to each respondent indicating a respondent’s truthfulness.

• Assess the level of accuracy (acc) when inferring grammatical elements. Accuracy is the degree of subjective certainty regarding an inference.

• Assess the level of truthfulness (tw). Truthfulness refers to the extent to which interview responses can be considered truthful. To assess truthfulness, we examine indicators such as uncertainty (e.g., vague language or hesitation), internal consistency (e.g., contradictory details within or across statements in the interview), and participant-specific weighting based on predefined Attributes such as age, gender, position, or experience.

• Assess the consistency (con) of responses. Consistency refers to the degree of agreement across responses from different interviewees. It can be measured by quantifying how frequently a given statement is repeated across interviews.

• Consider applying Reference annotations at the statement or component level to provide additional information relevant to the research study or research team. For example, statement-level reference annotations can be used to identify interviewee ID numbers, and to reference external or internal rules that link to a particular statement. Researchers can add their own project-specific annotations to their codebook for data traceability.

• Consider utilizing the "Or Else" component to capture emotional consequences associated with rule (non-)compliance, in addition to the tangible or automatic consequences typically found in formal rules.

Annotations outlined in the Steps above can be applied at the statement and component levels. See IG Logico: Semantic and reference annotations for more detailed statement/component level guidance.