-
Notifications
You must be signed in to change notification settings - Fork 2
Named Entity Recognition and Relation Extraction performance
Nic Dobbins edited this page Nov 9, 2021
·
5 revisions
Entity | Precision(%) | Recall(%) | F1(%) |
---|---|---|---|
Acuteness | 82.6 | 97.7 | 89.5 |
Age | 92.1 | 95.4 | 93.7 |
Allergy | 100.0 | 93.5 | 96.6 |
Allergy_Name | 100.0 | 44.4 | 61.5 |
And | 66.2 | 69.9 | 68.0 |
Assertion | 63.2 | 65.6 | 64.4 |
Assertion-Negation | 48.1 | 61.9 | 54.1 |
Birth | 100.0 | 100.0 | 100.0 |
Condition | 77.6 | 80.0 | 78.8 |
Condition_Name | 80.3 | 78.3 | 79.3 |
Contraindication | 83.3 | 78.9 | 81.0 |
Criteria_Count | 100.0 | 100.0 | 100.0 |
Death | 25.0 | 33.3 | 28.5 |
Drug | 75.3 | 86.8 | 80.7 |
Drug_Name | 77.0 | 87.2 | 81.8 |
Encounter | 65.8 | 62.7 | 64.2 |
Encounter_Type | 76.9 | 68.9 | 72.7 |
Eq_Comparison | 84.9 | 85.1 | 85.0 |
Eq_Operator | 94.2 | 96.3 | 95.2 |
Eq_Temporal_Period | 90.4 | 89.2 | 89.8 |
Eq_Temporal_Recency | 68.9 | 76.9 | 72.7 |
Eq_Temporal_Unit | 95.7 | 97.6 | 96.6 |
Eq_Unit | 84.0 | 87.6 | 85.8 |
Eq_Value | 92.2 | 94.9 | 93.5 |
Ethnicity | 100.0 | 66.6 | 80.0 |
Exception | 78.9 | 71.4 | 75.0 |
Family_Member | 66.6 | 28.5 | 40.0 |
Immunization | 0.0 | 0.0 | 0.0 |
Indication | 75.0 | 100.0 | 85.7 |
Insurance | 0.0 | 0.0 | 0.0 |
Language | 92.5 | 96.1 | 94.3 |
Life_Stage_And_Gender | 93.8 | 93.2 | 93.5 |
Location | 67.2 | 58.7 | 62.7 |
Modifier | 68.0 | 57.3 | 62.4 |
Negation | 76.8 | 82.4 | 79.5 |
Observation | 68.0 | 63.0 | 65.4 |
Observation_Name | 72.7 | 64.2 | 68.2 |
Observation_Specimen | 66.6 | 50.0 | 57.1 |
Or | 90.0 | 94.8 | 92.3 |
Other | 83.9 | 97.9 | 90.3 |
Polarity | 86.1 | 82.6 | 84.3 |
Procedure | 69.3 | 73.8 | 71.4 |
Procedure_Name | 73.8 | 68.5 | 71.0 |
Provider | 60.0 | 18.7 | 28.5 |
Risk | 93.1 | 96.4 | 94.7 |
Severity | 86.0 | 91.9 | 88.8 |
Stability | 82.7 | 67.6 | 74.4 |
Study | 67.7 | 83.7 | 74.9 |
Temporal_Connection | 81.7 | 78.3 | 80.0 |
Relation | Precision(%) | Recall(%) | F1(%) |
---|---|---|---|
Acuteness | 81.4 | 100.0 | 89.8 |
Arg1 | 78.6 | 93.2 | 85.3 |
Arg2 | 83.5 | 95.4 | 89.1 |
Asserted | 67.7 | 86.6 | 76.0 |
Contraindicates | 93.3 | 100.0 | 96.5 |
Criteria | 100.0 | 100.0 | 100.0 |
Dose | 100.0 | 100.0 | 100.0 |
Duration | 40.5 | 83.3 | 54.5 |
Eq-Comparison | 83.8 | 96.8 | 89.8 |
Except | 81.2 | 81.2 | 81.2 |
From | 75.0 | 92.3 | 82.7 |
Has | 43.7 | 87.5 | 58.3 |
Indication-For | 40.0 | 66.6 | 50.0 |
Is-Other | 82.3 | 100.0 | 90.3 |
Location | 78.2 | 100.0 | 87.8 |
Min-Value | 100.0 | 100.0 | 100.0 |
Minimum-Count | 61.9 | 68.4 | 65.0 |
Modifies | 87.9 | 95.0 | 91.3 |
Name | 81.2 | 100.0 | 89.6 |
Negates | 69.1 | 94.4 | 79.8 |
Polarity | 90.0 | 96.4 | 93.1 |
Provider | 36.8 | 87.5 | 51.8 |
Refers-To | 27.2 | 60.0 | 37.5 |
Risk-For | 100.0 | 100.0 | 100.0 |
Severity | 88.6 | 95.9 | 92.1 |
Stability | 75.0 | 84.3 | 79.4 |
Stage | 100.0 | 73.3 | 84.6 |
Study-Of | 61.1 | 78.5 | 68.7 |
Temporal-Unit | 100.0 | 100.0 | 100.0 |
Temporality | 79.5 | 92.8 | 85.7 |
Type | 100.0 | 66.6 | 80.0 |
Abbrev-Of | 82.9 | 82.9 | 82.9 |
Caused-By | 50.7 | 86.4 | 64.0 |
Equivalent-To | 42.6 | 68.6 | 52.6 |
Example-Of | 83.3 | 93.5 | 88.1 |
Found-By | 48.8 | 84.6 | 61.9 |
If-Then | 47.6 | 74.0 | 57.9 |
Treatment-For | 52.1 | 78.2 | 62.6 |
Using | 51.7 | 93.5 | 66.6 |
Clinical Trials Gov Annotation Guidelines - June 2020 by Nic Dobbins (ndobb@uw.edu)
- Demographics & Family
- Biomedical
- Boolean, Negations, & Conjunctives
- Temporal & Numerical
- Other