Skip to content

Named Entity Recognition and Relation Extraction performance

Nic Dobbins edited this page Nov 9, 2021 · 5 revisions

Named Entity Recognition

Entity Precision(%) Recall(%) F1(%)
Acuteness 82.6 97.7 89.5
Age 92.1 95.4 93.7
Allergy 100.0 93.5 96.6
Allergy_Name 100.0 44.4 61.5
And 66.2 69.9 68.0
Assertion 63.2 65.6 64.4
Assertion-Negation 48.1 61.9 54.1
Birth 100.0 100.0 100.0
Condition 77.6 80.0 78.8
Condition_Name 80.3 78.3 79.3
Contraindication 83.3 78.9 81.0
Criteria_Count 100.0 100.0 100.0
Death 25.0 33.3 28.5
Drug 75.3 86.8 80.7
Drug_Name 77.0 87.2 81.8
Encounter 65.8 62.7 64.2
Encounter_Type 76.9 68.9 72.7
Eq_Comparison 84.9 85.1 85.0
Eq_Operator 94.2 96.3 95.2
Eq_Temporal_Period 90.4 89.2 89.8
Eq_Temporal_Recency 68.9 76.9 72.7
Eq_Temporal_Unit 95.7 97.6 96.6
Eq_Unit 84.0 87.6 85.8
Eq_Value 92.2 94.9 93.5
Ethnicity 100.0 66.6 80.0
Exception 78.9 71.4 75.0
Family_Member 66.6 28.5 40.0
Immunization 0.0 0.0 0.0
Indication 75.0 100.0 85.7
Insurance 0.0 0.0 0.0
Language 92.5 96.1 94.3
Life_Stage_And_Gender 93.8 93.2 93.5
Location 67.2 58.7 62.7
Modifier 68.0 57.3 62.4
Negation 76.8 82.4 79.5
Observation 68.0 63.0 65.4
Observation_Name 72.7 64.2 68.2
Observation_Specimen 66.6 50.0 57.1
Or 90.0 94.8 92.3
Other 83.9 97.9 90.3
Polarity 86.1 82.6 84.3
Procedure 69.3 73.8 71.4
Procedure_Name 73.8 68.5 71.0
Provider 60.0 18.7 28.5
Risk 93.1 96.4 94.7
Severity 86.0 91.9 88.8
Stability 82.7 67.6 74.4
Study 67.7 83.7 74.9
Temporal_Connection 81.7 78.3 80.0

Relation Extraction

Relation Precision(%) Recall(%) F1(%)
Acuteness 81.4 100.0 89.8
Arg1 78.6 93.2 85.3
Arg2 83.5 95.4 89.1
Asserted 67.7 86.6 76.0
Contraindicates 93.3 100.0 96.5
Criteria 100.0 100.0 100.0
Dose 100.0 100.0 100.0
Duration 40.5 83.3 54.5
Eq-Comparison 83.8 96.8 89.8
Except 81.2 81.2 81.2
From 75.0 92.3 82.7
Has 43.7 87.5 58.3
Indication-For 40.0 66.6 50.0
Is-Other 82.3 100.0 90.3
Location 78.2 100.0 87.8
Min-Value 100.0 100.0 100.0
Minimum-Count 61.9 68.4 65.0
Modifies 87.9 95.0 91.3
Name 81.2 100.0 89.6
Negates 69.1 94.4 79.8
Polarity 90.0 96.4 93.1
Provider 36.8 87.5 51.8
Refers-To 27.2 60.0 37.5
Risk-For 100.0 100.0 100.0
Severity 88.6 95.9 92.1
Stability 75.0 84.3 79.4
Stage 100.0 73.3 84.6
Study-Of 61.1 78.5 68.7
Temporal-Unit 100.0 100.0 100.0
Temporality 79.5 92.8 85.7
Type 100.0 66.6 80.0
Abbrev-Of 82.9 82.9 82.9
Caused-By 50.7 86.4 64.0
Equivalent-To 42.6 68.6 52.6
Example-Of 83.3 93.5 88.1
Found-By 48.8 84.6 61.9
If-Then 47.6 74.0 57.9
Treatment-For 52.1 78.2 62.6
Using 51.7 93.5 66.6
Clone this wiki locally