update evaluation scores

lfoppiano · Mar 26, 2024 · 529ea2d · 529ea2d
1 parent 854e129
commit 529ea2d
Show file tree

Hide file tree

Showing 2 changed files with 16 additions and 17 deletions.
diff --git a/doc/evaluation-scores.md b/doc/evaluation-scores.md
@@ -81,22 +81,21 @@ Units were evaluated using UNISCOR dataset. For more information check the secti
 | Labels          | CRF   |       |       | | BERT_CRF |       |       |        | Support |
 |-----------------|-------|-------|-------|-|----------|-------|-------|--------|---------|
 | Metrics         | P     | R     | F1    | | P        | R     | F1    | St.dev |         |
-| `<base>`        | 80.64 | 82.71 | 81.66 | | 75.42    | 75.84 | 75.52 | 0.0318 | 3228    |
-| `<pow>`         | 71.94 | 74.34 | 73.12 | | 81.48    | 55.58 | 66.00 | 0.1069 | 1773    |
-| `<prefix>`      | 92.6  | 86.48 | 89.43 | | 67.56    | 92.17 | 77.79 | 0.0300 | 1287    |
-| -----           |       |
-| All (micro avg) | 80.39 | 81.12 | 80.76 | | 73.02    | 64.97 | 68.76 | 0.0167 | 6288    |
-
-**TO BE RE-EVALUATED**
-
-| Labels          | BidLSTM_CRF |       |       | BidLSTM_CRF_FEATURES |       |       |        | Support |
-|-----------------|-------------|-------|-------|----------------------|-------|-------|--------|---------|
-| Metrics         | P           | R     | F1    | P                    | R     | F1    | St.dev |         |
-| `<base>`        | 56.01       | 50.34 | 53.02 | 59.98                | 56.33 | 58.09 | 0.0318 | 3228    |
-| `<pow>`         | 93.70       | 62.38 | 74.88 | 93.71                | 68.40 | 78.94 | 0.1069 | 1773    |
-| `<prefix>`      | 80.31       | 85.25 | 82.54 | 83.21                | 83.58 | 83.35 | 0.0300 | 1287    |
-| -----           |
-| All (micro avg) | 70.19       | 60.88 | 65.20 | 73.03                | 65.31 | 68.94 | 0.0167 | 6288    |
+| `<base>`        | 80.64 | 82.71 | 81.66 | | 73.63    | 76.26 | 74.89 | 0.0231 | 3228    |
+| `<pow>`         | 71.94 | 74.34 | 73.12 | | 80.20    | 57.35 | 66.75 | 0.0752 | 1773    |
+| `<prefix>`      | 92.6  | 86.48 | 89.43 | | 77.61    | 88.05 | 82.12 | 0.0338 | 1287    |
+| -----           |       
+| All (micro avg) | 80.39 | 81.12 | 80.76 | | 75.55    | 73.34 | 74.41 | 0.0178 | 6288    |
+
+
+| Labels          | BidLSTM_CRF |       |       |         | | BidLSTM_CRF_FEATURES |         |        |        | Support |
+|-----------------|-------------|-------|-------|---------|-|----------------------|---------|--------|--------|---------|
+| Metrics         | P           | R     | F1    | St.dev  | | P                    | R       | F1     | St.dev |         |
+| `<base>`        | 52.17       | 46.16 | 48.93 | 0.0494  | | 51.99                | 48.00   | 49.88  | 0.0259 | 3228    |
+| `<pow>`         | 94.25       | 56.89 | 70.94 | 0.0125  | | 94.20                | 56.92   | 70.96  | 0.0062 | 1773    |
+| `<prefix>`      | 81.36       | 82.88 | 82.01 | 0.0119  | | 82.11                | 82.94   | 82.43  | 0.0201 | 1287    |
+| -----           |             
+| All (micro avg) | 68.12       | 56.70 | 61.85 | 0.0282  | | 67.76                | 57.67   | 62.29  | 0.0173 | 6288    |
 
 #### Values