Skip to content

Commit

Permalink
update results including only available models
Browse files Browse the repository at this point in the history
  • Loading branch information
@lfoppiano
lfoppiano committed Nov 1, 2022
1 parent 79a3b49 commit 2273010
Showing 1 changed file with 31 additions and 31 deletions.
62 changes: 31 additions & 31 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -57,44 +57,44 @@ Update on the 27/10/2022

#### Quantities

| Labels | CRF | | | **BidLSTM_CRF** | | | **BidLSTM_CRF_FEATURES** | | | **SciBERT** | | |
|-----------------|----------------|-------------|---------------|-----------------|-------------|---------------|--------------------------|-------------|---------------|-------------------|---------------|----------------|
| Metrics | **Precision** | **Recall** | **F1-Score** | **Precision** | **Recall** | **F1-Score** | **Precision** | **Recall** | **F1-Score** | **Precision** | **Recall** | **F1-Score** |
| `<unitLeft>` | 88.74 | 83.19 | 85.87 | 88.56 | 92.07 | 90.28 | 88.91 | 92.20 | 90.53 | 93.26 | 70.39 | 80.23 |
| `<unitRight>` | 30.77 | 30.77 | 30.77 | 24.75 | 30.77 | 27.42 | 21.73 | 30.77 | 25.41 | 17.31 | 21.54 | 19.18 |
| `<valueAtomic> | 76.29 | 78.66 | 77.46 | 78.14 | 86.06 | 81.90 | 78.21 | 86.20 | 82.01 | 83.41 | 69.33 | 75.72 |
| `<valueBase>` | 84.62 | 62.86 | 72.13 | 83.51 | 94.86 | 88.61 | 83.36 | 97.14 | 89.72 | 90.24 | 59.43 | 71.53 |
| `<valueLeast>` | 77.68 | 69.05 | 73.11 | 82.14 | 60.63 | 69.67 | 80.73 | 60.63 | 69.12 | 79.31 | 53.49 | 63.88 |
| `<valueList>` | 45.45 | 18.87 | 26.67 | 62.15 | 10.19 | 17.34 | 73.33 | 8.68 | 15.33 | 56.77 | 30.95 | 40.01 |
| `<valueMost>` | 71.62 | 54.64 | 61.99 | 77.64 | 68.25 | 72.61 | 77.25 | 70.31 | 73.58 | 73.72 | 51.34 | 60.52 |
| `<valueRange>` | 100 | 97.14 | 98.55 | 96.72 | 100.00 | 98.32 | 94.05 | 98.86 | 96.38 | 99.09 | 60.00 | 74.74 |
| -- | | | | | | | | | | | | |
| All (micro avg) | 80.08 | 75 | 77.45 | 81.81 | 81.73 | 81.76 | 81.76 | 81.94 | 81.85 | 84.41 | 64.70 | 73.25 |
| Labels | CRF | | | **BidLSTM_CRF** | | |
|-----------------|----------------|-------------|---------------|-----------------|-------------|---------------|
| Metrics | **Precision** | **Recall** | **F1-Score** | **Precision** | **Recall** | **F1-Score** |
| `<unitLeft>` | 88.74 | 83.19 | 85.87 | 88.56 | 92.07 | 90.28 |
| `<unitRight>` | 30.77 | 30.77 | 30.77 | 24.75 | 30.77 | 27.42 |
| `<valueAtomic> | 76.29 | 78.66 | 77.46 | 78.14 | 86.06 | 81.90 |
| `<valueBase>` | 84.62 | 62.86 | 72.13 | 83.51 | 94.86 | 88.61 |
| `<valueLeast>` | 77.68 | 69.05 | 73.11 | 82.14 | 60.63 | 69.67 |
| `<valueList>` | 45.45 | 18.87 | 26.67 | 62.15 | 10.19 | 17.34 |
| `<valueMost>` | 71.62 | 54.64 | 61.99 | 77.64 | 68.25 | 72.61 |
| `<valueRange>` | 100 | 97.14 | 98.55 | 96.72 | 100.00 | 98.32 |
| -- | | | | | | |
| All (micro avg) | 80.08 | 75 | 77.45 | 81.81 | 81.73 | 81.76 |

#### Units

| | **CRF** | | | **BidLSTM_CRF** | | | **BidLSTM_CRF_FEATURES** | | | **SciBERT** | | |
|-----------------|---------------------|------------|--------------|------------------|------------|----------------|--------------------------|------------|--------------|---------------|------------|--------------|
| Labels | **Precision** | **Recall** | **F1-Score** | **Precision** | **Recall** | **F1-Score** | **Precision** | **Recall** | **F1-Score** | **Precision** | **Recall** | **F1-Score** |
| `<base>` | 80.57 | 82.34 | 81.45 | 56.01 | 50.34 | 53.02 | 63.89 | 61.11 | 62.45 | 73.23 | 72.51 | 72.85 |
| `<pow>` | 72.65 | 74.45 | 73.54 | 93.70 | 62.38 | 74.88 | 90.83 | 70.24 | 79.19 | 70.72 | 49.41 | 58.11 |
| `<prefix>` | 93.8 | 84.69 | 89.02 | 80.31 | 85.25 | 82.54 | 82.55 | 83.51 | 82.95 | 74.60 | 82.75 | 78.45 |
| -- | | | | | | | | | | | | |
| All (micro avg) | 80.73 | 80.6 | 80.66 | 70.19 | 60.88 | 65.20 | 74.48 | 68.27 | 71.30 | 72.91 | 68.09 | 70.41 |
| | **CRF** | | | **BidLSTM_CRF** | | |
|-----------------|---------------------|------------|--------------|------------------|------------|----------------|
| Labels | **Precision** | **Recall** | **F1-Score** | **Precision** | **Recall** | **F1-Score** |
| `<base>` | 80.57 | 82.34 | 81.45 | 56.01 | 50.34 | 53.02 |
| `<pow>` | 72.65 | 74.45 | 73.54 | 93.70 | 62.38 | 74.88 |
| `<prefix>` | 93.8 | 84.69 | 89.02 | 80.31 | 85.25 | 82.54 |
| -- | | | | | | |
| All (micro avg) | 80.73 | 80.6 | 80.66 | 70.19 | 60.88 | 65.20 |


#### Values

| | **CRF** | | | **BidLSTM_CRF** | | | **BidLSTM_CRF_FEATURES** | | | **SciBERT** | | |
|-----------------|------------------|------------|--------------|-----------------|------------|----------|--------------------------|------------|----------------|---------------|------------|--------------|
| Labels | **Precision** | **Recall** | **F1-Score** | **Precision** | **Recall** | F1-Score | **Precision** | **Recall** | **F1-Score** | **Precision** | **Recall** | **F1-Score** |
| `<alpha>` | 97.66 | 99.21 | 98.43 | 99.53 | 100.00 | 99.76 | 99.37 | 99.37 | 99.68 | 99.84 | 100.00 | 99.92 |
| `<base>` | 76.92 | 76.92 | 76.92 | 98.18 | 76.92 | 86.23 | 96.36 | 96.36 | 85.51 | 85.11 | 84.62 | 84.70 |
| `<number>` | 97.8 | 98.52 | 98.16 | 98.93 | 97.73 | 98.32 | 98.83 | 98.83 | 98.50 | 98.46 | 98.94 | 98.70 |
| `<pow>` | 83.33 | 76.92 | 80 | 100.00 | 76.92 | 86.96 | 96.36 | 96.36 | 85.51 | 92.14 | 90.77 | 91.31 |
| `<time>` | 70.18 | 86.96 | 77.67 | 73.17 | 96.52 | 83.05 | 78.43 | 78.43 | 85.01 | 89.44 | 87.83 | 88.52 |
| -- | | | | | | | | | | | | |
| All (micro avg) | 95.81 | 97.52 | 96.66 | 97.41 | 97.42 | 97.41 | 97.62 | 97.62 | 97.64 | 97.95 | 98.28 | 98.11 |
| | **CRF** | | | **BidLSTM_CRF** | | |
|-----------------|------------------|------------|--------------|-----------------|------------|----------|
| Labels | **Precision** | **Recall** | **F1-Score** | **Precision** | **Recall** | F1-Score |
| `<alpha>` | 97.66 | 99.21 | 98.43 | 99.53 | 100.00 | 99.76 |
| `<base>` | 76.92 | 76.92 | 76.92 | 98.18 | 76.92 | 86.23 |
| `<number>` | 97.8 | 98.52 | 98.16 | 98.93 | 97.73 | 98.32 |
| `<pow>` | 83.33 | 76.92 | 80 | 100.00 | 76.92 | 86.96 |
| `<time>` | 70.18 | 86.96 | 77.67 | 73.17 | 96.52 | 83.05 |
| -- | | | | | | |
| All (micro avg) | 95.81 | 97.52 | 96.66 | 97.41 | 97.42 | 97.41 |


<details>
Expand Down

0 comments on commit 2273010

Please sign in to comment.