forked from pedrobalage/STIL_LIWC_Evaluation
-
Notifications
You must be signed in to change notification settings - Fork 0
/
output.txt
327 lines (279 loc) · 6.76 KB
/
output.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
########## Agreement ###########
Agreement between Opinion Lexicon and SentiLex : 93.68% out of 17087 entries
Agreement between Liwc and Opinion Lexicon : 35.07% out of 9810 entries
Agreement between Liwc and SentiLex : 33.03% out of 20282 entries
########### Polar Agreement #############
Agreement between Opinion Lexicon and SentiLex : 97.04% out of 13880 entries
Agreement between Liwc and Opinion Lexicon : 80.17% out of 1871 entries
Agreement between Liwc and SentiLex : 74.83% out of 7310 entries
AGREEMENT EXAMPLES (OpinionLexicon)
pol word
1 acreditada
1 acreditado
1 adequada
1 adoradas
-1 aterrorizados
1 elogiar
1 esperados
1 honestas
-1 inimigos
-1 insegura
-1 lesar
-1 lesas
-1 necessitadas
-1 perverter
1 relaxar
-1 reprimidas
-1 surpreendidas
-1 tremida
-1 tremido
1 vivificar
DISAGREEMENT EXAMPLES (OpinionLexicon)
lwic oplex word
1 -1 abismais
1 -1 animais
-1 1 ansiar
1 -1 apoiados
1 -1 atraídas
1 -1 bobos
1 -1 deleitada
1 -1 deleitadas
1 -1 deleitados
-1 1 destinados
-1 1 detestar
1 -1 emocionadas
-1 1 enganada
1 -1 entretido
1 -1 esquentada
1 -1 esquentado
-1 1 falsificadas
-1 1 ferida
-1 1 folgar
1 -1 fortuita
1 -1 gerar
-1 1 grave
1 -1 guardada
1 -1 guardado
1 -1 guardados
-1 1 impessoal
-1 1 implorar
-1 1 invejar
1 -1 libertar
1 -1 licenciosa
1 -1 louvados
1 -1 protegidas
-1 1 repugnar
1 -1 resguardado
1 -1 salvar
1 -1 tola
1 -1 tolo
-1 1 tremer
1 -1 vaga
1 -1 vagas
#########################################################################
######################## Opinion classification #######################
#########################################################################
Dictionary : Liwc
| - |
| 1 0 1 |
---+-------------+
-1 |<204>266 121 |
0 | . <.> . |
1 | 106 592<973>|
---+-------------+
(row = reference; col = test)
Accuracy: 0.520335985853
Metrics for class 0
Precision: 0.0
Recall : None
F_measure: None
Metrics for class 1
Precision: 0.889396709324
Recall : 0.582286056254
F_measure: 0.703797468354
Metrics for class -1
Precision: 0.658064516129
Recall : 0.345177664975
F_measure: 0.452830188679
Dictionary : Opinion Lexicon
| - |
| 1 0 1 |
---+-------------+
-1 |<217>234 140 |
0 | . <.> . |
1 | 156 589<926>|
---+-------------+
(row = reference; col = test)
Accuracy: 0.505305039788
Metrics for class 0
Precision: 0.0
Recall : None
F_measure: None
Metrics for class 1
Precision: 0.868667917448
Recall : 0.554159186116
F_measure: 0.676653270004
Metrics for class -1
Precision: 0.581769436997
Recall : 0.36717428088
F_measure: 0.45020746888
Dictionary : SentiLex
| - |
| 1 0 1 |
---+-------------+
-1 |<307>244 40 |
0 | . <.> . |
1 | 121 650<900>|
---+-------------+
(row = reference; col = test)
Accuracy: 0.533598585323
Metrics for class 0
Precision: 0.0
Recall : None
F_measure: None
Metrics for class 1
Precision: 0.957446808511
Recall : 0.538599640934
F_measure: 0.689391037917
Metrics for class -1
Precision: 0.717289719626
Recall : 0.519458544839
F_measure: 0.602551521099
#########################################################################
###################### Sentences classification #########################
#########################################################################
Dictionary : Liwc
| - |
| 1 0 1 |
---+----------------+
-1 | <131> 193 254 |
0 | 1423<3038>3650 |
1 | 196 658<1617>|
---+----------------+
(row = reference; col = test)
Accuracy: 0.428853046595
Metrics for class 0
Precision: 0.781177680638
Recall : 0.37455307607
F_measure: 0.506333333333
Metrics for class 1
Precision: 0.292881724325
Recall : 0.654390934844
F_measure: 0.404654654655
Metrics for class -1
Precision: 0.0748571428571
Recall : 0.226643598616
F_measure: 0.112542955326
Dictionary : Opinion Lexicon
| - |
| 1 0 1 |
---+----------------+
-1 | <187> 217 174 |
0 | 1938<3361>2812 |
1 | 333 879<1259>|
---+----------------+
(row = reference; col = test)
Accuracy: 0.430734767025
Metrics for class 0
Precision: 0.754094682522
Recall : 0.414375539391
F_measure: 0.534850413749
Metrics for class 1
Precision: 0.296584216726
Recall : 0.509510319709
F_measure: 0.374925550923
Metrics for class -1
Precision: 0.0760781122864
Recall : 0.323529411765
F_measure: 0.123188405797
Dictionary : SentiLex
| - |
| 1 0 1 |
---+----------------+
-1 | <279> 202 97 |
0 | 2254<4031>1826 |
1 | 323 1080<1068>|
---+----------------+
(row = reference; col = test)
Accuracy: 0.481899641577
Metrics for class 0
Precision: 0.758705063053
Recall : 0.496979410677
F_measure: 0.600566150179
Metrics for class 1
Precision: 0.357071213641
Recall : 0.432213678673
F_measure: 0.391065543757
Metrics for class -1
Precision: 0.0976890756303
Recall : 0.482698961938
F_measure: 0.16249271986
#########################################################################
################### Polar Sentences classification ######################
#########################################################################
Dictionary : Liwc
| - |
| 1 0 1 |
---+----------------+
-1 | <131> 193 254 |
0 | . <.> . |
1 | 196 658<1617>|
---+----------------+
(row = reference; col = test)
Accuracy: 0.573302722204
Metrics for class 0
Precision: 0.0
Recall : None
F_measure: None
Metrics for class 1
Precision: 0.864243719936
Recall : 0.654390934844
F_measure: 0.744818056195
Metrics for class -1
Precision: 0.400611620795
Recall : 0.226643598616
F_measure: 0.289502762431
Dictionary : Opinion Lexicon
| - |
| 1 0 1 |
---+----------------+
-1 | <187> 217 174 |
0 | . <.> . |
1 | 333 879<1259>|
---+----------------+
(row = reference; col = test)
Accuracy: 0.474253853723
Metrics for class 0
Precision: 0.0
Recall : None
F_measure: None
Metrics for class 1
Precision: 0.878576413119
Recall : 0.509510319709
F_measure: 0.644979508197
Metrics for class -1
Precision: 0.359615384615
Recall : 0.323529411765
F_measure: 0.340619307832
Dictionary : SentiLex
| - |
| 1 0 1 |
---+----------------+
-1 | <279> 202 97 |
0 | . <.> . |
1 | 323 1080<1068>|
---+----------------+
(row = reference; col = test)
Accuracy: 0.441784191538
Metrics for class 0
Precision: 0.0
Recall : None
F_measure: None
Metrics for class 1
Precision: 0.916738197425
Recall : 0.432213678673
F_measure: 0.587458745875
Metrics for class -1
Precision: 0.463455149502
Recall : 0.482698961938
F_measure: 0.472881355932