-
Notifications
You must be signed in to change notification settings - Fork 15
/
RESULTS_summary_tts_pytorch
68 lines (68 loc) · 4.63 KB
/
RESULTS_summary_tts_pytorch
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
ASV-libri_dev_enrolls-libri_dev_trials_f EER: 8.665%
ASV-libri_dev_enrolls-libri_dev_trials_m EER: 1.242%
ASV-vctk_dev_enrolls-vctk_dev_trials_f EER: 2.864%
ASV-vctk_dev_enrolls-vctk_dev_trials_m EER: 1.439%
ASV-vctk_dev_enrolls-vctk_dev_trials_f_common EER: 2.616%
ASV-vctk_dev_enrolls-vctk_dev_trials_m_common EER: 1.425%
ASV-libri_test_enrolls-libri_test_trials_f EER: 7.664%
ASV-libri_test_enrolls-libri_test_trials_m EER: 1.114%
ASV-vctk_test_enrolls-vctk_test_trials_f EER: 4.887%
ASV-vctk_test_enrolls-vctk_test_trials_m EER: 2.067%
ASV-vctk_test_enrolls-vctk_test_trials_f_common EER: 2.89%
ASV-vctk_test_enrolls-vctk_test_trials_m_common EER: 1.13%
ASV-libri_dev_enrolls_anon-libri_dev_trials_f_anon EER: 17.33%
ASV-libri_dev_enrolls_anon-libri_dev_trials_m_anon EER: 5.901%
ASV-vctk_dev_enrolls_anon-vctk_dev_trials_f_anon EER: 8.928%
ASV-vctk_dev_enrolls_anon-vctk_dev_trials_f_common_anon EER: 8.14%
ASV-vctk_dev_enrolls_anon-vctk_dev_trials_m_anon EER: 6.948%
ASV-vctk_dev_enrolls_anon-vctk_dev_trials_m_common_anon EER: 9.687%
ASV-libri_test_enrolls_anon-libri_test_trials_f_anon EER: 9.854%
ASV-libri_test_enrolls_anon-libri_test_trials_m_anon EER: 8.241%
ASV-vctk_test_enrolls_anon-vctk_test_trials_f_anon EER: 11.11%
ASV-vctk_test_enrolls_anon-vctk_test_trials_f_common_anon EER: 11.85%
ASV-vctk_test_enrolls_anon-vctk_test_trials_m_anon EER: 9.3%
ASV-vctk_test_enrolls_anon-vctk_test_trials_m_common_anon EER: 7.627%
ASR-libri_dev_asr %WER 3.82 [ 1518 / 39783, 185 ins, 140 del, 1193 sub ] exp/models/asr_eval/decode_libri_dev_asr_tglarge/wer_13_0.0
ASR-libri_test_asr %WER 4.15 [ 1453 / 35042, 174 ins, 157 del, 1122 sub ] exp/models/asr_eval/decode_libri_test_asr_tglarge/wer_12_1.0
ASR-vctk_dev_asr %WER 10.79 [ 9348 / 86627, 993 ins, 1354 del, 7001 sub ] exp/models/asr_eval/decode_vctk_dev_asr_tglarge/wer_14_0.5
ASR-vctk_test_asr %WER 12.81 [ 11103 / 86642, 1300 ins, 1472 del, 8331 sub ] exp/models/asr_eval/decode_vctk_test_asr_tglarge/wer_14_0.0
ASR-libri_dev_asr_anon %WER 4.13 [ 1643 / 39783, 205 ins, 150 del, 1288 sub ] exp/models/user_asr_eval_anon/decode_libri_dev_asr_anon_tglarge/wer_12_0.0
ASR-libri_test_asr_anon %WER 4.43 [ 1554 / 35042, 168 ins, 183 del, 1203 sub ] exp/models/user_asr_eval_anon/decode_libri_test_asr_anon_tglarge/wer_12_1.0
ASR-vctk_dev_asr_anon %WER 10.87 [ 9415 / 86627, 1214 ins, 1160 del, 7041 sub ] exp/models/user_asr_eval_anon/decode_vctk_dev_asr_anon_tglarge/wer_14_0.0
ASR-vctk_test_asr_anon %WER 11.02 [ 9545 / 86642, 1045 ins, 1436 del, 7064 sub ] exp/models/user_asr_eval_anon/decode_vctk_test_asr_anon_tglarge/wer_13_0.5
libri_dev_trials_f Pitch_correlation: mean=0.8404 std=0.0767
libri_dev_trials_m Pitch_correlation: mean=0.7929 std=0.1510
vctk_dev_trials_f Pitch_correlation: mean=0.8687 std=0.0887
vctk_dev_trials_m Pitch_correlation: mean=0.7968 std=0.1437
vctk_dev_trials_f_common Pitch_correlation: mean=0.8486 std=0.0800
vctk_dev_trials_m_common Pitch_correlation: mean=0.7694 std=0.1276
libri_test_trials_f Pitch_correlation: mean=0.8554 std=0.0599
libri_test_trials_m Pitch_correlation: mean=0.7541 std=0.1234
vctk_test_trials_f Pitch_correlation: mean=0.8741 std=0.0733
vctk_test_trials_m Pitch_correlation: mean=0.8073 std=0.1435
vctk_test_trials_f_common Pitch_correlation: mean=0.8539 std=0.0612
vctk_test_trials_m_common Pitch_correlation: mean=0.7576 std=0.1413
libri_dev_trials_f Gain of voice distinctiveness : -6.218362987954967
libri_dev_trials_m Gain of voice distinctiveness : -6.509125118273254
vctk_dev_trials_f Gain of voice distinctiveness : -7.456274401302824
vctk_dev_trials_m Gain of voice distinctiveness : -9.90206325335333
vctk_dev_trials_f_common Gain of voice distinctiveness : -5.367466432968449
vctk_dev_trials_m_common Gain of voice distinctiveness : -6.7544635152494426
libri_test_trials_f Gain of voice distinctiveness : -5.579195499604486
libri_test_trials_m Gain of voice distinctiveness : -5.732936451134161
vctk_test_trials_f Gain of voice distinctiveness : -8.32898258093253
vctk_test_trials_m Gain of voice distinctiveness : -9.681139033615821
vctk_test_trials_f_common Gain of voice distinctiveness : -6.683535297575608
vctk_test_trials_m_common Gain of voice distinctiveness : -6.345916844387331
Weighted average EER dev orig: 3.539
Weighted average EER test orig: 3.786
Weighted average EER dev anon: 9.874
Weighted average EER test anon: 9.580
Average WER dev orig: 7.305
Average WER test orig: 8.480
Average WER dev anon: 7.500
Average WER test anon: 7.725
Weighted average pitch correlation dev: 0.822
Weighted average pitch correlation test: 0.819
Weighted average gain of voice distinctiveness dev: -7.260
Weighted average gain of voice distinctiveness test: -7.082