ABstract: Mel-frequency filter bank (MFB) based approaches have the advantage of higher learning speeds compared to using the raw spectrum due to a smaller number of features. However, speech generators with the MFB approach require an additional computationally expensive vocoder for the training process. The pre- and post-processing needed by the MFB and the vocoder is not essential to convert human voices, because it is possible to use only the raw spectrum to generate different style of voices with clear pronunciation. In this paper, we introduce a vocoder-free end-to-end voice conversion method using a transformer network to alleviate the computational burden from additional pre- and post-processing. Our transformer-based architecture, which does not have any CNN or RNN layers, has shown the benefit of learning fast while solving the limitation of sequential computation of the conventional RNN. For this reason, our model is a fast and effective approach to convert realistic voices using raw spectra in a parallel manner to generate different style of voices with clear pronunciation. Furthermore, we can get an adapted MFB for speech recognition by multiplying the converted magnitude with the phase information, and therefore our conversion model is also suitable for speaker adaptation. We perform our voice conversion experiments on TIDIGITS-dataset using the naturalness, similarity, and clarity with Mean Opinion Score as metrics.
source.
Girl to Man (target)target.
Girl to Man (predict)predict.
Girl to Man (source)source.
Girl to Man (target)target.
Girl to Man (predict)predict.
Girl to Man (source)source.
Girl to Man (target)target.
Girl to Man (predict)predict.
Girl to Man (source)source.
Girl to Man (target)target.
Girl to Man (predict)predict.
Girl to Woman (source)source.
Girl to Woman (target)target.
Girl to Woman (predict)predict.
Girl to Woman (source)source.
Girl to Woman (target)target.
Girl to Woman (predict)predict.
Girl to Woman (source)source.
Girl to Woman (target)target.
Girl to Woman (predict)predict.
Girl to Woman (source)source.
Girl to Woman (target)target.
Girl to Woman (predict)predict.
Girl to Boy (source)source.
Girl to Boy (target)target.
Girl to Boy (predict)predict.
Girl to Boy (source)source.
Girl to Boy (target)target.
Girl to Boy (predict)predict.
Girl to Boy (source)source.
Girl to Boy (target)target.
Girl to Boy (predict)predict.
Girl to Boy (source)source.
Girl to Boy (target)target.
Girl to Boy (predict)predict.
Boy to Man (source)source.
Boy to Man (target)target.
Boy to Man (predict)predict.
Boy to Man (source)source.
Boy to Man (target)target.
Boy to Man (predict)predict.
Boy to Man (source)source.
Boy to Man (target)target.
Boy to Man (predict)predict.
Boy to Man (source)source.
Boy to Man (target)target.
Boy to Man (predict)predict.
Boy to Woman (source)source.
Boy to Woman (target)target.
Boy to Woman (predict)predict.
Boy to Woman (source)source.
Boy to Woman (target)target.
Boy to Woman (predict)predict.
Boy to Woman (source)source.
Boy to Woman (target)target.
Boy to Woman (predict)predict.
Boy to Woman (source)source.
Boy to Woman (target)target.
Boy to Woman (predict)predict.
Boy to Girl (source)source.
Boy to Girl (target)target.
Boy to Girl (predict)predict.
Boy to Girl (source)source.
Boy to Girl (target)target.
Boy to Girl (predict)predict.
Boy to Girl (source)source.
Boy to Girl (target)target.
Boy to Girl (predict)predict.
Boy to Girl (source)source.
Boy to Girl (target)target.
Boy to Girl (predict)predict.
Woman to Man (source)source.
Woman to Man (target)target.
Woman to Man (predict)predict.
Woman to Man (source)source.
Woman to Man (target)target.
Woman to Man (predict)predict.
Woman to Man (source)source.
Woman to Man (target)target.
Woman to Man (predict)predict.
Woman to Man (source)source.
Woman to Man (target)target.
Woman to Man (predict)predict.
Woman to Boy (source)source.
Woman to Boy (target)target.
Woman to Boy (predict)predict.
Woman to Boy (source)source.
Woman to Boy (target)target.
Woman to Boy (predict)predict.
Woman to Boy (source)source.
Woman to Boy (target)target.
Woman to Boy (predict)predict.
Woman to Boy (source)source.
Woman to Boy (target)target.
Woman to Boy (predict)predict.
Woman to Girl (source)source.
Woman to Girl (target)target.
Woman to Girl (predict)predict.
Woman to Girl (source)source.
Woman to Girl (target)target.
Woman to Girl (predict)predict.
Woman to Girl (source)source.
Woman to Girl (target)target.
Woman to Girl (predict)predict.
Woman to Girl (source)source.
Woman to Girl (target)target.
Woman to Girl (predict)predict.
Man to Woman (source)source.
Man to Woman (target)target.
Man to Woman (predict)predict.
Man to Woman (source)source.
Man to Woman (target)target.
Man to Woman (predict)predict.
Man to Woman (source)source.
Man to Woman (target)target.
Man to Woman (predict)predict.
Man to Woman (source)source.
Man to Woman (target)target.
Man to Woman (predict)predict.
Man to Boy (source)source.
Man to Boy (target)target.
Man to Boy (predict)predict.
Man to Boy (source)source.
Man to Boy (target)target.
Man to Boy (predict)predict.
Man to Boy (source)source.
Man to Boy (target)target.
Man to Boy (predict)predict.
Man to Boy (source)source.
Man to Boy (target)target.
Man to Boy (predict)predict.
Man to Girl (source)source.
Man to Girl (target)target.
Man to Girl (predict)predict.
Man to Girl (source)source.
Man to Girl (target)target.
Man to Girl (predict)predict.
Man to Girl (source)source.
Man to Girl (target)target.
Man to Girl (predict)predict.
Man to Girl (source)source.
Man to Girl (target)target.
Man to Girl (predict)predict.