[Bug] Phoneme extraction with punctuations is wrongly delimited

[erogol]

Describe the bug
Punctuations in extracted phonemes are delimited wrongly.

For instance the sentence tuː foːɹ paʊndz , bʌt hɛviɚ aɪɚnz , should be tuː foːɹ paʊndz, bʌt hɛviɚ aɪɚnz,

So punctuations do not need a space preceding them.

I think the current implementation causes unnatural silences in the trained models.

[synesthesiam]

I'm reworking parts of gruut's tokenization pipeline to preserve whitespace. I'll delay updating the current pull request until these changes are in.

[skol101]

@erogol would love to see it in the next minor version update, please.

[erogol]

It is pretty much in the hands of @synesthesiam

[synesthesiam]

I'm working on it! I have this pesky job that keeps taking my time 😉

This is taking longer than expected since I'm adding it and preliminary SSML support at this same time. It didn't seem worth it to me to redo the existing gruut tokenizer (to add proper whitespace preservation) only to scrap it later for SSML.

I will be completing the changes to gruut this week, and my goal is to have it integrated and tested with 🐸 TTS by 1 Oct 👍

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. You might also look our discussion channels.

[erogol]

I think Gruut 2 adresses this right @synesthesiam

[synesthesiam]

Yes, the punctuation doesn't have whitespace artificially added now.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. You might also look our discussion channels.

[erogol]

I close this as it's been fixed by the latest Gruut