Synthesis after a couple PINTs

This repository contains the data and code for "Synthesis after a couple PINTs: Investigating the role of pause-internal phonetic particles in speech synthesis and perception" by Mikey Elmers, Johannah O'Mahony, and Éva Székely for the 24th INTERSPEECH Conference (Interspeech '23), Dublin, August 20-24. This project developed TTS systems that included pause-internal phonetic particles and evaluated speaker certainty.

A demo of the text-to-speech stimuli can be found here.

The following PINTs are investigated:

• silence (sil)
• inhalation noise (in)
• exhalation noise (ex)
• filler particles (uh/um)
• tongue click (cl)

Table Of Contents

• Instructions
• Directory information
  • data
  • docs
  • output
  • scripts
• Citation
• Issues/comments/suggestions
• License
• References

Instructions

1. Clone repository.

   git clone https://github.com/MikeyElmers/paper_interspeech23.git
   cd paper_interspeech23/

2. Rmarkdown documents and the sessionInfo are located in output/.

Directory Information

data

• Raw data
• Final data

docs

• elmers_interspeech23_paper.pdf: Interspeech '23 paper submission
• elmers_interspeech23_poster.pdf: Interspeech '23 poster submission

output

• 02_analysis.html: Output of analysis.Rmd file
• sessionInfo.txt: R session info
• plot_heatmag.png: Heatmap for certainty score and condition

scripts

• 00_renvRestore.R: Restores project dependencies
• 01_clean.R: Cleans and exports final data
• 02_eda.Rmd: Descriptive and inferential data analysis

Citation

If you use this data or code for you work, please cite as:

@inproceedings{elmers23interspeech,
  author={Mikey Elmers and Johannah O'Mahony and \'{E}va Sz\'{e}kely},
  title={{Synthesis after a couple PINTs: Investigating the Role of Pause-Internal Phonetic Particles in Speech Synthesis and Perception}},
  year=2023,
  booktitle={Proc. INTERSPEECH 2023},
  pages={4843--4847},
  doi={10.21437/Interspeech.2023-2178}
}

Issues/Comments/Suggestions

Please use the issue tracker.

License

This code is licensed under the terms of the MIT license. See LICENSE.md

References

Langdon Hammer, Modern Poetry (Yale University: Open Yale Couses), http://oyc.yale.edu (Accessed June 27, 2022). License: Creative Commons BY-NC-SA