vietnamese_hue_mfa v3.0.0

Vietnamese (Hue) MFA G2P model v3.0.0

Link to documentation on mfa-models

Jump to section:

• Model details
• Intended use
• Performance Factors
• Metrics
• Training data
• Evaluation data
• Ethical considerations
• Troubleshooting issues

Model details

• Maintainer: Montreal Forced Aligner
• Language: Vietnamese
• Dialect: N/A
• Phone set: MFA
• Model type: G2P model
• Architecture: phonetisaurus
• Model version: v3.0.0
• Trained date: 2024-03-22
• Compatible MFA version: v3.0.0
• License: CC BY 4.0
• Citation:

@techreport{mfa_vietnamese_hue_mfa_g2p_2024,
	author={McAuliffe, Michael and Sonderegger, Morgan},
	title={Vietnamese (Hue) MFA G2P model v3.0.0},
	address={\url{https://mfa-models.readthedocs.io/G2P model/Vietnamese/Vietnamese (Hue) MFA G2P model v3_0_0.html}},
	year={2024},
	month={Mar},
}

• If you have comments or questions about this model, you can check previous MFA model discussion posts or create a new one.

Installation

Install from the MFA command line:

mfa model download g2p vietnamese_hue_mfa

Or download from the release page.

Intended use

This model is intended for generating pronunciations of Vietnamese transcripts.

This model uses the MFA phone set for Vietnamese, and was trained from the pronunciation dictionaries above. Pronunciations generated with this G2P model can be appended and used when aligning or transcribing.

Performance Factors

The trained G2P models should be relatively quick and accurate, however the model may struggle when dealing with less common orthographic characters or word types outside of what it was trained on. If so, you may need to supplement the dictionary through generating, correcting, and re-training the G2P model as necessary.

Metrics

The model was trained on 90% of the dictionary and evaluated on a held-out 10% and evaluated with word error rate and phone error rate.

Training

This model was trained on the following data set:

• Words: 4,505
• Phones: 189
• Graphemes: 89

Evaluation

This model was evaluated on the following data set:

• Words: 501
• WER: 100.00%
• PER: 100.00%

Ethical considerations

Deploying any model involving language into any production setting has ethical implications. You should consider these implications before use.

Demographic Bias

You should assume every machine learning model has demographic bias unless proven otherwise. For G2P models, the model will only process the types of tokens that it was trained on, and will not represent the full range of text or spoken words that native speakers will produce. If you are using this model in production, you should acknowledge this as a potential issue.

Surveillance

Speech-to-Text technologies may be misused to invade the privacy of others by recording and mining information from private conversations. This kind of individual privacy is protected by law in many countries. You should not assume consent to record and analyze private speech.

vietnamese_ho_chi_minh_city_mfa v3.0.0

Vietnamese (Ho Chi Minh City) MFA G2P model v3.0.0

Link to documentation on mfa-models

Jump to section:

• Model details
• Intended use
• Performance Factors
• Metrics
• Training data
• Evaluation data
• Ethical considerations
• Troubleshooting issues

Model details

• Maintainer: Montreal Forced Aligner
• Language: Vietnamese
• Dialect: Southern Vietnamese
• Phone set: MFA
• Model type: G2P model
• Architecture: phonetisaurus
• Model version: v3.0.0
• Trained date: 2024-03-22
• Compatible MFA version: v3.0.0
• License: CC BY 4.0
• Citation:

@techreport{mfa_vietnamese_ho_chi_minh_city_mfa_g2p_2024,
	author={McAuliffe, Michael and Sonderegger, Morgan},
	title={Vietnamese (Ho Chi Minh City) MFA G2P model v3.0.0},
	address={\url{https://mfa-models.readthedocs.io/G2P model/Vietnamese/Vietnamese (Ho Chi Minh City) MFA G2P model v3_0_0.html}},
	year={2024},
	month={Mar},
}

• If you have comments or questions about this model, you can check previous MFA model discussion posts or create a new one.

Installation

Install from the MFA command line:

mfa model download g2p vietnamese_ho_chi_minh_city_mfa

Or download from the release page.

Intended use

This model is intended for generating pronunciations of Vietnamese transcripts.

This model uses the MFA phone set for Vietnamese, and was trained from the pronunciation dictionaries above. Pronunciations generated with this G2P model can be appended and used when aligning or transcribing.

Performance Factors

The trained G2P models should be relatively quick and accurate, however the model may struggle when dealing with less common orthographic characters or word types outside of what it was trained on. If so, you may need to supplement the dictionary through generating, correcting, and re-training the G2P model as necessary.

Metrics

The model was trained on 90% of the dictionary and evaluated on a held-out 10% and evaluated with word error rate and phone error rate.

Training

This model was trained on the following data set:

• Words: 4,505
• Phones: 123
• Graphemes: 89

Evaluation

This model was evaluated on the following data set:

• Words: 501
• WER: 100.00%
• PER: 100.00%

Ethical considerations

Deploying any model involving language into any production setting has ethical implications. You should consider these implications before use.

Demographic Bias

You should assume every machine learning model has demographic bias unless proven otherwise. For G2P models, the model will only process the types of tokens that it was trained on, and will not represent the full range of text or spoken words that native speakers will produce. If you are using this model in production, you should acknowledge this as a potential issue.

Surveillance

Speech-to-Text technologies may be misused to invade the privacy of others by recording and mining information from private conversations. This kind of individual privacy is protected by law in many countries. You should not assume consent to record and analyze private speech.

vietnamese_hanoi_mfa v3.0.0

Vietnamese (Hanoi) MFA G2P model v3.0.0

Link to documentation on mfa-models

Jump to section:

• Model details
• Intended use
• Performance Factors
• Metrics
• Training data
• Evaluation data
• Ethical considerations
• Troubleshooting issues

Model details

• Maintainer: Montreal Forced Aligner
• Language: Vietnamese
• Dialect: Northern Vietnamese
• Phone set: MFA
• Model type: G2P model
• Architecture: phonetisaurus
• Model version: v3.0.0
• Trained date: 2024-03-22
• Compatible MFA version: v3.0.0
• License: CC BY 4.0
• Citation:

@techreport{mfa_vietnamese_hanoi_mfa_g2p_2024,
	author={McAuliffe, Michael and Sonderegger, Morgan},
	title={Vietnamese (Hanoi) MFA G2P model v3.0.0},
	address={\url{https://mfa-models.readthedocs.io/G2P model/Vietnamese/Vietnamese (Hanoi) MFA G2P model v3_0_0.html}},
	year={2024},
	month={Mar},
}

• If you have comments or questions about this model, you can check previous MFA model discussion posts or create a new one.

Installation

Install from the MFA command line:

mfa model download g2p vietnamese_hanoi_mfa

Or download from the release page.

Intended use

This model is intended for generating pronunciations of Vietnamese transcripts.

This model uses the MFA phone set for Vietnamese, and was trained from the pronunciation dictionaries above. Pronunciations generated with this G2P model can be appended and used when aligning or transcribing.

Performance Factors

The trained G2P models should be relatively quick and accurate, however the model may struggle when dealing with less common orthographic characters or word types outside of what it was trained on. If so, you may need to supplement the dictionary through generating, correcting, and re-training the G2P model as necessary.

Metrics

The model was trained on 90% of the dictionary and evaluated on a held-out 10% and evaluated with word error rate and phone error rate.

Training

This model was trained on the following data set:

• Words: 4,505
• Phones: 165
• Graphemes: 89

Evaluation

This model was evaluated on the following data set:

• Words: 501
• WER: 100.00%
• PER: 100.00%

Ethical considerations

Deploying any model involving language into any production setting has ethical implications. You should consider these implications before use.

Demographic Bias

You should assume every machine learning model has demographic bias unless proven otherwise. For G2P models, the model will only process the types of tokens that it was trained on, and will not represent the full range of text or spoken words that native speakers will produce. If you are using this model in production, you should acknowledge this as a potential issue.

Surveillance

Speech-to-Text technologies may be misused to invade the privacy of others by recording and mining information from private conversations. This kind of individual privacy is protected by law in many countries. You should not assume consent to record and analyze private speech.

vietnamese_mfa v3.0.0

Vietnamese MFA dictionary v3.0.0

Link to documentation on mfa-models

Jump to section:

• Dictionary details
• Intended use
• Performance Factors
• Ethical considerations

Dictionary details

• Maintainer: Montreal Forced Aligner
• Language: Vietnamese
• Dialect: N/A
• Phone set: MFA
• Number of words: 1,788
• Phones: aː˦˥ aː˨ˀ˥ aː˨˦ aː˨˨ aː˨˩ aː˨˩ˀ aː˨˩˦ aː˨˩˨ a˦˥ a˨ˀ˥ a˨˦ a˨˨ a˨˩ a˨˩ˀ a˨˩˦ a˨˩˨ c eː˦˥ eː˨ˀ˥ eː˨˦ eː˨˨ eː˨˩ eː˨˩ˀ eː˨˩˦ eː˨˩˨ e˨˨ e˨˩ˀ f h iə˦˥ iə˨ˀ˥ iə˨˦ iə˨˨ iə˨˩ iə˨˩ˀ iə˨˩˦ iə˨˩˨ iː˦˥ iː˨ˀ˥ iː˨˦ iː˨˨ iː˨˩ iː˨˩ˀ iː˨˩˦ iː˨˩˨ i˦˥ i˨ˀ˥ i˨˦ i˨˨ i˨˩ i˨˩ˀ i˨˩˦ i˨˩˨ j k kp k̚ l m n oː˦˥ oː˨ˀ˥ oː˨˦ oː˨˨ oː˨˩ oː˨˩ˀ oː˨˩˦ oː˨˩˨ o˦˥ o˨ˀ˥ o˨˦ o˨˨ o˨˩ o˨˩ˀ o˨˩˦ o˨˩˨ p̚ r s t tɕ tʰ t̚ uə˦˥ uə˨˦ uə˨˨ uə˨˩ uə˨˩ˀ uə˨˩˦ uə˨˩˨ uː˦˥ uː˨ˀ˥ uː˨˦ uː˨˨ uː˨˩ uː˨˩ˀ uː˨˩˦ uː˨˩˨ u˦˥ u˨ˀ˥ u˨˦ u˨˨ u˨˩ u˨˩ˀ u˨˩˦ u˨˩˨ v w x z ŋ ŋm ɓ ɔː˦˥ ɔː˨ˀ˥ ɔː˨˦ ɔː˨˨ ɔː˨˩ ɔː˨˩ˀ ɔː˨˩˦ ɔː˨˩˨ ɔ˦˥ ɔ˨˦ ɔ˨˨ ɔ˨˩ ɔ˨˩ˀ ɔ˨˩˦ ɔ˨˩˨ ɗ əː˦˥ əː˨ˀ˥ əː˨˦ əː˨˨ əː˨˩ əː˨˩ˀ əː˨˩˦ əː˨˩˨ ə˦˥ ə˨ˀ˥ ə˨˦ ə˨˨ ə˨˩ ə˨˩ˀ ə˨˩˦ ə˨˩˨ ɛː˦˥ ɛː˨ˀ˥ ɛː˨˦ ɛː˨˨ ɛː˨˩ ɛː˨˩ˀ ɛː˨˩˦ ɛː˨˩˨ ɡ ɣ ɨə˦˥ ɨə˨ˀ˥ ɨə˨˦ ɨə˨˨ ɨə˨˩ ɨə˨˩ˀ ɨə˨˩˦ ɨə˨˩˨ ɨː˦˥ ɨː˨ˀ˥ ɨː˨˦ ɨː˨˨ ɨː˨˩ ɨː˨˩ˀ ɨː˨˩˦ ɨː˨˩˨ ɨ˦˥ ɨ˨ˀ˥ ɨ˨˦ ɨ˨˨ ɨ˨˩ ɨ˨˩ˀ ɨ˨˩˦ ɨ˨˩˨ ɲ ʈ ʔ
• License: CC BY 4.0
• Compatible MFA version: v3.0.0
• Citation:

@techreport{mfa_vietnamese_mfa_dictionary_2024,
	author={McAuliffe, Michael and Sonderegger, Morgan},
	title={Vietnamese MFA dictionary v3.0.0},
	address={\url{https://mfa-models.readthedocs.io/pronunciation dictionary/Vietnamese/Vietnamese MFA dictionary v3_0_0.html}},
	year={2024},
	month={Mar},
}

• If you have comments or questions about this dictionary or its phone set, you can check previous MFA model discussion posts or create a new one.
• The dictionary downloadable from this release has trained pronunciation and silence probabilities. The base dictionary is available here

##Installation

Install from the MFA command line:

mfa model download dictionary vietnamese_mfa

Or download from the release page.

The dictionary available from the release page and command line installation has pronunciation and silence probabilities estimated as part acoustic model training (see Silence probability format and training pronunciation probabilities for more information. If you would like to use the version of this dictionary without probabilities, please see the [plain dictionary](https://raw.githubusercontent.com/MontrealCorpusTools/mfa-models/main/dictionary/vietnamese/mfa/Vietnamese MFA dictionary v3_0_0.dict).

Intended use

This dictionary is intended for forced alignment of Vietnamese transcripts.

This dictionary uses the MFA phone set for Vietnamese, and was used in training the Vietnamese MFA acoustic model. Pronunciations can be added on top of the dictionary, as long as no additional phones are introduced.

Performance Factors

When trying to get better alignment accuracy, adding pronunciations is generally helpful, especially for different styles and dialects. The most impactful improvements will generally be seen when adding reduced variants that involve deleting segments/syllables common in spontaneous speech. Alignment must include all phones specified in the pronunciation of a word, and each phone has a minimum duration (by default 10ms). If a speaker pronounces a multisyllabic word with just a single syllable, it can be hard for MFA to fit all the segments in, so it will lead to alignment errors on adjacent words as well.

Ethical considerations

Deploying any Speech-to-Text model into any production setting has ethical implications. You should consider these implications before use.

Demographic Bias

You should assume every machine learning model has demographic bias unless proven otherwise. For pronunciation dictionaries, it is often the case that transcription accuracy and lexicon coverage for the prestige variety modeled in this dictionary compared to other variants. If you are using this dictionary in production, you should acknowledge this as a potential issue.

vietnamese_ho_chi_minh_city_mfa v3.0.0

Vietnamese (Ho Chi Minh City) MFA dictionary v3.0.0

Link to documentation on mfa-models

Jump to section:

• Dictionary details
• Intended use
• Performance Factors
• Ethical considerations

Dictionary details

• Maintainer: Montreal Forced Aligner
• Language: Vietnamese
• Dialect: Southern Vietnamese
• Phone set: MFA
• Number of words: 3,739
• Phones: aː˦˥ aː˨˨ aː˨˩ aː˨˩˦ aː˨˩˨ a˦˥ a˨˨ a˨˩ a˨˩˦ a˨˩˨ c eː˦˥ eː˨˨ eː˨˩ eː˨˩˦ eː˨˩˨ f h iə˦˥ iə˨˨ iə˨˩ iə˨˩˦ iə˨˩˨ iː˦˥ iː˨˨ iː˨˩ iː˨˩˦ iː˨˩˨ i˦˥ i˨˨ i˨˩ i˨˩˦ i˨˩˨ j k kp k̚ l m n oː˦˥ oː˨˨ oː˨˩ oː˨˩˦ oː˨˩˨ o˦˥ o˨˨ o˨˩ o˨˩˦ o˨˩˨ p p̚ r s t tʰ t̚ uə˦˥ uə˨˨ uə˨˩ uə˨˩˦ uə˨˩˨ uː˦˥ uː˨˨ uː˨˩ uː˨˩˦ uː˨˩˨ u˦˥ u˨˨ u˨˩ u˨˩˦ u˨˩˨ v w x z ŋ ŋm ɓ ɔː˦˥ ɔː˨˨ ɔː˨˩ ɔː˨˩˦ ɔː˨˩˨ ɔ˦˥ ɔ˨˨ ɔ˨˩ ɔ˨˩˦ ɔ˨˩˨ ɗ əː˦˥ əː˨˨ əː˨˩ əː˨˩˦ əː˨˩˨ ə˦˥ ə˨˨ ə˨˩ ə˨˩˦ ə˨˩˨ ɛː˦˥ ɛː˨˨ ɛː˨˩ ɛː˨˩˦ ɛː˨˩˨ ɡ ɨə˦˥ ɨə˨˨ ɨə˨˩ ɨə˨˩˦ ɨə˨˩˨ ɨː˦˥ ɨː˨˨ ɨː˨˩ ɨː˨˩˦ ɨː˨˩˨ ɨ˦˥ ɨ˨˨ ɨ˨˩ ɨ˨˩˦ ɨ˨˩˨ ɲ ʈ ʔ
• License: CC BY 4.0
• Compatible MFA version: v3.0.0
• Citation:

@techreport{mfa_vietnamese_ho_chi_minh_city_mfa_dictionary_2024,
	author={McAuliffe, Michael and Sonderegger, Morgan},
	title={Vietnamese (Ho Chi Minh City) MFA dictionary v3.0.0},
	address={\url{https://mfa-models.readthedocs.io/pronunciation dictionary/Vietnamese/Vietnamese (Ho Chi Minh City) MFA dictionary v3_0_0.html}},
	year={2024},
	month={Mar},
}

• If you have comments or questions about this dictionary or its phone set, you can check previous MFA model discussion posts or create a new one.
• The dictionary downloadable from this release has trained pronunciation and silence probabilities. The base dictionary is available here

##Installation

Install from the MFA command line:

mfa model download dictionary vietnamese_ho_chi_minh_city_mfa

Or download from the release page.

The dictionary available from the release page and command line installation has pronunciation and silence probabilities estimated as part acoustic model training (see Silence probability format and training pronunciation probabilities for more information. If you would like to use the version of this dictionary without probabilities, please see the [plain dictionary](https://raw.githubusercontent.com/MontrealCorpusTools/mfa-models/main/dictionary/vietnamese/mfa/Vietnamese (Ho Chi Minh City) MFA dictionary v3_0_0.dict).

Intended use

This dictionary is intended for forced alignment of Vietnamese transcripts.

This dictionary uses the MFA phone set for Vietnamese, and was used in training the Vietnamese MFA acoustic model. Pronunciations can be added on top of the dictionary, as long as no additional phones are introduced.

Performance Factors

When trying to get better alignment accuracy, adding pronunciations is generally helpful, especially for different styles and dialects. The most impactful improvements will generally be seen when adding reduced variants that involve deleting segments/syllables common in spontaneous speech. Alignment must include all phones specified in the pronunciation of a word, and each phone has a minimum duration (by default 10ms). If a speaker pronounces a multisyllabic word with just a single syllable, it can be hard for MFA to fit all the segments in, so it will lead to alignment errors on adjacent words as well.

Ethical considerations

Deploying any Speech-to-Text model into any production setting has ethical implications. You should consider these implications before use.

Demographic Bias

You should assume every machine learning model has demographic bias unless proven otherwise. For pronunciation dictionaries, it is often the case that transcription accuracy and lexicon coverage for the prestige variety modeled in this dictionary compared to other variants. If you are using this dictionary in production, you should acknowledge this as a potential issue.

vietnamese_hanoi_mfa v3.0.0

Vietnamese (Hanoi) MFA dictionary v3.0.0

Link to documentation on mfa-models

Jump to section:

• Dictionary details
• Intended use
• Performance Factors
• Ethical considerations

Dictionary details

• Maintainer: Montreal Forced Aligner
• Language: Vietnamese
• Dialect: Northern Vietnamese
• Phone set: MFA
• Number of words: 2,456
• Phones: aː˦˥ aː˨ˀ˥ aː˨˦ aː˨˨ aː˨˩ aː˨˩ˀ aː˨˩˨ a˦˥ a˨ˀ˥ a˨˦ a˨˨ a˨˩ a˨˩ˀ a˨˩˨ c eː˦˥ eː˨ˀ˥ eː˨˦ eː˨˨ eː˨˩ eː˨˩ˀ eː˨˩˨ e˨˨ e˨˩ e˨˩ˀ f h iə˦˥ iə˨ˀ˥ iə˨˦ iə˨˨ iə˨˩ iə˨˩ˀ iə˨˩˨ iː˦˥ iː˨ˀ˥ iː˨˦ iː˨˨ iː˨˩ iː˨˩ˀ iː˨˩˨ i˦˥ i˨ˀ˥ i˨˦ i˨˨ i˨˩ i˨˩ˀ i˨˩˨ j k kp k̚ l m n oː˦˥ oː˨ˀ˥ oː˨˦ oː˨˨ oː˨˩ oː˨˩ˀ oː˨˩˨ o˦˥ o˨ˀ˥ o˨˦ o˨˨ o˨˩ o˨˩ˀ o˨˩˨ p p̚ s t tɕ tʰ t̚ uə˦˥ uə˨ˀ˥ uə˨˦ uə˨˨ uə˨˩ uə˨˩ˀ uə˨˩˨ uː˦˥ uː˨ˀ˥ uː˨˦ uː˨˨ uː˨˩ uː˨˩ˀ uː˨˩˨ u˦˥ u˨ˀ˥ u˨˦ u˨˨ u˨˩ u˨˩ˀ u˨˩˨ v w x z ŋ ŋm ɓ ɔː˦˥ ɔː˨ˀ˥ ɔː˨˦ ɔː˨˨ ɔː˨˩ ɔː˨˩ˀ ɔː˨˩˨ ɔ˦˥ ɔ˨˦ ɔ˨˨ ɔ˨˩ ɔ˨˩ˀ ɔ˨˩˨ ɗ əː˦˥ əː˨ˀ˥ əː˨˦ əː˨˨ əː˨˩ əː˨˩ˀ əː˨˩˨ ə˦˥ ə˨ˀ˥ ə˨˦ ə˨˨ ə˨˩ ə˨˩ˀ ə˨˩˨ ɛː˦˥ ɛː˨ˀ˥ ɛː˨˦ ɛː˨˨ ɛː˨˩ ɛː˨˩ˀ ɛː˨˩˨ ɣ ɨə˦˥ ɨə˨ˀ˥ ɨə˨˦ ɨə˨˨ ɨə˨˩ ɨə˨˩ˀ ɨə˨˩˨ ɨː˨ˀ˥ ɨː˨˦ ɨː˨˨ ɨː˨˩ˀ ɨː˨˩˨ ɨ˦˥ ɨ˨ˀ˥ ɨ˨˦ ɨ˨˨ ɨ˨˩ ɨ˨˩ˀ ɨ˨˩˨ ɲ ʔ
• License: CC BY 4.0
• Compatible MFA version: v3.0.0
• Citation:

@techreport{mfa_vietnamese_hanoi_mfa_dictionary_2024,
	author={McAuliffe, Michael and Sonderegger, Morgan},
	title={Vietnamese (Hanoi) MFA dictionary v3.0.0},
	address={\url{https://mfa-models.readthedocs.io/pronunciation dictionary/Vietnamese/Vietnamese (Hanoi) MFA dictionary v3_0_0.html}},
	year={2024},
	month={Mar},
}

• If you have comments or questions about this dictionary or its phone set, you can check previous MFA model discussion posts or create a new one.
• The dictionary downloadable from this release has trained pronunciation and silence probabilities. The base dictionary is available here

##Installation

Install from the MFA command line:

mfa model download dictionary vietnamese_hanoi_mfa

Or download from the release page.

The dictionary available from the release page and command line installation has pronunciation and silence probabilities estimated as part acoustic model training (see Silence probability format and training pronunciation probabilities for more information. If you would like to use the version of this dictionary without probabilities, please see the [plain dictionary](https://raw.githubusercontent.com/MontrealCorpusTools/mfa-models/main/dictionary/vietnamese/mfa/Vietnamese (Hanoi) MFA dictionary v3_0_0.dict).

Intended use

This dictionary is intended for forced alignment of Vietnamese transcripts.

This dictionary uses the MFA phone set for Vietnamese, and was used in training the Vietnamese MFA acoustic model. Pronunciations can be added on top of the dictionary, as long as no additional phones are introduced.

Performance Factors

When trying to get better alignment accuracy, adding pronunciations is generally helpful, especially for different styles and dialects. The most impactful improvements will generally be seen when adding reduced variants that involve deleting segments/syllables common in spontaneous speech. Alignment must include all phones specified in the pronunciation of a word, and each phone has a minimum duration (by default 10ms). If a speaker pronounces a multisyllabic word with just a single syllable, it can be hard for MFA to fit all the segments in, so it will lead to alignment errors on adjacent words as well.

Ethical considerations

Deploying any Speech-to-Text model into any production setting has ethical implications. You should consider these implications before use.

Demographic Bias

You should assume every machine learning model has demographic bias unless proven otherwise. For pronunciation dictionaries, it is often the case that transcription accuracy and lexicon coverage for the prestige variety modeled in this dictionary compared to other variants. If you are using this dictionary in production, you should acknowledge this as a potential issue.

vietnamese_mfa v3.0.0

Vietnamese MFA acoustic model v3.0.0

Link to documentation on mfa-models

Jump to section:

• Model details
• Installation
• Intended use
• Performance Factors
• Metrics
• Ethical considerations
• Troubleshooting issues
• Training data
• Evaluation data

Model details

• Maintainer: Montreal Forced Aligner
• Language: Vietnamese
• Dialect: N/A
• Phone set: MFA
• Model type: Acoustic
• Features: MFCC + pitch
• Architecture: gmm-hmm
• Model version: v3.0.0
• Trained date: 2024-03-22
• Compatible MFA version: v3.0.0
• License: CC BY 4.0
• Citation:

@techreport{mfa_vietnamese_mfa_acoustic_2024,
	author={McAuliffe, Michael and Sonderegger, Morgan},
	title={Vietnamese MFA acoustic model v3.0.0},
	address={\url{https://mfa-models.readthedocs.io/acoustic/Vietnamese/Vietnamese MFA acoustic model v3_0_0.html}},
	year={2024},
	month={Mar},
}

• If you have comments or questions about this model, you can check previous MFA model discussion posts or create a new one.

Installation

Install from the MFA command line:

mfa model download acoustic vietnamese_mfa

Or download from the release page.

Intended use

This model is intended for forced alignment of Vietnamese transcripts.

This model uses the MFA phone set for Vietnamese, and was trained with the pronunciation dictionaries above. Pronunciations can be added on top of the dictionary, as long as no additional phones are introduced.

Performance Factors

As forced alignment is a relatively well-constrained problem (given accurate transcripts), this model should be applicable to a range of recording conditions and speakers. However, please note that it was trained on read speech in low-noise environments, so as your data diverges from that, you may run into alignment issues or need to increase the beam size of MFA or see other recommendations in the troubleshooting section below.

Please note as well that MFA does not use state-of-the-art ASR models for forced alignment. You may get better performance (especially on speech-to-text tasks) using other frameworks like Coqui.

Metrics

Acoustic models are typically generated as one component of a larger ASR system where the metric is word error rate (WER). For forced alignment, there is typically not the same sort of gold standard measure for most languages.

As a rough approximation of the acoustic model quality, we evaluated it against the corpus it was trained on alongside a language model trained from the same data. Key caveat here is that this is not a typical WER measure on held out data, so it should not be taken as a hard measure of how well an acoustic model will generalize to your data, but rather is more of a sanity check that the training data quality was sufficiently high.

Using the pronunciation dictionaries and language models above:

• WER: 0%
• CER: 0%

Ethical considerations

Deploying any Speech-to-Text model into any production setting has ethical implications. You should consider these implications before use.

Demographic Bias

You should assume every machine learning model has demographic bias unless proven otherwise. For STT models, it is often the case that transcription accuracy is better for men than it is for women. If you are using this model in production, you should acknowledge this as a potential issue.

Surveillance

Speech-to-Text technologies may be misused to invade the privacy of others by recording and mining information from private conversations. This kind of individual privacy is protected by law in many countries. You should not assume consent to record and analyze private speech.

Troubleshooting issues

Machine learning models (like this acoustic model) perform best on data that is similar to the data on which they were trained.

The primary sources of variability in forced alignment will be the applicability of the pronunciation dictionary and how similar the speech, demographics, and recording conditions are. If you encounter issues in alignment, there are couple of avenues to improve performance:

1. Increase the beam size of MFA

   • MFA defaults to a narrow beam to ensure quick alignment and also as a way to detect potential issues in your dataset, but depending on your data, you might benefit from boosting the beam to 100 or higher.

2. Add pronunciations to the pronunciation dictionary

   • This model was trained a particular dialect/style, and so adding pronunciations more representative of the variety spoken in your dataset will help alignment.

3. Check the quality of your data

   • MFA includes a validator utility, which aims to detect issues in the dataset.
   • Use MFA's anchor utility to visually inspect your data as MFA sees it and correct issues in transcription or OOV items.

4. Adapt the model to your data

   • MFA has an adaptation command to adapt some of the model to your data based on an initial alignment, and then run another alignment with the adapted model.

Training data

This model was trained on the following corpora:

• Common Voice Vietnamese:

  • Hours: 5.91
  • Speakers: 150
  • Utterances: 5,068

• VIVOS:

  • Hours: 15.67
  • Speakers: 65
  • Utterances: 12,420

• GlobalPhone Vietnamese:

  • Hours: 19.72
  • Speakers: 129
  • Utterances: 18,842

ukrainian_mfa v3.0.0

Ukrainian MFA G2P model v3.0.0

Link to documentation on mfa-models

Jump to section:

• Model details
• Intended use
• Performance Factors
• Metrics
• Training data
• Evaluation data
• Ethical considerations
• Troubleshooting issues

Model details

• Maintainer: Montreal Forced Aligner
• Language: Ukrainian
• Dialect: N/A
• Phone set: MFA
• Model type: G2P model
• Architecture: phonetisaurus
• Model version: v3.0.0
• Trained date: 2024-03-21
• Compatible MFA version: v3.0.0
• License: CC BY 4.0
• Citation:

@techreport{mfa_ukrainian_mfa_g2p_2024,
	author={McAuliffe, Michael and Sonderegger, Morgan},
	title={Ukrainian MFA G2P model v3.0.0},
	address={\url{https://mfa-models.readthedocs.io/G2P model/Ukrainian/Ukrainian MFA G2P model v3_0_0.html}},
	year={2024},
	month={Mar},
}

• If you have comments or questions about this model, you can check previous MFA model discussion posts or create a new one.

Installation

Install from the MFA command line:

mfa model download g2p ukrainian_mfa

Or download from the release page.

Intended use

This model is intended for generating pronunciations of Ukrainian transcripts.

This model uses the MFA phone set for Ukrainian, and was trained from the pronunciation dictionaries above. Pronunciations generated with this G2P model can be appended and used when aligning or transcribing.

Performance Factors

The trained G2P models should be relatively quick and accurate, however the model may struggle when dealing with less common orthographic characters or word types outside of what it was trained on. If so, you may need to supplement the dictionary through generating, correcting, and re-training the G2P model as necessary.

Metrics

The model was trained on 90% of the dictionary and evaluated on a held-out 10% and evaluated with word error rate and phone error rate.

Training

This model was trained on the following data set:

• Words: 58,496
• Phones: 87
• Graphemes: 34

Evaluation

This model was evaluated on the following data set:

• Words: 6,499
• WER: 100.00%
• PER: 100.00%

Ethical considerations

Deploying any model involving language into any production setting has ethical implications. You should consider these implications before use.

Demographic Bias

You should assume every machine learning model has demographic bias unless proven otherwise. For G2P models, the model will only process the types of tokens that it was trained on, and will not represent the full range of text or spoken words that native speakers will produce. If you are using this model in production, you should acknowledge this as a potential issue.

Surveillance

Speech-to-Text technologies may be misused to invade the privacy of others by recording and mining information from private conversations. This kind of individual privacy is protected by law in many countries. You should not assume consent to record and analyze private speech.

ukrainian_mfa v3.0.0

Ukrainian MFA dictionary v3.0.0

Link to documentation on mfa-models

Jump to section:

• Dictionary details
• Intended use
• Performance Factors
• Ethical considerations

Dictionary details

• Maintainer: Montreal Forced Aligner
• Language: Ukrainian
• Dialect: N/A
• Phone set: MFA
• Number of words: 55,548
• Phones: b bʲ bʲː bː c cː dzʲ dʒ dʲ dʲː d̪ d̪z̪ d̪z̪ː d̪ː e f fʲ fː i iː j k kː l lː m mʲ mʲː n̪ n̪ː o p pʲ pʲː sʲ sʲː s̪ s̪ː tsʲ tsʲː tʃ tʃʲ tʃʲː tʃː tʲ tʲː t̪ t̪s̪ t̪s̪ː t̪ː u x zʲ zʲː z̪ z̪ː ç ɐ ɑ ɔ ɛ ɟ ɡ ɦ ɪ ɲ ɲː ɾ ɾʲ ɾʲː ɾː ʃ ʃʲ ʊ ʋ ʋʲ ʋʲː ʋː ʎ ʎː ʒ ʒʲ ʒʲː ʝ
• License: CC BY 4.0
• Compatible MFA version: v3.0.0
• Citation:

@techreport{mfa_ukrainian_mfa_dictionary_2024,
	author={McAuliffe, Michael and Sonderegger, Morgan},
	title={Ukrainian MFA dictionary v3.0.0},
	address={\url{https://mfa-models.readthedocs.io/pronunciation dictionary/Ukrainian/Ukrainian MFA dictionary v3_0_0.html}},
	year={2024},
	month={Mar},
}

• If you have comments or questions about this dictionary or its phone set, you can check previous MFA model discussion posts or create a new one.
• The dictionary downloadable from this release has trained pronunciation and silence probabilities. The base dictionary is available here

##Installation

Install from the MFA command line:

mfa model download dictionary ukrainian_mfa

Or download from the release page.

The dictionary available from the release page and command line installation has pronunciation and silence probabilities estimated as part acoustic model training (see Silence probability format and training pronunciation probabilities for more information. If you would like to use the version of this dictionary without probabilities, please see the [plain dictionary](https://raw.githubusercontent.com/MontrealCorpusTools/mfa-models/main/dictionary/ukrainian/mfa/Ukrainian MFA dictionary v3_0_0.dict).

Intended use

This dictionary is intended for forced alignment of Ukrainian transcripts.

This dictionary uses the MFA phone set for Ukrainian, and was used in training the Ukrainian MFA acoustic model. Pronunciations can be added on top of the dictionary, as long as no additional phones are introduced.

Performance Factors

When trying to get better alignment accuracy, adding pronunciations is generally helpful, especially for different styles and dialects. The most impactful improvements will generally be seen when adding reduced variants that involve deleting segments/syllables common in spontaneous speech. Alignment must include all phones specified in the pronunciation of a word, and each phone has a minimum duration (by default 10ms). If a speaker pronounces a multisyllabic word with just a single syllable, it can be hard for MFA to fit all the segments in, so it will lead to alignment errors on adjacent words as well.

Ethical considerations

Deploying any Speech-to-Text model into any production setting has ethical implications. You should consider these implications before use.

Demographic Bias

You should assume every machine learning model has demographic bias unless proven otherwise. For pronunciation dictionaries, it is often the case that transcription accuracy and lexicon coverage for the prestige variety modeled in this dictionary compared to other variants. If you are using this dictionary in production, you should acknowledge this as a potential issue.

ukrainian_mfa v3.0.0

Ukrainian MFA acoustic model v3.0.0

Link to documentation on mfa-models

Jump to section:

• Model details
• Installation
• Intended use
• Performance Factors
• Metrics
• Ethical considerations
• Troubleshooting issues
• Training data
• Evaluation data

Model details

• Maintainer: Montreal Forced Aligner
• Language: Ukrainian
• Dialect: N/A
• Phone set: MFA
• Model type: Acoustic
• Features: MFCC
• Architecture: gmm-hmm
• Model version: v3.0.0
• Trained date: 2024-03-21
• Compatible MFA version: v3.0.0
• License: CC BY 4.0
• Citation:

@techreport{mfa_ukrainian_mfa_acoustic_2024,
	author={McAuliffe, Michael and Sonderegger, Morgan},
	title={Ukrainian MFA acoustic model v3.0.0},
	address={\url{https://mfa-models.readthedocs.io/acoustic/Ukrainian/Ukrainian MFA acoustic model v3_0_0.html}},
	year={2024},
	month={Mar},
}

• If you have comments or questions about this model, you can check previous MFA model discussion posts or create a new one.

Installation

Install from the MFA command line:

mfa model download acoustic ukrainian_mfa

Or download from the release page.

Intended use

This model is intended for forced alignment of Ukrainian transcripts.

This model uses the MFA phone set for Ukrainian, and was trained with the pronunciation dictionaries above. Pronunciations can be added on top of the dictionary, as long as no additional phones are introduced.

Performance Factors

As forced alignment is a relatively well-constrained problem (given accurate transcripts), this model should be applicable to a range of recording conditions and speakers. However, please note that it was trained on read speech in low-noise environments, so as your data diverges from that, you may run into alignment issues or need to increase the beam size of MFA or see other recommendations in the troubleshooting section below.

Please note as well that MFA does not use state-of-the-art ASR models for forced alignment. You may get better performance (especially on speech-to-text tasks) using other frameworks like Coqui.

Metrics

Acoustic models are typically generated as one component of a larger ASR system where the metric is word error rate (WER). For forced alignment, there is typically not the same sort of gold standard measure for most languages.

As a rough approximation of the acoustic model quality, we evaluated it against the corpus it was trained on alongside a language model trained from the same data. Key caveat here is that this is not a typical WER measure on held out data, so it should not be taken as a hard measure of how well an acoustic model will generalize to your data, but rather is more of a sanity check that the training data quality was sufficiently high.

Using the pronunciation dictionaries and language models above:

• WER: 0%
• CER: 0%

Ethical considerations

Deploying any Speech-to-Text model into any production setting has ethical implications. You should consider these implications before use.

Demographic Bias

You should assume every machine learning model has demographic bias unless proven otherwise. For STT models, it is often the case that transcription accuracy is better for men than it is for women. If you are using this model in production, you should acknowledge this as a potential issue.

Surveillance

Speech-to-Text technologies may be misused to invade the privacy of others by recording and mining information from private conversations. This kind of individual privacy is protected by law in many countries. You should not assume consent to record and analyze private speech.

Troubleshooting issues

Machine learning models (like this acoustic model) perform best on data that is similar to the data on which they were trained.

The primary sources of variability in forced alignment will be the applicability of the pronunciation dictionary and how similar the speech, demographics, and recording conditions are. If you encounter issues in alignment, there are couple of avenues to improve performance:

1. Increase the beam size of MFA

   • MFA defaults to a narrow beam to ensure quick alignment and also as a way to detect potential issues in your dataset, but depending on your data, you might benefit from boosting the beam to 100 or higher.

2. Add pronunciations to the pronunciation dictionary

   • This model was trained a particular dialect/style, and so adding pronunciations more representative of the variety spoken in your dataset will help alignment.

3. Check the quality of your data

   • MFA includes a validator utility, which aims to detect issues in the dataset.
   • Use MFA's anchor utility to visually inspect your data as MFA sees it and correct issues in transcription or OOV items.

4. Adapt the model to your data

   • MFA has an adaptation command to adapt some of the model to your data based on an initial alignment, and then run another alignment with the adapted model.

Training data

This model was trained on the following corpora:

• Common Voice Ukrainian:

  • Hours: 94.80
  • Speakers: 1,026
  • Utterances: 73,099

• M-AILABS Ukrainian:

  • Hours: 83.22
  • Speakers: 6
  • Utterances: 34,189

• GlobalPhone Ukrainian:

  • Hours: 14.11
  • Speakers: 119
  • Utterances: 12,814