Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to improve voice recognition using odas? #54

Open
JaySpeech opened this issue May 11, 2018 · 3 comments
Open

How to improve voice recognition using odas? #54

JaySpeech opened this issue May 11, 2018 · 3 comments

Comments

@JaySpeech
Copy link

When two people speak at the same time,there are four channels in the postfilter output.
Which channel shoud I send to voice recognition engine.

@FrancoisGrondin
Copy link
Member

The channel with speech will match the position in the tracking results, e.g. if I have a tracked source in position 2, then the 2nd channel will contain the corresponding separated stream.

However, be careful: feeding the postfiltered output directly to a ASR system which was not trained on a dataset filtered in the same way will not produce any good result at all. There will be a domain mismatch. Postfiltering makes it easier for the human ear, but also introduces artifacts picked by the ASR. I suggest you use instead the separated stream, which does not include those artifacts.

Cheers!

@JaySpeech
Copy link
Author

Thank you for your reply.
If two people speak at the same time at different position,two sources will be tracked,which source is the best choice?

@FrancoisGrondin
Copy link
Member

It really depends which source you want to use for voice recognition. However, let me warn you: you'll probably get quite bad ASR results if two people are speaking at the same time: each source will still corrupt the other one (even after separation... interference is reduced but not removed). Unless you use a language model with a very limited dictionary, and trained in such similar conditions, the WER will be quite high. Cocktail party is still a very hot research topic right now... deep learning makes things better, but we still have to work hard to get human like recognition performances.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants