Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(2) Test the existing baseline ASR model [2] #9

Closed
2 tasks done
PanosAntoniadis opened this issue May 9, 2019 · 2 comments
Closed
2 tasks done

(2) Test the existing baseline ASR model [2] #9

PanosAntoniadis opened this issue May 9, 2019 · 2 comments

Comments

@PanosAntoniadis
Copy link
Collaborator

PanosAntoniadis commented May 9, 2019

  • Evaluate the model using Kaggle dataset.
  • Evaluate the model using Journalism dataset.
@PanosAntoniadis PanosAntoniadis created this issue from a note in gsoc2019-sphinx-management (Backlog) May 9, 2019
@PanosAntoniadis PanosAntoniadis changed the title (1) Test the existing baseline ASR model [0] (2) Test the existing baseline ASR model [0] May 9, 2019
@PanosAntoniadis PanosAntoniadis added the enhancement New feature or request label May 9, 2019
@etsardou etsardou moved this from Backlog to Sprint Planning in gsoc2019-sphinx-management May 10, 2019
@PanosAntoniadis PanosAntoniadis moved this from Sprint Planning to In progress in gsoc2019-sphinx-management May 12, 2019
@PanosAntoniadis PanosAntoniadis moved this from In progress to Sprint Planning in gsoc2019-sphinx-management May 12, 2019
@PanosAntoniadis PanosAntoniadis moved this from Sprint Planning to In progress in gsoc2019-sphinx-management May 13, 2019
@PanosAntoniadis PanosAntoniadis changed the title (2) Test the existing baseline ASR model [0] (2) Test the existing baseline ASR model [1] May 16, 2019
@PanosAntoniadis
Copy link
Collaborator Author

PanosAntoniadis commented May 16, 2019

The kaggle dataset in the required form for evaluation by Sphinx can be found here: https://drive.google.com/open?id=18hErfhgmXmhJ0VraVX4zb4SJ2UOOZl8l.

Results using Sphinx aligner https://cmusphinx.github.io/wiki/tutorialtuning/ :
TOTAL Words: 37138 Correct: 17879 Errors: 21304
TOTAL Percent correct = 48.14% Error = 57.36% Accuracy = 42.64%
TOTAL Insertions: 2045 Deletions: 2362 Substitutions: 16897

@PanosAntoniadis
Copy link
Collaborator Author

PanosAntoniadis commented May 20, 2019

The Journalism dataset in the required form for evaluation by Sphinx can be found here:
https://www.dropbox.com/sh/a8dkcgchb3cxgnc/AAA-7uxX8embvJWPOW-yQFTGa?dl=0

Results using Sphinx aligner https://cmusphinx.github.io/wiki/tutorialtuning/ :
TOTAL Words: 11532 Correct: 5038 Errors: 6811
TOTAL Percent correct = 43.69% Error = 59.06% Accuracy = 40.94%
TOTAL Insertions: 317 Deletions: 936 Substitutions: 5558

@asymeon

@PanosAntoniadis PanosAntoniadis changed the title (2) Test the existing baseline ASR model [1] (2) Test the existing baseline ASR model [2] May 20, 2019
@PanosAntoniadis PanosAntoniadis moved this from In progress to Delivered in gsoc2019-sphinx-management May 20, 2019
@etsardou etsardou moved this from Delivered to Accepted in gsoc2019-sphinx-management May 24, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Development

No branches or pull requests

2 participants