MOS

Introduction

This is a mean opinion score (MOS) evaluation web-based application based on web2py.

Features list:

1. Support multiple test sets.
2. Support multiple subjects to evaluate at the same time.
3. The audios will be played sequencially, so it should be randomized before input to the applicatin.
4. Download the result in various formats such as CSV, JSON.

How to install

1. Download and install web2py
2. Open web2py admin page and fill in the information as below image:
   • Name: MOS
   • Get from URL: https://github.com/truongdq54/MOS.git
3. Click Install

How to use

The application works as follows:

1. Input database

   • Open data mangage by click to data in the top menu You can input the data one by one by click Add Record or add all the data in batch mode by click Batch add.

   • Batch add: In Batch add mode, the data format is as follow:

   utterance_name|test_set|text|audio_path|system
   

   utterance_name: is an unique name for every utterance
   test_set: This is useful when you want to divide your test data
   into small test sets. The subject can select the test set that they want to evaluate.
   audio_path: This is the relative path of the audio. For all utterance, you have to upload
   the audio to static/wav/ folder. For examples, if you have the audio in static/wav/baseline/audio1.wav, then the correct audio_path is baseline/audio1.wav.

   Examples:

2. The evaluator fill in their name and age. In addition a list of registered user is also displayed in the Index page

3. Select test set to be evaluated

4. The evaluation page looks like below: User select the score for each utterance and click submit.

5. The result will be showed in result page in the top menu: You can download the reuslt in many difference format such as CSV, HTML, JSON.