No Audiofiles

[LuciusDaClassic]

Hello,
I'm trying to use this tool at the moment, but I have the problem that in the final P.808_acr.html audioclips aren't available when I run it in a Webbrowser. It starts in the Setup section with question number 2-6. The Training sections works, but in the Rating section they are also not available. In the rating_clips.csv, trapping_clips.csv, golden_clips.csv and the general.csv files I updated all links to my AmazonAWS directory. The developers console in the browser says that it searches for the files in my local project.
I checked everthing twice what what written in your Preperation of ACR test, but didn't saw the problem.
In the master.cfg I saw coincidentally the section about the definition of the URLs and Paths of the clips. There you write that I should use the azure storage and give the information for that.
Is this the problem? And if yes, what do I have to do / have to change, when I'm using AmazonAWS for all the files?
Thank you!

[babaknaderi]

when you run the master script, you get 3 files. The HTML file is a template with variables for all the URLs you see missing. You need to follow the steps here: https://github.com/microsoft/P.808/blob/master/docs/running_test_mturk.md
upload the HTML file when creating new project in Mturk.com. After that click on the Publish Batch in the mturk and upload the csv file. The csv file contains all the links you see is missing in your local computer.
For testing rather you can use mturk developer sandbox or the HitApp server from https://github.com/microsoft/P.910

[LuciusDaClassic]

Thank you very much, that worked! So the lower part in the master.cfg where you write the information about the azure account is irrelevant and doesn't has to be filled?
At the moment I have the problem, that I don't really understand how the pattern for the randomization works.
I will have 24 conditions that have to be included in the experiment. The sequence can be random, but all conditions have to be in it. Now the point is, that every Condition exists in variants like Male voice 1 and 2 and Female voice 1 and 2. Those Variants also have the next variation, the they can be clean or have a kind of loss.
My file-name-structur is:
P501_C01_F1_S01
C is for the conditions 01-24, then the options M1,M2,F1,F2 and at least S01 for noloss and S02 for a kind of loss.
What has to be the pattern and configuration (conditions_keys, clip_packing_strategy and block_keys) that you get all 24 conditions but randomly selected out of the options M1,M2,F1,F2 and S01,S02?

[babaknaderi]

Azure storage is optional and you can use them instead of the CSV files. Within the code, first it is evaluated if CSV files are present, if not Azure storage is used.

do you want to use a block design? In your case, it means to set 24 clips (+ trapping and gold) in one session. That make the session too long and not recommended.
Said that, in case you want to give it a try, following setting should work:

number_of_clips_per_session: 24
condition_pattern:.*_C(?P<condition_num>\d{1,2})_.*.wav
condition_keys: condition_num
clip_packing_strategy : balanced_block
block_keys: condition_num

[LuciusDaClassic]

Oh thank you! Now everything runs. I'm not sure at the moment how many conditions I will finally have at the end. What would you say is your recommended amount? The concept of the block design was for me unfortunately not clear enough. I just understood roughly the condition pattern.

For the finalisation I need to know another important thing. In the "P.808_acr.html" the trapping question gets checked in "tp_check". So if it's zero the question was answered right and -1 if not. Is that just a variable that I get in the results to check or is it reused in an other file of yours that already checks that and validate it?
I ask because I got the requirement that everyone gets checked at the end and gets a code (defined by us) if the trapping question was answered right or nothing if not, but I would not know how or where I do that. To implement that I need to understand the connection / variables. If it's just a variable in the result sheet, would you say it makes more sense to just check the number instead of a extra given code?
Sorry for all the questions, but this whole project is a lot harder for me than I thought.
Thank you and have a nice weekend!