Snippet
Snippets will be displayed in the rating editor page in which administrators can monitor the ratings and import/export snippets while raters can give ratings for a list of snippets. Both raters and administrators can change from vertical to horizontal layout back and forth with a toggle button above the language selector.
 |
|---|
| Vertical layout |
 |
|---|
| Horizontal layout |
However, some of the functionalities will only be displayed to administrators but not to raters. On the other hand, administrators can neither give a rating nor change the ratings and answers of raters.
The interface for raters is quite simple that raters can only choose highlighter (how snippet will be display), give ratings, answer snippet questions, and complete the survey.
If the local raters management is used, raters will be redirected to a goodbye page. Otherwise, they will be redirected to Prolific to complete their survey.
The interface for administrators is more complicated than for raters. There are a couple of buttons next to the Snippets text that allows administrators to add a snippet from github, add an attention check snippet, delete snippet, and import/export snippets of this dataset.
A dialog will be displayed to specify which part of a file in Github you would like to add as a snippet to this dataset.
This feature will clone the current snippet and mark it for attention check. The tool also assign the attention check snippet a random value as the correct rating. A piece of text would be displayed to raters to guide them to select the correct rating. If a rater selects an incorrect rating for a given attention check snippet, that means they did not pay attention when taking the survey and administrators should investigate and consider their submission.
The feature allows administrators to delete the current snippet. All snippet questions and their solutions and the snippet rating will be deleted as well.
The tool supports administrators to upload a couple of snippet files or a zip file of all snippets to a dataset. Old snippets will be deleted as well as their ratings, questions, and solutions of raters.
Administrators can also export all snippets to local disk.
