Skip to content
This tool is meant to be used in order to collect crodwsourced multimodal data from participants using their web browser through their webcam/microphone.
JavaScript Python Other
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
js
static
templates
.gitignore
LICENSE
Procfile
README.md
_config.yml
main.py
requirements.txt

README.md

Multimodal Crowdsourcing tool

This tool is meant to be used in order to collect crodwsourced multimodal data from participants using their web browser through their webcam/microphone. It can be used with the most common crowdsourcing platforms (mturk, crowdflower, prolific acadmic) and probably more.

Setting up and running the server

In order to build the javascript please go to the folder js and then

  1. npm install
  2. webpack --w --config webpack.config.js

Now webpack will be listening for changes in your js folder and update the bundle.js

In order to run the server use the command python main.py

Modules

The code uses react modules in the js/components folder and the app.jsx controls how the user steps trhough these components.

Caveats

If you are not running on localhost you must use a https connection or the browser will block the access to the camera and microphone

Citation

If you use any of this work, then please cite the following paper:

Jonell, P., Oertel, C., Kontogiorgos, D., J., Beskow, J., Gustafson, J.: Crowd-Powered Design of Virtual Attentive Listeners. In: Intelligent Virtual Agents: 17th International Conference, IVA 2017, Stockholm, Sweden, August 27-30, 2017, Proceedings. Vol. 10498. Springer, 2017 (2017)

@inproceedings{jonell2017crowd,
  title={Crowd-Powered Design of Virtual Attentive Listeners},
  author={Jonell, Patrik and Oertel, Catharine and Kontogiorgos, Dimosthenis and Beskow, Jonas and Gustafson, Joakim},
  booktitle={Intelligent Virtual Agents: 17th International Conference, IVA 2017, Stockholm, Sweden, August 27-30, 2017, Proceedings},
  volume={10498},
  pages={188},
  year={2017},
  organization={Springer}
}
You can’t perform that action at this time.