TurkServer is a package for building interactive web-based user experiments on the Meteor web app framework. It uses Meteor's powerful publish/subscribe data model and reactivity to make building real-time user interfaces less error-prone, and provides facilities for deploying your app and collecting data.
- Design interfaces using the power and flexibility of Meteor.
- Multi-user, interactive experiments are as easy to build as single-user experiments.
- Highly configurable randomization of treatments.
- Deploying experiments from a live web interface and watch the progress of experiments in real time.
Here's an example of how TurkServer was used to run a month-long prisoner's dilemma experiment:
See the guide, which has information about getting started, system architecture, experiment design, and examples.
To add this to a Meteor app, follow these instructions:
- Install Meteor and create a Meteor app.
meteor add mizzao:turkserverto install the package and its dependencies.
- Start your app with the
- Navigate to
/turkserverto log into the administration interface, and develop your experiment!
See the API documentation to get an idea of what you can use in your app.
npm install -g meteor-jsdoc
Then build and view the docs with the following commands:
meteor-jsdoc build meteor-jsdoc start
The documentation will be visible as a Meteor app on the specified port (default 3333).
If you use TurkServer in your work and publish a paper, please cite
Andrew Mao, Yiling Chen, Krzysztof Z. Gajos, David Parkes, Ariel D. Procaccia, and Haoqi Zhang. TurkServer: Enabling Synchronous and Longitudinal Online Experiments. In the Fourth Workshop on Human Computation (HCOMP 2012).
Note that this paper doesn't refer to the latest version of the system, but it is the same core idea. We plan to publish an improved paper detailing the methods behind TurkServer in the near future.