TurkServer is a package for building interactive web-based user experiments on the Meteor web app framework. It uses Meteor's powerful publish/subscribe data model and reactivity to make building real-time user interfaces less error-prone, and provides facilities for deploying your app and collecting data.
- Design interfaces using the power and flexibility of Meteor.
- Multi-user, interactive experiments are as easy to build as single-user experiments.
- Highly configurable randomization of treatments.
- Deploying experiments from a live web interface and watch the progress of experiments in real time.
See the guide, which has information about getting started, system architecture, experiment design, and examples.
To add this to a Meteor app, follow these instructions:
- Install Meteor and create a Meteor app.
In the app directory, install TurkServer locally (once we publish TurkServer to the Meteor packaging server, you will be able to omit this step):
git clone https://github.com/TurkServer/turkserver-meteor.git packages/turkserver
meteor add mizzao:turkserverto install the package and its dependencies.
- Start your app with the
- Navigate to
/turkserverto log into the administration interface, and develop your experiment!
See the API documentation to get an idea of what you can use in your app.
npm install -g meteor-jsdoc
Then build and view the docs with the following commands:
meteor-jsdoc build meteor-jsdoc start
The documentation will be visible as a Meteor app on the specified port (default 3333).
If you use TurkServer in your work and publish a paper, please cite
Andrew Mao, Yiling Chen, Krzysztof Z. Gajos, David Parkes, Ariel D. Procaccia, and Haoqi Zhang. TurkServer: Enabling Synchronous and Longitudinal Online Experiments. In the Fourth Workshop on Human Computation (HCOMP 2012).
Note that this paper doesn't refer to the latest version of the system, but it is the same core idea. We plan to publish an improved paper detailing the methods behind TurkServer in the near future.
Clone this entire repository:
git clone https://github.com/TurkServer/turkserver-meteor.git turkserver
Then run the tests:
cd turkserver meteor test-packages ./
If you checked out the repository into an existing Meteor app, you can run
meteor test-packages turkserver from your app instead.
http://localhost:3000 to run the tests.
You don't have to run the tests yourself; this project is set up for continuous integration on Travis CI, which runs these tests on each commit.