ComedyParser is a system that allows humanoid robots to act as stand-up comedians in live comedy shows. The system uses SHORE computer vision framework to analyse the audience in real-time, identify the existing people and make the robot look at or point to them. It also uses both SHORE and audio signal levels to recognise responses of the audience such as Laughing or Applauding.
For more information about the project, please visit https://minoskt.github.io/projects/robothespian or read the publications bellow. Watch a Video of ComedyParser in action using a RoboThespian robot.
- Python 2.7
- Natural Language Toolkit (NLTK) from http://www.nltk.org
- English punkt tokenizer using nltk.download() in a python shell
- PyAudio from http://people.csail.mit.edu/hubert/pyaudio/
python playComedy.py input.json
Always use a JSON validator on your input script (e.g. http://jsonlint.com)
Using the following command, you can check for invalid Unicode characters and unsupported commands ("WARNING" messages).
python Comedy.py input.json
Kleomenis Katevas, Patrick G.T. Healey, Matthew Tobias Harris, “Robot Stand-up: Engineering a Comic Performance”, Short paper, Humanoid Robots and Creativity workshop @ IEEE Humanoids 2014, Madrid, November 2014. [pdf]
Kleomenis Katevas, Patrick G.T. Healey and Matthew Tobias Harris, “Robot Comedy Lab: Experimenting with the Social Dynamics of Live Performance”, Frontiers in Psychology 6:1253. doi: 10.3389/fpsyg.2015.01253. [pdf]
This project was featured on the following on-line magazines and websites:
-
New Scientist: Robot comedian stands up well against human rivals
-
Queen Mary University of London: Comedy robot metal tested at the Barbican
-
Chortle: Rise of the Robocomics - The machines performing stand-up
-
London Evening Standard: Scientists create robot to take on comedians in stand-up challenge
Ph.D. student Toby Harris won the 1st prize in a national photo competition with a picture of RoboThespian performing stand-up comedy live on-stage:
-
Queen Mary University of London: Student’s stand-up robot photo wins national competition
-
Times Higher Education: From robots to charades - 15 remarkable science photographs
The MIT License (MIT)
Copyright (c) 2014. Queen Mary University of London
Kleomenis Katevas, k.katevas@qmul.ac.uk
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.