Blender hands free using LeapMotion and voice command
Switch branches/tags
Nothing to show
Clone or download
Latest commit d723c77 Jun 17, 2015
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
article Update Article.md Apr 17, 2014
controllers Remove stuff Apr 3, 2014
libs/leap Add leap library Mar 31, 2014
resources Deplacement relatif Apr 2, 2014
voice Make recognition cleaner Mar 31, 2014
.gitignore wtf Apr 2, 2014
LICENSE Create LICENSE Jun 17, 2015
README.md Fixed demo video URL (yay) Apr 5, 2014
blender.py calc de la rotation (marche pas vraiment => desactivation sur le client) Apr 2, 2014
commands.py Even prettier commands Mar 31, 2014
communication.py Scale done Apr 3, 2014
filters.py Scale done Apr 3, 2014
run.sh Merge Apr 5, 2014
server.py Move to sole listeners Apr 3, 2014

README.md

BlenderBQ

A Leap Motion and voice-control interface for Blender.

Check out our demo video!

Features

Object mode

Enter object mode by saying "object". In this mode, you can use two gestures:

  • grab to move the object around the scene
  • pinch inwards or outwards to scale the object

The "center" voice command will place the object back at the origin. The "reset" voice command acts as "center" but also cancels any applied rotation.

Camera control

Several voice commands are available to control the view:

  • "over" (or "above"), "under" (or "below")
  • "left", "right"
  • "front", "back"
  • "camera"

Pottery mode

Enter pottery mode by saying "pottery". In this mode, you can use two gestures:

  • swipe left or right to start rotating the object in this direction. Repeating the movement speeds up rotation.
  • point with your finger to start

Several modifiers are avaiable:

  • The "add" voice command will switch the brush to adding matter to the object
  • The "substract" voice command will switch the brush to removing matter from the object
  • The "noob" voice command will toggle between symetric sculpting and local scuplting

Paint mode

Enter paint mode by saying "paint".

In this mode, there's only one gesture : keep your hand flat with your five fingers spread out. Move your hand to select the desired color in the RGB space.

Misc

At any time, use the "sleep" and "wake" voice commands to disable or enable voice recognition.

Required

  • python 2.7 (the Leap Motion API only supports Python 2.x for now)
  • A working Blender install (tested with Blender 2.70)
  • A working Leap Motion install
  • Voice recognition packages (optionnal):

How to run

Run these commands in a UNIX terminal.

  1. Plug in your Leap Motion and make sure it is detected correctly by your system.
  2. cd to the BlenderBQ directory
  3. python server.py
  4. blender -P blender.py [filename] (use the filename parameter if you want to open a file directly)
  5. In Blender, using the command palette (shortcut: spacebar), launch the "BBQ operator"

If everything is working correctly, you should lose mouse control over the scene while the BBQ operator is running. Blender should now respond to gesture and voice commands.