No description, website, or topics provided.
C# C
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Failed to load latest commit information.

Controlling Unity Using Leap Motion




I'm still waiting for the Oculus DK2 so I'm doing this project to find a more intuitive way to translate, scale, and rotate objects in the Unity. If you've seen the Iron Man movies or Elon Musk designing rockets with his hands, you'll understand what I'm going for. Manipulating 3D objects using keyboard and mouse is quite limiting. If we can improve on this, it would allow us to create content for VR faster.


We'll be using the Leap Motion, which ships in 2 days from Amazon :-). The plan is to create a custom Unity editor window that will communicate with the Leap Motion sensor. We'll then connect the hand movements directly to the translation, scale, and rotation controls for the currently selected GameObject. Feedback is always welcome. If it's good, I may put it up on the Asset Store to share more broadly.


  • Clone this repo
  • Open it in Unity
  • Plug in your Leap Motion and use the visualizer to make sure it's sending data
  • Open the custom editor window from Unity (Window Menu > Leap Motion)
  • Click on a GameObject in your scene
  • Place your hand(s) above the Leap Motion
  • Try it out by holding down the Command/Control key and moving your hand (only translation and scaling are available right now)
  • (optional) import a scene like the "Robot Lab" tutorial to play around with different objects



Copyright (c) 2014 Jimmy Zhang See the LICENSE file for license rights and limitations (MIT).