Skip to content
A virtual cockpit for the AR Drone using Oculus head tracking and Leap Motion
C# C JavaScript ASP
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
2015-01-25_013156
2015-01-25_013322
Assets
Library
ProjectSettings
hackgeny_Data
.gitattributes
Assembly-CSharp-Editor-vs.csproj
Assembly-CSharp-Editor.csproj
Assembly-CSharp-firstpass-vs.csproj
Assembly-CSharp-firstpass.csproj
Assembly-CSharp-vs.csproj
Assembly-CSharp.csproj
Assembly-UnityScript-Editor-vs.unityproj
Assembly-UnityScript-Editor.unityproj
Assembly-UnityScript-firstpass-vs.unityproj
Assembly-UnityScript-firstpass.unityproj
HackGenY-csharp.sln
HackGenY.sln
HackGenY.userprefs
README.md
drone.js
flybycockpit.png
flybylogo.png
png.js
stop.js
test.js

README.md

Click for video:

A virtual cockpit for the AR Drone using Oculus head tracking and Leap Motion

Built at Hacking Generation Y with Logan Taylor, Matthew Linker, and Andrew Liu http://challengepost.com/software/flyby-vr-drone

FlyBy is a virtual reality application that integrates Oculus Rift and Leap Motion with an AR.Drone to create a virtual cockpit for a user to operate the drone. Gone is the need for remote controllers and unintuitive buttons, as FlyBy allows the user to control the AR.Drone with natural movements of the head and hands. FlyBy makes operating AR.Drones easier and more fun for everyone, as it provides a completely intuitive control method—the learning curve is virtually nonexistent. When using FlyBy, the user truly feels like he or she is in the cockpit of our built-from-scratch virtual Apache helicopter. Using Oculus’s VR capabilities, they see an extraordinarily detailed cockpit as well as a live video feed streamed from the onboard camera. In addition, to further enhance the user’s piloting experience, FlyBy incorporates Leap Motion and an Android app to track simple hand gestures to control the drone's altitude. Overall, Flyby is an elegant and intuitive control system for AR.Drones which will greatly enhance their ease of use and enjoyment.

#How does it work? Uses a Node.js server with node-ar-drone to control the drone. This server then communicates with Unity3d game engine over sockets. Within the Unity3d game engine we use LeapMotionVR assets and a built-from-scratch 3d cockpit to create a immersive 3d experience. Using Oculus head tracking and accelerometer data from FlyBy-VR-Drone-Android, commands are relayed to the Node.js server.

You can’t perform that action at this time.