Workshop: Package VR without VR

[EloiStree]

Do you need virtual reality headset to create virtual reality content ?
In deed... Not really.

And most of the time, I spend 90% of my work creating my asset in Unity and 10% of the time testing them with in the target headset of the client.

As we don't have the headsets with the coronas quarantine.
Let's demonstrate and practice that.

Objectif

With the package manager learn in the previous workshop.
Create an VR designed tool for virtual reality without the headset.

You can find in this post a list of cool code to experiment as exercice that can be mainly don't with the headset. Some exists, some are downloadable, some existe as private assets.

Pick one and try to implement a tool box of it.

The following label

---

Linked:

#57 Artist assets for VR
#58 Quest VS PC
#59 Hands, lot's of hand
#60 Helmet
#39 old games
#35 future of VR input

[EloiStree]

Junior Challenge

• Hide the view of the player when hitting the wall layer
  • Hide when hitting object
• Look at your hand detector
  • Detect and display info when looking at wrist / up of controller
    • Example: Watch menu
  • Detect and display info when looking at hand / down of controller
    • Example: Palm menu
• Teleport without transition & Rotate without transition
• Allow the user say "hi" to monster with your hand (See Sébastien)
• Detect if the user is sitting or crowling (see Lory scene)
• Move the chain in the donjon with player hands.
  • Make the chain be attracted by the player hands
• Play sound when the player look at some object (See pig in disco room and else)

Weird but maybe

• Make a belt menu that follow the the head position but stay at the belt height to be used as menu inventory ?

[EloiStree]

Expert Challenge

"Some of the challenge are easy here, but expert because you have only one day".

• Put planes to fade in out from cameras in the VR
• Highlight objects in the vision of the player that are interactable/grabable with the shade of Maude
• Be able to grab objects in the scene with the Ambroise kind of script you used.
• "Finger tip intent" Do part of finger that can't pass through object
  • Do that the finger tip become more and more horizontal to give the feeling of pressing the object
• Detect the player salutation like in Japon culture
• Detect metal hand sign and generate particule between finger
• Make focus sounds. (The sound volume change base on if you focus his with your look or not)
• Make the colliders and the mesh of the hand

[EloiStree]

Magic Doors project

Find here cool tools that could be code for the commun project Magic Doors.

[EloiStree]

My History

Find here implementation I coded for VR in the passe but did not put in package online (because package manager did not existed at this time).
DRAFT

JRIFT

• Make a 2D game with virtual reality by moving sprite global plane.

Multi Cursor

• Use cursors that work in generic ways to point objects: hands, foot, eyes, head...

Wolfenstein and Fishing R&D

• Use the rotation of the head compare to shoulders to rotate user with the kinect
  • Basically use the pain in the neck rotation to translate a rotation
• Use hands movement to interact with observed object (like open a door, or push a wall)
• Use position of the player at start of the level to make it move around in the environment based on his position compare to it.
  • It also rotate the player based on where he look in the same way I deal with the neck pain concept

AppleCloud & Krakens R&D

• Use position of the hands compare to the head of the user position to fly around in scene

Kinect Walk

• Use the head vertical position of the player head
  • To detect when he jump
  • To detect when he walk and run

Cho'Gath

• Jeu en Java de réalité virtuelle en utilisant les parallaxes de plans 2D avec l'Oculus DK1 basé sur la rotation de la tête fonctionne nickel.

Querty War & Solar God

• Jeux de dactylographie pour la réalité virtuelle

Unkown Radio Re-edition

• Suite à un jeu dans la vrai vie ou on a utilisé un theramine qui n'est plus utilisable. J'ai créé un jeu en VR avec un theramine en VR pour continuer à jouer au jeu.

Krakens Intern Ship

• Fuse Kinect Positional tracking with Oculus system
• Be able to grab object with your hand and store them else where
• Track hands in space with Hydra & Oculus
• See your sefl in a wall of vertex moving with the kinect cloud points
• Do some research and development on Kinect (see Archived: Found those images in my Kinect search of 2015. Can be useful. #66)
• Zoom, grab, turn around in 3D with hands

Wheelchairs projects

• Accessibility Green light
  • Simulate a wheelchair using the Accelerometer of two phones glue on the wheels
• Demolition wheelchair
  • Simulate a wheelchair using magnet in a device to put against the wheel of the wheelchair
  • Make a version where clip a controller on the wheelchair to controller the game. To be compatible with all wheelchair
• Sim Wheels
  • Simulate a wheelchair by moving your hands in space with VR controllers :)

Jedi Trainer

• Simulate the position of the user head based on the a skull simulation that allow to give 6 degree of freedom with only a 3 degree device.
• Use your phone to simulate a pointer controller with the accelerator and/or the gyro through lan udp message

Fly in the city

• Simulate the fly of a bird using kinect movements and Oculus DK1

Juggle master

• Detect the balls of a juggler with the kinect points cloud to be able to play in 2D or in VR

Limonade

• LEARN OPTIMIZATION xD
• Make puck people with rail path idea
• Make a fly with your head code that is cool
  • but make you sick like hell if you are new to the game
• Use a fake phone to display info to the player
• Use fake noise to reduce sickness (no really effective)
• Look at object triggers action to them
• Make fake avatar for multiplayer version that follow the player head movement but don't break the immersion if the tracker bug, if the player move to far or if he do a not human movement with his head

Virtual drone war

• Scan the user body with Kinect compute the information on PC and send the info required to the user by compressed info on the WiFi
• Compute main part logic of the game on the computer and send the compressed information computed on the graphic card to the Gear VR to be used with compute shader scripts.
• Use a goliath cockpit that move around with the player position and the hand actions send from the computer
  • Block = hand cross, Fire = punch with your fist, Missiles, Punch with both fists ...

Surfing drones

• Use inverse kinematics to simulate the surfer body of player on Gear VR / Kinect for the food and hands of him.

Hako Bio

• Move around the room with Gear VR controller
• Fake light under objects in baked room
• Make a fake multiplayer connection
  • Just send the same loading information for a room and send only the player head position to through the devices.

Blind little girl

• Make a game only based on the 3D sound and the rotation of the player head
  • Use ray cast to feel the wall
• Push info on WiFi to the observer in 2D where is the player in the 3D game from your computer

Blind mind

• Use a connected phone in a stick to command your game

Coin VR

• Use coin in real life with Raspberry Pi to launch the game and trigger action in the Gear VR

oGame Hacking

• Sniff data from your account on oGame with Selenium that you parse to be used in VR to have your immersive virtual reality interface 🧐

Cannon Moles

• Sync players in a 2D game from crappy phone to a player on Gear VR to player a social game with your friends
• Fire moles on sight or by clicking on the pad

BIFFF Catalog

• Use augmented reality as controller to move around 3D objects in virtual reality
  • Used to display movies and where they have place in the festival
  • Used to display the map of the festival
  • Used to display movies trailer in immersive ways

Virtual Atlas & 360 Apps

• Visit the work by looking a point on a map that switch the 360 photos around you
  • Look at the ground logo make the menu appear
  • Make the menu moving only when the user look far away of it
  • Make look at button actions
• Virtual Car
  • Allow to move from car to car using teleport anchor on photo position in the application
  • Allow to load specific car by using a menu that appear when looking at it
• Ravenstein VR
  • Same as previous but with cool icon integrated a bit more to the 360 image and some editor script a bit more fast to use.
• Hotel 360
  • Same as previous but with interactive buttons for publicity and light shader to tweak luminosity and the rotation of the photo in the editor

Dodge

• Slow motion guns fight asymmetric game where a player use the head of the headset and the other player the controllers

Fly Fly

• Plane fighting game where both player use the controllers of the Vive to fight in a plane game without the headset

360 Anonymous field of view

• Use a camera 360 clip on my face to make an immersive story game

Muforia

• Use augmented reality trackers printed and clip on the walls to see how would fit object on the wall of the room in AR/VR with Gear VR

Vizor VR

• Feel a festival in 360
  • Use video in old unity on a 360 sphere without quality lost
  • Use a first proto of sound tweaking base on if you look at the public or the concert

Design space analytics

• Help Thomas on his project to store information of where the player is looking in a 3D map and send the information to a data base in PHP to be observe extracted on the computer and observed on his tool in the Vive.

BruSee

• See graphs in 3D of the Brussels visit

360 VR Roller Coaster

• Do a roller coaster with full graphics around and record it in 360 stereo to make an application that can be pay on any cardboard.

Dok Hack Story

• Make transition from video loop to video loop with sound to live a story
• Have sound changing depending of what you look in 360

In the Cell

• Have information based on what your look in the game
• Have a 3D cockpit around you to feel in the cell
  • Display information in the cockpit of what is happening
  • Make the cockpit navigable in VR with the gear
  • avoid making people sick
• Display the device batteries in the us to help the user know how many time he still have in the game. (I could have add the heat of the device with Gear VR 😂)

Artery VR

• Use a full solo game on the device, but just send the bullet start point & intensity to the php data base that is sync by all players to make a massive multiplayer cannon artery game 🧐

Microsoft Hololens on VR

• Create a fake UI to simulate the Hololens view in your Virtual reality headset to avoid 20 minutes of compilation to make tests with your game
  • Switch on/off object rendering that are not in the fake ui to simulate the Hololens behavior
  • Use a 3D scan mesh to put the simulation to it maximum
• Use XR Input first version of Unity to recover the hands position of the Hololens 1
• Use git fork of a core project that have the game logic to have projects that have native of Hololens, Gear VR and WMR in it.

Punch to the break

• Use controller rotations of Oculus Go to simulate a boxing game.

Stereo Experiment & Stereo Recorder

• Don't use the classic 6cm between the eyes to feel 3D distance of mountains !!!
• Record an asset in Unity and convert it to a stereo video to be seen in VR with cardboard (interact with the slide to move around in the video frame)
• PS: use rendering in one yes and an other in the other with an other at the same position give nice effect in Virtual Reality 🤟.

Painted Dream

• Use painted mesh in Gear VR optimised with Mesh Lab from Tilt Brush to create and story.
  • Watch to character teleport you in their point of view and you can hear their thinking in the scene.

Teaching simulator

• Make the object non observed react to the player
• Allow the user to draw and erase on a board with shader
• Use asset from Google Block

Youtube Heatmap

• Color the video in Unity to a have information in video 360 during a the display of the video.

Restream Chat Hacking

• Sniff the code of the Restream chat to send it to the virtual reality throw a console.

"Voice ce qui vas se passer"

• Created a tool to simulate the position and the rotation of fake foot in the game based on the move and direction of the player head.

Lab Photo record

• record photos with their position compare to the Quest pivot
• recenter the Unity scene based on a point recorded in the real room
• allow to see data that human can't see in time volume or/and time

Kiss your puppets

• Use the Oculus S as a tracker to make puppet game on a classic 2D screen

Kaput Commander

• Use the hand of the Oculus quest to manipulate a tower defense game with your fingers.

[EloiStree]

Artiste proposition

Find what artist would be delighted for you to code #64