An immersive installation built from a pile of mirror balls and a few projectors.
C++ GLSL Makefile
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
0-EdsdkOsc merged Sep 11, 2015
0-ProCamSample
1-ProCamScan
2-camamok Kyle wedding Jun 4, 2016
3-BuildXyzMap Minor build XYZ map fixes Sep 16, 2015
4-LightLeaks
Debug-Correlation more experiments. hard to say if anything works much better. Sep 14, 2015
Debug-MaskBuilder minor adjustments Jun 3, 2016
Debug-ProMapBuilder
Debug-Utilities refactoring, starting to rebuild all project files for 0.9.0 Sep 12, 2015
Debug-Visualize updated Debug projects to 0.9.0 Sep 12, 2015
SharedCode this works better Sep 14, 2015
SharedData
.gitignore
license.md
readme.md

readme.md

Light Leaks

"Light Leaks" is an immersive installation built from a pile of mirror balls and a few projectors, created for CLICK Festival 2013 in Elsinore, Denmark.

The app is updated for openFrameworks 090

Calibration Process

Before doing any calibration, it's essential to measure the room and produce a model.dae file that includes all the geometry you want to project on. We usually build this file in SketchUp with a laser rangefinder for measurements, then save with "export two-sided faces" enabled, and finally load the model into MeshLab and save it again. MeshLab changes the order of the axes, and saves the geometry in a way that makes it easier to load into OpenFrameworks.

  1. Capture multiple structured light calibration patterns using ProCamSample with EdsdkOsc. Make sure the projector size and OSC hosts match your configuration in settings.xml. If the camera has image stabilization, make sure to turn it off.
  2. Place the resulting data in a folder called scan/cameraImages/ in SharedData/. Run ProCamScan and this will generate proConfidence.exr and proMap.png.
  3. Place your model.dae and a referenceImage.jpg of the well lit space in camamok/bin/data/. Run camamok on your reference image. Hit the (back tick key) to generate the normals, then press the saveXyzMap button to save the normals.
  4. Place the resulting xyzMap.exr and normalMap.exr inside SharedData/scan/.
  5. Run BuildXyzMap. This will produce SharedData/confidenceMap.exr, SharedData/xyzMap.exr and SharedData/normalMap.exr
  6. Copy the results of BuildXyzMap into ProcessXyzMap/bin/data/ and run ProcessXyzMap.

Install Notes

  • Each projector should be focused on the mirror balls, outputting native pixels (no scaling or keystoning) and framing the entire collection of mirror balls.

Click Festival (2012)

  • Mac Mini
  • 1024x768 (native resolution) with TH2G

La Gaîté Lyrique (2014)

  • iMac
  • 1280x1024 with TH2G on projectiondesign F32 sx+ (native 1400x1050) inset on the sensor
  • When calibrating, create a network from the calibration computer that shares the ethernet and therefore provides DHCP.
  • BlackMagic grabber and SDI camera for interaction

Scopitone Festival (2015)

  • Mac Pro (the bin)
  • Mitsubishi UD8350U 6500 lumens, 1920x1200
  • 2 projectors running through triplehead2go, the last directly form

Redesign

  1. Run the CalibrationCapture app from a laptop that is on the same network as the computer that is connected to the projectors.
  2. On the computer connected to the projector run the Calibration app.
  3. Plug the camera into the laptop, and position it in a location where you can see at least N points. The app will tell you whether the image is over or underexposed.
  4. Transfer the images to the Calibration app, it will decode all the images and let you know how accurately it could reconstruct the environment.
  5. In the Calibration app, select control points until the model lines up.
  6. Start the LightLeaks app.

Future ideas

  • Auto calibrate from video taken with iPhone. Using BMC to encode the gray code signal.
  • Auto create point mesh from images so 3d model is not needed, and camamok is not required.
  • Change ProCamScan into a CLI that automatically is triggered by ProCamSample for live feedback on progress (highlight/hide points that have good confidence)