The code for Presence - a kinetic sculpture that detects a viewer's gaze in real-time using a neural network and moves in response to the gaze
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
GazeCapture @ 03e687b
js
notebooks
processing_sketches
.gitignore
.gitmodules
FPS.py
FaceAndEyeDetectorStream.py
README.md
TODO.md
WebcamVideoStream.py
features.py
features.pyc
gaze.py
gaze.pyc
gaze_detection_from_file_tester.py
gaze_detector.py
gaze_detector.pyc
gaze_detector_from_camera.py
gaze_detector_from_camera_stream.py
gaze_detector_from_camera_stream.pyc
gaze_recorder.py
gaze_server.py
gaze_stream_tester.py
lib.py
lib.pyc
rendering.py
requirements.txt
video_frame_recorder.py

README.md

Presence

Presence is a kinetic sculpture that detects a viewer's gaze in real-time using a convolutional neural-network and moves in response to the gaze

It uses a webcam and the pre-trained model from Eye Tracking for Everyone to detect where users are gazing, and moves in the direction of the gaze.

Key files/documentation

Full documentation coming soon

Requirements

For gaze detection:

  • python
  • caffe
  • opencv

To render simulations of the servo positions:

  • processing