No description, website, or topics provided.
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Type Name Latest commit message Commit time
Failed to load latest commit information.

CS 194-26 Final Project

Video Synchronization


This was made as the final project for my Computational Photography class, and development is ongoing.

My goal was to modify the frames of a video such that they appeared somehow synchronized or reacting to a song or other audio. Applications include syncing dance-heavy music videos to different songs, or making it look like a person or animal is dancing to a beat.

Peak matching audio strength with optical flow magnitude yielded cool results, but I have started to implement everything from Abe Davis's Visual Rhythm Project, which matches audio onset envelopes with video impact envelopes, taking tempo into account.

See a demo here.

Directory Structure

### Code Files             # Select file names and methods             # Simple peak detection functions
----       # Interfaces and content processing code
----      # Identify potential matching points
----       # Merge media

### Required Media Folders
---- audio/
---- video/