No description, website, or topics provided.
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
media
synchronize
.gitignore
README.md
main.py
peak.py

README.md

CS 194-26 Final Project

Video Synchronization

Overview

This was made as the final project for my Computational Photography class, and development is ongoing.

My goal was to modify the frames of a video such that they appeared somehow synchronized or reacting to a song or other audio. Applications include syncing dance-heavy music videos to different songs, or making it look like a person or animal is dancing to a beat.

Peak matching audio strength with optical flow magnitude yielded cool results, but I have started to implement everything from Abe Davis's Visual Rhythm Project, which matches audio onset envelopes with video impact envelopes, taking tempo into account.

See a demo here.

Directory Structure

### Code Files
main.py             # Select file names and methods
peak.py             # Simple peak detection functions
media
---- media.py       # Interfaces and content processing code
sychronize/
---- rhythm.py      # Identify potential matching points
---- synch.py       # Merge media

### Required Media Folders
input_files/
---- audio/
---- video/
output_files/