No description, website, or topics provided.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
res
sfx
video player
video tagging
visual_recognition_demo
.gitignore
README.md
emo_api_handler.sh
main_handler.py
mov2mp4.sh
vid_tag_analyzer.py
vid_tagging.py
visual_api_handler.sh

README.md

Movie Genie

This is a project for IBM's BlueHack 2017.

interface

Description

An emotion analysis based real time movie scene modifying video player. The current prototype would enhance audience experience of any horror movie or video by manipulating effects in the video according to the facial mood gestures of the audience.

YOUTUBE LINK:https://youtu.be/-YdCxjJUEQQ

Link to Presentation: https://youtu.be/-YdCxjJUEQQ

Link to 3 minute pitch video: https://drive.google.com/open?id=0B_INX3BifvJoUV92SGNFN0Z2VGs

GitHub: https://github.com/knmac/scarifier

Workflow

workflow

While the film is playing, the emotion of the watcher is recognized by the Watson Facial Recognition API and categorized as either a negative or positive emotions. The movie player uses this data to change to content of the video. The film is pre-examined with the Watson Visual Recognition API to tag the content of the video to improve the quality of the changes. It uses the augmentation library to change the mood of the film using music and visual effects. The final product is a video which atmosphere changes based on the user data and content of the video.

candidate

This graph tracks the appearance of the candidate (the scary monster in this case). It uses the Watson Recognition API to analyze the content on the screen to make it easier to pin point where the editor could quickly increase the fear factor.