Liquid-Player

A Media Player which recognises the emotion of the user and plays a song accordingly. Currently supported emotions are:

• Happy
• Sad
• Neutral

The songs have to be kept in three different folders namely happy, sad and neutral and based on the emotion, a random song is played from the corresponding folder. The song is played as long as long as a face is being detected in the feed obtained from the webcam. The moment no face is detected, the song pauses automatically and then resumes when a face is detected.

Features separating this from an ordinary media player:

• Emotion recognition
• Automatic pause and resume based on face detection

Hardware requirements:

A mid-ranged GPU is highly recommended for getting a good FPS value of the CNN based face detector. We have developed and tested this throughly on a gaming laptop with a 4GB NVIDIA GeForce GTX 1050 card and an i7 7700HQ CPU with 8GB RAM running Linux Mint 18.3.

Libraries used:

• We have used the libvlc C++ wrapper as the Media Player backend.
• The Dlib C++ Library has been used for face detection. In our project we have used the CNN-based face detector available in Dlib shown in this example
• The emotion recognition part has been done in Python using Keras.

Note:

The emotion detection has been done in Python and the video playing and face detection has been done in C++. The integration of these two portions have been done using a system call: system("python3 realtime.py"); in test2.cpp. This has prevented the need of using any wrapper code.