DeMystify

Abstract

Deepfakes may be used maliciously as a source of misinformation, manipulation, harassment, and persuasion. Identifying manipulated media is a technically demanding and rapidly evolving challenge that requires collaborations across the entire tech industry and beyond.

What it does

DeMystify uses deep learning to assist in determining if a face is real or not. In the desired field, the user must enter the input picture. After the user inputs the image, the googlenet model processes it and delivers the results as real and fake confidence. Fastapi sends the result to the browser as a response, displaying both real and fake confidence in a progress bar. In order to aid in identification, DeMystify helps to forecast the real and fake face.

How we built it

We had 3 phase in our project .

• The first phase is brainstorming where we went across various articles , research papers and real life incidents . Its where we came across this idea.
• The second phase is planning where we decided our techstack for frontend , backend , dataset to train the model and the neural network model to be used for this project.
• The third phase is the implementation where we created our GUI using React JS , API using Fastapi and Deep learning model was trained using deep fake dataset in Pytorch.

Architecture of DeMystify

Deep Learning Model Phase

GoogleNet :

Paper : https://arxiv.org/pdf/1409.4842v1.pdf

Challenges we ran into

The deep learning model we decided was GoogleNet. We had to customize some of the GoogleNet features according to our product. Creating API using FastAPI framework to handle request response for the Deep Learning Model. Making API calls using Axios library from React . Processing the desired request by the model within less time span .

Accomplishments that we're proud of

Using Googlenet model for identifying deep fake faces. Customizing the Googlenet model according to our project . Adjust parameters to bring a better accuracy for the model. Creating a desired GUI . Building an API using Fastapi to handle request response cycle .

What we learned

Using pretrained Neural Network models. Customizing the pretrained neural network according to our product. Usage of FastAPI . Creating GUI using React JS .

What's next for DeMystify

Implement DeMystify in various platforms such as mobile application . Introduce as browser extension such that various users can find fake and real faces within a single click . Improving accuracy of the Deep Learning by tuning.