Skip to content

agg-shambhavi/Intelligent-Vision

Β 
Β 

Repository files navigation

πŸ•΅οΈβ€ Intelligent-Vision

Socialify We are aiming to make a tool that will assist crime investigation authorities to rapidly analyze CCTV recordings/videos.

πŸ€” Problem

Let's say we have an images of a suspects, and we have the CCTV recordings of the crime scene. Now, the video recording could be of hours and there can be a long list of suspects. Finding the suspects manually in the video can be a time-consuming and labour intensive task. Given the seriousness of any crime investigation where prompt actions are required, a lot of time is wasted in analyzing videos.

πŸ” Solution

Let's automate this task and save some time!
Enter the suspect's picture and the video recording in our tool, and our tool will find the suspect's face in the video recording. You will be able to see the frames in which the suspect appeared in the video.

πŸ“Ή Demo

iv3

πŸ““ Machine Learning Pipeline

  1. Divide the video into frames.
  2. Detect faces in the frames and put those frames into a list.
  3. Encode detected faces using FaceNet(used face-recognition library).
  4. Group the faces of one person in a cluster using DBSCAN Algorithm.
  5. Detect the face in the query image and encode it.
  6. Predict in which cluster will the query image belong to using SVM.
  7. Retrieve all the frames in the predicted cluster

We have deployed the ML-Pipeline on a Web application using Flask.

πŸ“· Screenshots

image image
Landing Page Home Page
image shambhavii
Enter Query image & Video Query Image
input frames image
Frames of the video Results

πŸ”¨ Tech-Stack

  • Front-end : HTML, CSS, Bootstrap, JavaScript
  • Back-end: Flask
  • Machine Learning Libraries: Numpy, Pandas, Sci-Kit Learn, Face-recognition, OpenCV

πŸ§‘β€πŸ€β€πŸ§‘ Team Members

This project was built by Shambhavi Aggarwal, Bhargav Akhani and Dharven Doshi

πŸ“œ License

This project is released under a free and open-source software license, Apache License 2.0 or later (LICENSE or https://www.apache.org/licenses/LICENSE-2.0). The documentation is also released under a free documentation license, namely the GFDL v1.3 license or later.

Languages

  • HTML 58.3%
  • CSS 35.9%
  • Jupyter Notebook 4.6%
  • Other 1.2%