The purpose of this project is to create a device, equipped with advanced motion sensors, that is capable of notifying the user about the activity taking place outside the door, allowing two-way communication with visitors via built-in speakers and a microphone. I chose this project because of the learning opportunity it provides. I was able to improve my knowledge about IoT and networking, subjects I was interested in before. Also I had the possibility to integrate a machine leaning model and to deepen my robotics capability.
My prototype aims to reshape the basic security systems by enabling a remote two-way communication, using WebRTC, a technology that uses both TCP and UDP protocols to establish real-time communication. To achieve this type of connection on the Raspberry Pi, without using a browser, I chose to use aioRTC, a Python library built on top of asyncio.
This component does use an infrared sensor in order to detect motion and it captures a picture of the subject. Then, the image is analyzed by an efficient computer vision model that is specially implemented for people detection.If the model positively detects human presence, the user will instantly receive a notification. This property is provided by the realtime servers integrated in the backend.
One of the revolutionary features is the remote door control option available on the web application, making it possible to open and close the door whenever you see fit.
Landing Page:
Home Page:
Camera Page:
Notifications Page:
Front end:
- React
- Chakra UI
Backend:
- Supabase
- aioRTC
- RaspberryPi 4B
- Jack speaker
- USB microphone
- PiCamera
- Servo motor