GrabThisSpot is a Gesture-Based Robot Control which gives you the ability to communicate with robots through natural, intuitive means has the potential to redefine the way we engage with these mechanical counterparts. It embarks on a transformative journey into the realm of human-robot interaction, where hand gestures and movements become the conduit for commanding and controlling the movement of a robot.
GrabThisSpot is about effortlessly guiding a robot's every move, from navigating complex terrains to performing intricate tasks, simply by using your own body's language. No cumbersome controllers or intricate programming required—just the innate expressiveness of your hands and body. This project is dedicated to realizing this vision, pushing the boundaries of technological innovation, and ultimately enhancing the adaptability and accessibility of robotic systems.
The project is built on the foundation of the SPOT robot from Boston Dynamics, harnessing Python and the Flask web framework for development. Key components include computer vision techniques such as pose estimation (MediaPipe by Google) and facial recognition, facilitated by deep learning models. These technologies allow users to control the SPOT robot through natural hand gestures and movements. The integration of various sensors and robust communication protocols ensures real-time responsiveness and reliability, promising to revolutionize human-robot interaction by making it more intuitive and accessible across diverse applications and industries.
- SPOT ROBOT[By Boston Dynamics]: This spot robot was used for the project, can be replaced by any robot
- Mediapipe: A Python Library for detecting body posture
- DeepFace: A python library to detect and recognize faces
- OpenCV: A Python Library for image analysis
- Axios: Used to make HTTP requests to the Flask back-end and external APIs.
- Material-UI: A UI framework for creating responsive and visually appealing designs.
To install these dependencies, navigate to the base directory and run the following command:
pip install requirements.txt
Contributors names and contact info
Yash Khandelwal Julen Ferro