This repository contains software design and code of the Humanoid Robot(Gyani 2.0) created by our team. It works as a receptionist for our college and also got featured in National press (Times Of India, Danik Bhaskar and live telecast on News 18) of India.
Features of Humanoid Robot(Gyani2.0) :-
-> It can answer all your questions related to our college (works as a receptionist) and can greet you with Namaste, hand shake, etc .
-> Recognizing ability.
-> It can dance, play music and perform simple arithmetic operations.
-> Can answer your knick-knacks (natural questions).
-> Oled displays can display emotions in eyes.
-> Body parts are made by 3D printing.
Hardware used in the project is specified in 'Docs/hardware_requirement.docx' of this repository.
Dependencies that should be installed on raspberry pi before starting is listed in 'Docs/software_dependencies.docx'of this repository.
In this repository 'Scripts/maincode.py' consist of the major processing:-
(1) Used google's Speech To Text converter to convert user queries into text from speech.
(2) That text is then sended to Google's apiai(Dialogflow).
Google's apiai(Dialogflow) is an end-to-end, build-once deploy-everywhere development suite for creating conversational interfaces for websites, mobile applications, popular messaging platforms, and IoT devices. You can use it to build interfaces such as chatbots, conversational IVR, etc.
(3) After sending the queries to Dialogflow(v2_beta) version in text format an appropriate response comes in the form of audio and we save that to our system(on raspberry pi).
(4) Now the audio is played using VLC media player present in the system.
(5) Actions are also predefined accordingly to the response of any query, if response contain action:-
(5.a) Recognise me - then face recognition code will be executed. For face recognition I have used openCV and face_recognition libraries. The face_encodings in '.dat' format files are pre stored on the system.
(5.b) Emotions - then an emotion on the Oled displays will be displayed. Like for
Love -> Oled will display 'img/Oled_img/heart.png'
any responses related to Money -> 'img/Oled_img/rs.png'
Music, Dance -> 'img/Oled_img/music.png' etc.
(5.c) Physical actions to be performed - then a data signal will be sent to Arduino through serial port (serial data communication) to instruct servo motors to perform required action.
The code is self explanatory.
