This chatbot can be used to find your desired VIDEOS and IMAGES of objects , animals , places and... the chatbot is using models like image captioning , Object detection , Intent Classification and Information Extraction . All you need to do is to talk to the chatbot , ask a few questions of how it works and how you can use it , and then start searching for your desired content ...
This program first processes the available images, identifying the objects and capturing the actions being performed (captions), and then stores this information in the database. When interacting with our chatbot, we have the flexibility to specify our preferences and the desired actions for the images. The bot takes care of the rest, seamlessly executing our requests.
Included below is a video showcasing the functionality of the project. (please watch with vpn turned off)
New.video.mp4
Included below are several images showcasing the functionality of the project
-
chating with the bot
-
asking for images
- finding images having a specific action done in them
- word emmbedings for finding the closest key phrases and words
- Rasa NLU and Intent Classification
- Entity Extraction
- POS and NER
- Object detection and Image captioning
MelodyHub is licensed under the MIT License.