Skip to content

Latest commit

 

History

17 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 

Repository files navigation

🤖 DataTalk - A Multimodal Q&A Chatbot

A powerful AI chatbot that answers questions from documents (PDF, DOCX, CSV), images, and videos using cutting-edge NLP and computer vision models.

Built with Streamlit, Hugging Face Transformers, BLIP, and FAISS.


📌 Features

  • 🔍 Semantic search using SentenceTransformers + FAISS
  • 📄 Text QA from PDF, DOCX, CSV using BERT
  • 📊 Handles structured data (tables in DOCX and CSV)
  • 🖼️ Visual Q&A using BLIP (Salesforce)
  • 🎞️ Video QA by extracting frames using OpenCV
  • 🧠 User-friendly Streamlit UI

📂 Supported File Types

Type Formats
Documents .pdf, .docx, .csv
Images .jpg, .jpeg, .png
Videos .mp4, .avi, .mov

🧠 Models Used

Task Model Name
Sentence Embedding all-MiniLM-L6-v2 (SentenceTransformers)
Text Q&A bert-large-uncased-whole-word-masking-finetuned-squad
Visual Q&A Salesforce/blip-vqa-base

Output

Screenshot 2025-03-24 184152 Screenshot 2025-03-24 193255 Screenshot 2025-03-24 193834 Screenshot 2025-03-24 194945 Screenshot 2025-03-24 195408 Screenshot 2025-03-24 200116

👨‍💻 Author

Made by Dharshini


About

DataTalk is a Multimodal Chatbot tool that answers questions from text, images, and videos using models like BERT and BLIP. It supports PDFs, DOCX, CSVs, images, and videos, with a simple Streamlit UI.

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages