🤖 AI Web Scraper

An AI-powered Web Scraper that combines traditional scraping (BeautifulSoup/Playwright/Requests) with Large Language Models (LLMs) such as Ollama to extract, clean, and interpret data from websites in a human-readable way.

---

📌 Features

• 🌐 Scrape static and dynamic websites
• 🧠 Use AI (LLMs) to summarize, clean, or classify scraped text
• 📊 Export results in CSV / JSON / Markdown
• 🔍 Ask questions directly about scraped data
• ⚡ Works fully locally with Ollama models (e.g., Mistral, LLaMA2)

---

🛠️ Installation & Setup

1. Install Ollama

Download Ollama from here and ensure it’s running:

ollama --version

🛠️ Installation & Setup

2. Clone the Repository

git clone https://github.com/abeni-hub/AI-Web-Scraper
cd AI-Web-Scraper