Data Aggregator API

The Data Aggregator API is a lightweight service for collecting and unifying public financial and market-related data.
It focuses on scraping webpages, fetching Google News headlines, and collecting Reddit posts.

---

🚀 Features

• Web Scraping → Extract raw text and metadata from any URL
• Google News → Fetch news headlines for a search query
• Reddit Headlines → Collect subreddit posts (via Reddit API / PRAW)

---

📂 Endpoints Overview

• GET /scrape/url?url={page_url} → Scrape text from a webpage
• GET /scrape/news?q={query}&limit=10 → Fetch Google News results
• GET /scrape/reddit?subreddit={name}&limit=25 → Get subreddit headlines

---

🔑 Authentication

• No authentication required for local development.
• For Reddit scraping, add credentials in a .env file: