0.1.2

MuckScraper v0.1.2-alpha — Initial Release

MuckScraper is a self-hosted news aggregator with LLM-powered bias scoring and summarization. This is an early alpha release — expect rough edges.

What it does

• Fetches articles from NewsAPI and GNews across configurable topics (US Headlines, World Headlines, US Politics, Technology, Gaming)
• Scrapes full article text using BeautifulSoup with Playwright fallback for JavaScript-heavy sites
• Scores outlet bias on a 1–5 left-to-right scale using a local Ollama LLM
• Groups articles into stories using LLM-assisted clustering across all topics
• Generates on-demand AI summaries of stories via Ollama
• Runs on a 3-hour fetch schedule with smart restart detection to avoid redundant API calls
• Clean UI with topic sidebar, bias tags, full article reader, and Ollama status indicator
• Fully self-hosted via Docker Compose with PostgreSQL

Requirements

• Docker and Docker Compose
• NewsAPI and GNews API keys (both have free tiers)
• Ollama running on your network with a compatible model

Known Limitations

• Development server only — not production hardened
• NYT, Washington Post, and some paywalled sites cannot be fully scraped
• Story clustering quality depends on your Ollama model
• No user authentication

See README.md and .env.example to get started.