v0.2.2

MuckScraper v0.2.2

What's New

Cleaner UI

The sidebar has been reorganized — maintenance actions (Force Re-group, Reclassify Topics, etc.) have moved into a hamburger menu (☰) in the top right corner, keeping the sidebar focused on navigation. The sidebar is now collapsible to give more screen space to articles. State is remembered between sessions.

Grouped Stories View

A dedicated Grouped Stories view now shows only stories covered by multiple outlets — the most newsworthy content — paginated at 50 per page. This is the fastest way to see what's actually being widely covered.

Smarter Story Ordering and Matching

Stories are now ordered by the date of their most recent article rather than when the story was first created, so the freshest news always appears first. Story matching now uses single linkage — a new article is compared against every article already in a story rather than just the first one, which improves grouping accuracy.

Aggregator Deduplication

When a story has articles from both original outlets and aggregators (Yahoo News, Google News, MSN, AOL), the aggregator versions are now hidden automatically. You see the original reporting instead.

Timestamps in Local Time

Article published and fetched dates are now shown in your local timezone rather than UTC.

Database Migration Required

If upgrading from v0.2.1, run this in pgAdmin:

ALTER TABLE articles ADD COLUMN IF NOT EXISTS fetched_at TIMESTAMP DEFAULT NOW();

Known Limitations

• No authentication — do not expose to the internet
• Development server only
• cleanup_duplicates.py is a work in progress