v1.4.2 — Real-world URL extraction

mahope released this 24 Aug 15:55

· 22 commits to main since this release

8c67a30

clean-copy CLI v1.4.2 improves URL → Markdown extraction against real websites:

Changes

Strips ARIA/role boilerplate (role=navigation/banner/contentinfo/complementary)
Removes MediaWiki maintenance boxes (ambox/ombox), navboxes, edit links and print-only cruft
Link-density scoring: navigation-heavy wrappers no longer outrank prose blocks
<section> added to candidate containers; hidden elements skipped
Prefers JSON-LD articleBody when present (news sites)
New live test: Wikipedia extraction verified in npm test

Verify

node test.js — 22 passed, 0 failed.

Assets 3