v0.5.3

🌍 Expanded Publisher Support & Key Bug Fixes 🌍

This release introduces 10 new publishers to fundus, bringing the total to 160 publishers across 37 countries. We've also added a feature that respects publishers' preferences to not be scraped for AI purposes (see our documentation for details).

Additionally, we resolved several bugs related to deadlocks that appeared in specific edge cases within our threading logic.

New Publishers

🇸🇪 Sweden

• Add SE Expressen by @ghostsshadow in #800

🇩🇪 Germany

• Add Stuttgarter Zeitung Parser by @myoncee in #808
• Add Der Freitag by @bresslem in #798

🇬🇧 UK

• Add Nature (UK Scientific Journal) by @Kucki2018 in #797

🇺🇸 USA

• Add Rest Of World Publisher by @marten-ti in #801

🇧🇪 Belgium

• Add BE Publisher (Politico EU) by @rascaria in #811

🇿🇦 South Africa

• Add Dizindaba by @addie9800 in #832
• Add Independent Online newspapers by @addie9800 in #827

Maintained Existing Publishers

• Add V1_1 for SeznamZpravy by @addie9800 in #821
• Fix ZwanzigMinuten by @addie9800 in #820
• Update upper_boundary_selector for NZZ by @addie9800 in #819
• Update topics for Funke by @addie9800 in #823
• Fix BoersenZeitung by @addie9800 in #824
• Add V1_1 for ZDF by @addie9800 in #825
• Fix summary_selector for TheNation by @addie9800 in #831
• Add V1_1 to NTVTR by @addie9800 in #830

New Features

• Add skip_publishers_disallowing_training by @addie9800 in #772
• Update generic_parsing by @addie9800 in #822

Bug Fixes

• Fix spacing error in LaVanguardia by @MaxDall in #795
• Handle malformed XML by @addie9800 in #794
• Fix race conditions and improve exception handling by @MaxDall in #796
• Ignore type check for MONTHS by @addie9800 in #810
• Update User Agents by @addie9800 in #818
• Fix deadlock in queue_wrapper by @MaxDall in #833

New Contributors

• @ghostsshadow made their first contribution in #800
• @Kucki2018 made their first contribution in #797
• @marten-ti made their first contribution in #801
• @bresslem made their first contribution in #798
• @rascaria made their first contribution in #811

Full Changelog: v0.5.2...v0.5.3