Skip to content

v0.4.0 - Resilient Multi-Tier Engine & Anti-Ban Shields

Choose a tag to compare

View all tags
@ismailsaoulaj ismailsaoulaj released this 20 Aug 10:52
· 27 commits to main since this release
v0.4.0
5c45abc

🚀 What's New in v0.4.0

This release introduces the high-availability Cascading Multi-Tier Engine, sub-second Cookie Authentication, and built-in Protective Shields (Rate Limiting, Concurrency Semaphore, and Singleflight Coalescing) to prevent WAF 403 blocks and IP bans under heavy AI traffic.

✨ Added

  • Cascading Multi-Tier Architecture: Seamless fallback pipeline (Official OAuth -> Session Cookie -> Browser-Impersonated Web JSON -> Enriched Public RSS -> DDG + Arctic Shift).
  • Optional Session Cookie Tier (REDDIT_SESSION_COOKIE): Enables direct authenticated JSON queries, sub-second latency, and native Reddit pagination (t3_... cursors).
  • Token Bucket Rate Limiter (_TokenBucketRateLimiter): Enforces safe requests-per-minute limits (default: 40 RPM) with jitter.
  • Global Concurrency Semaphore: Bounds concurrent outbound requests (default: 4) using asyncio.Semaphore.
  • Singleflight Request Coalescing (_singleflight): Automatically merges concurrent identical in-flight requests into a single network call.
  • Arctic Shift Batch RSS Enrichment: Automatically enriches Tier-3 public RSS posts with live scores, upvote ratios, and comment counts.

🛡️ Fixed & Improved

  • Fastly/Cloudflare WAF Bypass: Full Chrome 131 profile emulation with Client Hints (Sec-Ch-Ua, Sec-Fetch-Mode: cors).
  • Live Zero-Config Trends: Revived analyze_niche_trends to work in real-time without API keys across all tiers.
  • Test Suite Expansion: 138/138 unit and integration tests passing cleanly.
Assets 2
Loading