Skip to content

v3.8.3 - Free Reddit at ScrapeCreators parity

Latest
Latest

Choose a tag to compare

View all tags
@mvanhorn mvanhorn released this 25 Jun 22:57
· 11 commits to main since this release
v3.8.3
d5f3083
This commit was signed with the committer’s verified signature.
mvanhorn Matt Van Horn
SSH Key Fingerprint: MevKPyzgQjT/itW4zvDsT+dFrO6TLlpJhM5/E5AMvhM
Verified
Learn about vigilant mode.

Added

  • Free Reddit gets dedicated-subreddit lanes: entity-home subs (e.g. r/Kanye for "Kanye West", via the new --dedicated-subreddits flag) are pulled in full from top+hot+new listings and exempt from the relevance floor, since the whole sub is the topic. Fixes the over-aggressive floor that dropped on-topic posts whose titles lacked the entity name.
  • reddit_arctic resolves upvote counts for threads found only via RSS search (which carries no score) using the free, keyless arctic-shift archive — batched, paced, cached, and graceful-degrading. Reddit now gets headlines-with-points and best-comments-with-points entirely for free, at parity with ScrapeCreators.
  • LAST30DAYS_REDDIT_SC_MIN_ITEMS (default 0 = unchanged empty-only behavior): set above 0 to let the ScrapeCreators backup backfill a thin free Reddit run instead of sitting idle. Backfilled items merge deduped by post id.

Removed

  • The permanently-403 search.json Tier 0 is gone from the keyless Reddit path; discovery is RSS breadth + shreddit listing partials (real scores) + the dedicated-sub lanes, with no wasted 403 calls.
Assets 2
Loading