Skip to content

v0.2.5

Choose a tag to compare

@github-actions github-actions released this 23 Jul 15:35
· 58 commits to main since this release

Added

  • SharedLimiter: a shareable throttle clock + concurrency semaphore. Give the
    same limiter to every Scraper that talks to one host — via the new
    limiter= constructor argument or adopt_limiter() — and the host-wide
    request rate and in-flight cap are enforced across all of them, while each
    scraper keeps its own cookies, headers, and abort signal.
  • Scraper now forwards extra keyword arguments (e.g. limiter=) to the
    underlying ScraperEngine.