Skip to content

reqstorm 2.0.1

Choose a tag to compare

@melihcolpan melihcolpan released this 08 Oct 20:14
· 19 commits to master since this release

reqstorm is the new name of reqt. This first reqstorm release has the same features as reqt 2.0.0, under a name that is easier to find. Another project has used "reqt" since 2013.

$ python -m pip install reqstorm
import reqstorm

print(reqstorm.estimate(7000, rate_limit="100/min"))   # 7000 requests: about 1h 10m (limited by rate_limit)
results = reqstorm.fetch_all_sync(urls, rate_limit="100/min", retries=2, progress=True)
print(results.summary())
  • Documentation: https://reqstorm.github.io
  • Coming from reqt: replace import reqt with import reqstorm. The reqt package now installs reqstorm and re-exports it with a deprecation warning, so existing code keeps working.
  • What reqstorm does: per-host rate limits in any unit, retries and retry rounds, results with attempt history and reports, output to JSONL, CSV, SQLite, PostgreSQL or MySQL with resume, a blocking API for scripts and notebooks, and progress with an ETA. See the changelog.