Skip to content

Safe Web Access v0.1.1

Latest

Choose a tag to compare

@mirza1272 mirza1272 released this 02 Aug 10:38

Safe Web Access v0.1.0

First public release of Safe Web Access, a secure and budget-aware Python package for controlled web access in crawlers, AI agents, backend services, and ingestion pipelines.

Highlights

  • Safe URL validation and normalization
  • HTTP and HTTPS scheme restrictions
  • Domain allowlists and blocklists
  • Port restrictions
  • Public IP validation and SSRF protection
  • Safe redirect validation
  • Advisory robots.txt checks
  • Response content-type validation
  • Streamed response-size limits
  • Immutable crawl budgets
  • Bounded retry policies with backoff and Retry-After support
  • Async SafeWebClient
  • Sync SyncSafeWebClient
  • Structured SafeWebResult
  • Privacy-safe event hooks
  • Full type hints with py.typed

Quality

  • 228 automated tests passing
  • 96% overall test coverage
  • Ruff checks passing
  • Black formatting checks passing
  • mypy checks passing
  • Clean wheel and source distribution
  • Verified installation in a fresh virtual environment
  • Test suite does not require real DNS or external internet access

Installation

pip install safe-web-access