Release v0.1.6

What's Changed

See CHANGELOG.md for details.

Installation

pip install opencrawl

Ethical Crawling

This release maintains our commitment to ethical web crawling through:

• Strict robots.txt compliance
• Rate limiting per domain
• Respectful delays between requests
• Queue-based processing

Making the web a better place, one respectful crawl at a time 🌐✨