v0.3.0

Features

• New crawler package — generic, reusable Colly-based web crawler
  • Concurrent page fetching with configurable parallelism
  • Retries with exponential backoff
  • Rate limiting per domain
  • Pluggable Evaluator interface for document processing
  • Async result streaming via channels

Improvements

• Upgraded CI to actions/checkout@v4, actions/setup-go@v5 with go-version: 'stable'
• Fixed allowed_actions repo setting that was blocking all CI runs

Testing

• Integration tests for basic crawl and retry scenarios