Skip to content

Releases: SagarBiswas-MultiHAT/WebSource-Harvester

v0.1.0 - URL Export and Multithreading

Choose a tag to compare

@SagarBiswas-MultiHAT SagarBiswas-MultiHAT released this 02 Mar 08:30
4d0833f

This release introduces new crawling flexibility and analysis features.

New Features:

  • --export-urls: Export all visited URLs to urls.txt
  • --no-download: Crawl without downloading files
  • --threads: Multi-threaded crawling support

Improvements:

  • Updated README documentation
  • Enhanced CLI usability

This update improves workflow control for educational web crawling and client-side analysis.