We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
5386f4d
Adds a new command line option to specify the user agent to use when crawling.
E.g.
.\crawler.exe --url https://awesomesite.net --useragent "My Crawler"
