Possibility to stop crawling (and start crawling async)

[GoogleCodeExporter]

Once the Crawl method has been called, there is no way to stop the crawling. 
This is a big issue when launching the crawler on big sites.

Original issue reported on code.google.com by finizio...@gmail.com on 17 Jan 2014 at 2:30

• Merged into: Add better cancellation to signal "hard stop" #96

[GoogleCodeExporter]

Cancellation was implemented in version 1.2.3 (not released yet but available 
here https://github.com/sjdirect/abot/tree/1.2.3). 

You can start the crawl asynchronously with cancellation support like so..

Task.Factory.StartNew( () => {
    crawler.Crawl(new Uri("http://aaa.com"), cancellationToken);
 }, cancellationToken)

Original comment by sjdir...@gmail.com on 17 Jan 2014 at 4:23

• Changed state: Duplicate
• Added labels: Type-Enhancement
• Removed labels: Type-Defect