Add Func<Arg, Retrun> hooks for on the fly behavior modification

[GoogleCodeExporter]

-Add Func<PageToCrawl, CrawlDecision> for ShouldCrawlPage
-Add Func<CrawledPage, CrawlDecision> for ShouldCrawlPageLinks
-Add Func<CrawledPage, CrawlDecision> for ShouldDownloadPageContent

Original issue reported on code.google.com by sjdir...@gmail.com on 7 Nov 2012 at 5:19

[GoogleCodeExporter]

Pros: 
-Allows users to determine crawl behavior on the fly
-No classes or interfaces to implement and plugin

Cons:
-Not easy to test compound crawl behaviors
-Users must set these values on every instance (lots of copy and paste)
-Hard to group related or behaviors that are grouped together

Original comment by sjdir...@gmail.com on 31 Dec 2012 at 3:56

[GoogleCodeExporter]

Issue 24 has been merged into this issue.

Original comment by sjdir...@gmail.com on 31 Dec 2012 at 3:56

[GoogleCodeExporter]

Original comment by sjdir...@gmail.com on 31 Dec 2012 at 6:13

• Changed state: Started

[GoogleCodeExporter]

Added ShouldCrawlPage(), ShouldCrawlPageLinks() and ShouldDownloadPageContent()

Original comment by sjdir...@gmail.com on 2 Jan 2013 at 6:59

• Changed state: Fixed