DelegatorProtocol to filter with regexps on URLs

[jnioche]

This adds to the recent improvements made to the DelegatorProtocol.
In addition to metadata, we should be able to define regular expressions on the URLs. This will make it easier e.g. to avoid using Selenium when dealing with a suspected pdf or Word file.