How to work with a very large “allowed_domains” attribute in scrapy? #1908
@redapple https://stackoverflow.com/questions/36440681/how-to-work-with-a-very-large-allowed-domains-attribute-in-scrapy/36454033 the problem is my question, but the method efficienty is too low
Yeah, I write this following test code
it showed up the following error code:
I don't know re2 what method to replace the escape and compile, i don't know do you have any good suggestions, think you.