Qwant blocked

[fl02]

Why did you decide to block the Qwant-bot? It's a legitimate search engine which reads and obeys the robots.txt.

[mitchellkrogza]

I assume you are referring to Qwantify? Must have lingered in there since my original lists, removed with next Commit coming shortly. Has been removed with latest commit - 20dbd00

Thanks for alerting me to this. This one must have slipped through from one of my very early bad bot lists. Will go through bot lists again for a good double check. Please notify me if you spot anything else.

[eurobank]

Qwant/Qwantify doesn't read/respect robots.txt.

[chrisastley]

I'm having big issues with a group of Useragents/bots that don't respect robots.txt and are crawling the same URL's over and over.

Qwantify
VelenPublicWebCrawler
CCBot
ZoominfoBot
Seekport

They appear to be linked as they all crawl the same handful of pages at the same rates and all ignore robots.txt and I'm often finding 3-4 of the above bots hitting the same page on the same seconds continually.