豆瓣防范规则

[mnhkahn]

只允许段时间内12次请求
2015/08/06 01:47:56 Start to Parse: http://www.douban.com/group/topic/76598516/ proxy: http://183.207.128.47:80
2015/08/06 01:47:57 Cawl Success.
2015/08/06 01:47:57 Add to DuoShuo Success.
2015/08/06 01:47:57 Start to Parse: http://www.douban.com/group/topic/78280849/ proxy: http://183.207.128.47:80
2015/08/06 01:47:57 Cawl Success.
2015/08/06 01:47:58 Add to DuoShuo Success.
2015/08/06 01:47:58 Start to Parse: http://www.douban.com/group/topic/78329068/ proxy: http://183.207.128.47:80
2015/08/06 01:47:58 Cawl Success.
2015/08/06 01:48:00 Add to DuoShuo Success.
2015/08/06 01:48:00 Start to Parse: http://www.douban.com/group/topic/74228349/ proxy: http://183.207.128.47:80
2015/08/06 01:48:03 Cawl Success.
2015/08/06 01:48:03 Add to DuoShuo Success.
2015/08/06 01:48:03 Start to Parse: http://www.douban.com/group/topic/78304280/ proxy: http://183.207.128.47:80
2015/08/06 01:48:04 Cawl Success.
2015/08/06 01:48:05 Add to DuoShuo Success.
2015/08/06 01:48:05 Start to Parse: http://www.douban.com/group/topic/76960919/ proxy: http://183.207.128.47:80
2015/08/06 01:48:06 Cawl Success.
2015/08/06 01:48:07 Add to DuoShuo Success.
2015/08/06 01:48:07 Start to Parse: http://www.douban.com/group/topic/72127170/ proxy: http://183.207.128.47:80
2015/08/06 01:48:07 Cawl Success.
2015/08/06 01:48:08 Add to DuoShuo Success.
2015/08/06 01:48:08 Start to Parse: http://www.douban.com/group/topic/78263641/ proxy: http://183.207.128.47:80
2015/08/06 01:48:08 Cawl Success.
2015/08/06 01:48:09 Add to DuoShuo Success.
2015/08/06 01:48:09 Start to Parse: http://www.douban.com/group/topic/75974276/ proxy: http://183.207.128.47:80
2015/08/06 01:48:09 Cawl Success.
2015/08/06 01:48:09 Add to DuoShuo Success.
2015/08/06 01:48:09 Start to Parse: http://www.douban.com/group/topic/78198161/ proxy: http://183.207.128.47:80
2015/08/06 01:48:10 Cawl Success.
2015/08/06 01:48:20 Add to DuoShuo Success.
2015/08/06 01:48:20 Start to Parse: http://www.douban.com/group/topic/78318542/ proxy: http://183.207.128.47:80
2015/08/06 01:48:21 Cawl Success.
2015/08/06 01:48:22 Add to DuoShuo Success.
2015/08/06 01:48:22 Start to Parse: http://www.douban.com/group/topic/77911318/ proxy: http://183.207.128.47:80
2015/08/06 01:48:22 Cawl Success.
2015/08/06 01:48:24 Add to DuoShuo Success.
2015/08/06 01:48:24 Start to Parse: http://www.douban.com/group/topic/78241453/ proxy: http://183.207.128.47:80
2015/08/06 01:48:24 http://www.douban.com/group/topic/78241453/ 302

[mnhkahn]

2015/08/06 21:26:09 [INFO] Start parse at 2015-08-06T21:26:09-04:00...
2015/08/06 21:26:09 Start to Parse: http://www.douban.com/group/haixiuzu/discussion proxy:
2015/08/06 21:26:09 Cawl Got Status Code 400.
2015/08/06 21:26:09 [SUCC] Parse end.