-
bianjiang committed on GitHub
Feb 18, 2017
-
bianjiang committed on GitHub
Aug 10, 2016
-
replace import futures with import concurrent.futures
bianjiang committedJun 30, 2016
-
bianjiang committed
Jul 3, 2015
-
bianjiang committed
May 4, 2015
-
Merge pull request #3 from stepmr/patch-1
Allow redis connection without password
bianjiang committedMar 4, 2015
-
bianjiang committed
Dec 17, 2014 -
bianjiang committed
Dec 17, 2014 -
bianjiang committed
Dec 17, 2014 -
bianjiang committed
Dec 17, 2014
-
Merge pull request #2 from cbuntain/master
Bug fixes when commands fail and need to be redistributed.
bianjiang committedApr 3, 2014
-
Merge pull request #1 from bitdeli-chef/master
Add a Bitdeli Badge to README
bianjiang committedFeb 5, 2014
-
bianjiang committed
Nov 14, 2013 -
bianjiang committed
Nov 14, 2013 -
bianjiang committed
Nov 14, 2013 -
bianjiang committed
Nov 14, 2013 -
bianjiang committed
Nov 14, 2013 -
bianjiang committed
Nov 14, 2013 -
Releasing health topic follower dataset
bianjiang committedNov 14, 2013
-
add support to clear a node's queues to get you a fresh start
bianjiang committedNov 13, 2013 -
only keeps http proxies, free https proxies noramlly just won't work...
bianjiang committedNov 13, 2013
-
bianjiang committed
Nov 11, 2013
-
shouldn't clear out the crawler queue after restart...
bianjiang committedNov 10, 2013 -
bug in recreating failed crawler
bianjiang committedNov 10, 2013 -
continue migrating local multiprocessing.Queue to redis queue
bianjiang committedNov 10, 2013
-
rewrite local crawler queue using redis; using lifo queue so that con…
…trol commands can be grab asap;
bianjiang committedNov 9, 2013
-
handle dead crawler gracefully: cleanup residue resources; and schedu…
…le it to restart after 30 mins
bianjiang committedNov 8, 2013 -
clean up leftover, if a crawler gets restarted
bianjiang committedNov 8, 2013
-
change python2.7 to python in boostrap.sh and client.sh
bianjiang committedNov 5, 2013
-
bianjiang committed
Oct 30, 2013
-
bianjiang committed
Oct 23, 2013 -
bianjiang committed
Oct 23, 2013 -
show full stack when error occurs, so we can catch what's wrong..
bianjiang committedOct 23, 2013