/tweetf0rm

Permalink
Switch branches/tags
Nothing to show
Commits on Dec 17, 2014

  1. remove temp data

    committed Dec 17, 2014
    7ab6d5b

  2. allow crawling without proxy

    committed Dec 17, 2014
    1797c89
  3. @bi0nji0ng

    refactor, add search_for function, need more work to create crawler d… 

    …ynamically per request
    bi0nji0ng committed Dec 17, 2014
    e5c1183

  4. test proxies

    committed Dec 17, 2014
    c454bd0

  5. stream apis

    committed Dec 17, 2014
    6353ea3
Commits on Dec 11, 2014

  1. Update README.md 

    Update Readme
    committed Dec 11, 2014
    f59e574
Commits on Nov 22, 2014

  1. update proxy crawler

    Jiang Bian committed Nov 22, 2014
    00ad660
Commits on Apr 3, 2014

  1. Merge pull request #2 from cbuntain/master 

    Bug fixes when commands fail and need to be redistributed.
    committed Apr 3, 2014
    8f75668
  2. @cbuntain

    Added behavior for crawling specific tweet IDs both manually and in 

    batch mode.
    cbuntain committed Apr 3, 2014
    b8345c2

  3. Fixed two bugs. In one, the node queue size used an incorrect variable 

    name. In the other, the command to redistribute to other nodes wasn't
being populated.
    Cody Buntain committed Apr 3, 2014
    3365890
Commits on Feb 5, 2014

  1. Merge pull request #1 from bitdeli-chef/master 

    Add a Bitdeli Badge to README
    committed Feb 5, 2014
    6c87fb1
  2. @bitdeli-chef

    Add a Bitdeli badge to README

    bitdeli-chef committed Feb 5, 2014
    52aa63e
Commits on Nov 14, 2013

  1. Update README.md

    committed Nov 14, 2013
    f6ec511

  2. Update README.md

    committed Nov 14, 2013
    b858ad7

  3. Update README.md

    committed Nov 14, 2013
    2ff57c5

  4. Update README.md

    committed Nov 14, 2013
    398528d

  5. Update README.md

    committed Nov 14, 2013
    d4cd9b8

  6. Update README.md

    committed Nov 14, 2013
    9d4dc05

  7. Releasing health topic follower dataset

    committed Nov 14, 2013
    ea5b80c
Commits on Nov 13, 2013

  1. add support to clear a node's queues to get you a fresh start

    committed Nov 13, 2013
    8bb2ff8

  2. only keeps http proxies, free https proxies noramlly just won't work...

    committed Nov 13, 2013
    8cf4d94
Commits on Nov 11, 2013

  1. load balancing rules update

    committed Nov 11, 2013
    0987c29
Commits on Nov 10, 2013

  1. shouldn't clear out the crawler queue after restart...

    committed Nov 10, 2013
    ee52dd8

  2. bug in recreating failed crawler

    committed Nov 10, 2013
    0cbc9e4

  3. continue migrating local multiprocessing.Queue to redis queue

    committed Nov 10, 2013
    39844f3
Commits on Nov 9, 2013

  1. rewrite local crawler queue using redis; using lifo queue so that con… 

    …trol commands can be grab asap;
    committed Nov 9, 2013
    4439f2f
Commits on Nov 8, 2013

  1. handle dead crawler gracefully: cleanup residue resources; and schedu… 

    …le it to restart after 30 mins
    committed Nov 8, 2013
    84e96d1

  2. clean up leftover, if a crawler gets restarted

    committed Nov 8, 2013
    53286d2
Commits on Nov 7, 2013

  1. close redis connection when its done; otherwise, it causes error

    Jiang Bian committed Nov 7, 2013
    1e7cd87
Commits on Nov 6, 2013

  1. Merge branch 'master' of bitbucket.org:bianjiang/tweetf0rm

    Jiang Bian committed Nov 6, 2013
    ac6c3a2

  2. add in function to get the full user object from a list of user ids; … 

    …and add in GET_USERS_FROM_IDS command; see tweetf0rm/client.py;
    Jiang Bian committed Nov 6, 2013
    10f08c7
Commits on Nov 5, 2013

  1. change python2.7 to python in boostrap.sh and client.sh

    committed Nov 5, 2013
    27935de
Commits on Nov 4, 2013

  1. update readme, and sample config file

    Jiang Bian committed Nov 4, 2013
    0e0407f

  2. killall.sh script

    Jiang Bian committed Nov 4, 2013
    9c694c1
Commits on Nov 2, 2013

  1. use app_key as id, and add-in support for restart the entire crawler

    Jiang Bian committed Nov 2, 2013
    2c9130a