bianjiang/tweetf0rm

refactor, add search_for function, need more work to create crawler d… …

…ynamically per request

close redis connection when its done; otherwise, it causes error

add in function to get the full user object from a list of user ids; … …

…and add in GET_USERS_FROM_IDS command; see tweetf0rm/client.py;

remove passwrod from config sample

remove config data

update dataset

proxies.json

duplicates

client.py and README.md that explains the usage of client.py

new proxies.json

crawl proxy list

remove verbose flags

remove testing config.json

more f0rmers

split function error

rate limit test

remove excessive logging

put in proxy switch, fail safe, and persist queue functions

m

config.json

local scheduler error

exclude sensitive information

checking scheduler

adding node queue, proxy support

need to rethink about scheduler

adding scheduler

adding scheduler

proxy check support

file handler

works with one crawler

redis

add code for redis support

sharing dict bewteen process

adding proxy support

user timelink