Freeweibo is a web service that automatically crawls microblogs on weibo platform that are blocked or deleted under the internet censorship by Chinese government. The whole process of this project has been covered in a toptal blog.
- Website show recently censored microblogs
- Email subscription for censored microblogs
- Add weibo user to crawl list
-
Register an account
-
Register 10 apps
unless you register an app as advanced level which may require monthly charging, we need 10 free level apps to get around the rate limit on API interface
-
Config user account and app id in /crawler/config.js
-
refer to run.sh for setup
- refer to deploy.sh