Skip to content

wvanderp/tpb-scrape

Repository files navigation

tpb-scrape

the scraper for the pirate bay. written in node js. with data saved in a json format. and everything kept track of in mysql.

how to install

  1. install nodejs, npm, php and mysql.
  2. git clone.
  3. npm install in the working dir.
  4. import the sql from /sql
  5. edit the settings in "setting.json"
  6. ready to run index.js which does the scraping.
  7. set getNew.js to run every 5 min with cron for example

I need you for

  • spell checking.
  • code review.
  • profiling of the code (it is very slow now).
  • bringing up issues.
  • write some test for the data.
  • commenting the code.

if you are interested message me and I will help you start

todo

  • finding edge casses.
  • writing test.
  • publishing data.

About

scraper for the pirate bay

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published