Skip to content
Web crawler using Selenium with NodeJs
JavaScript
Branch: master
Clone or download
Latest commit e81b265 Sep 24, 2017
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
temp init Sep 24, 2017
.gitignore init Sep 24, 2017
README.md init Sep 24, 2017
docker-compose.yml init Sep 24, 2017
package.json
server.js init Sep 24, 2017

README.md

Crawl website use Selenium with Nodejs

  • Dockerzing Selenum grid system.
  • Crawl all products from first page of taobao.com's category using Nodejs.

How to run

  1. $ npm install
  2. $ docker-compose up
  3. $ docker-compose exec app bash -c "cd /app && node server.js \"category_url\" \"destination_file_name\""
You can’t perform that action at this time.