crawler2

爬虫2.0

环境要求

1、nodejs >= 5.0.0

2、elasticsearch >= 2.3

3、rabbitmq >= 3.2.4

代理节点启动命令：NODE_ENV=production NODE_IPS=106.75.78.203:3000 NODE_CHIP=1 forever start . 爬虫启动命令：ENV=production NODE_IPS=106.75.78.203:3000 NODE_QUEUE=106.75.78.203 forever start .

Name		Name	Last commit message	Last commit date
Latest commit History 201 Commits
.idea		.idea
.vscode		.vscode
core		core
hhhuo		hhhuo
mapping		mapping
spider		spider
typings		typings
.DS_Store		.DS_Store
.gitignore		.gitignore
.jshintrc		.jshintrc
README.md		README.md
index.js		index.js
jquery.js		jquery.js
package.json		package.json

nick121212/crawler2

Folders and files

Latest commit

History

Repository files navigation

crawler2

环境要求

1、nodejs >= 5.0.0

2、elasticsearch >= 2.3

3、rabbitmq >= 3.2.4

About

Resources

Stars

Watchers

Forks

Languages