node定义爬取
- User-Agent模拟，降低网站被拒绝的机率（done）
- UTF-8编码处理(iconv-lite解码)(done)
- 超时控制（done）
- 异步并发控制(done)
- IP代理(done)
- 模拟cookie
- 存储
- 分析
-
Notifications
You must be signed in to change notification settings - Fork 0
hwlcode/node_spider
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
node定向爬取
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published