Web Crawler/Spider for NodeJS + server-side jQuery ;-)

Flexible Node.js AI-assisted crawler library

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON.

web spider built by puppeteer, support task-queue and task-scheduling by decorators，support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架，提供灵活的任务队列管理调度方案，提供便捷的数据保存方案（nedb/mongodb），提供数据可视化和用户交互的实现方案

微信公众号爬虫

一个自我托管的 JavBus API 服务

🤖 A spider and server for Luoo.qy

一个用 Node.js 写的批量去水印多线程下载抖音用户发布/喜欢列表视频的爬虫

🕷️ This is an ES6 adaptation of the original PHP library CrawlerDetect, this library will help you detect bots/crawlers/spiders vie the useragent.

An admin UI project for a configurable web crawler platform

This repository is deprecated

[DEPRECATED] Simple, flexible, delightful web crawler/spider package

Telegram media spider for personal use

📚Comic Downloader (漫画下载器)

ppspider爬虫例子，B站视频信息及评论爬取，qq音乐信息及评论爬取，推特主题评论和用户信息爬取

All In One API to easily scrape data from any website, without worrying about captchas and bot detection mecanisms.

🎉 开箱即用的高性能可自定义的笔趣阁小说爬虫 快速下载无广告小说

Web crawling & scraping framework for Node.js on top of headless Chrome browser

Web crawler based on Puppeteer