Skip to content
@Gerapy

Gerapy

Distributed Crawler Management Framework Based on Scrapy, Scrapyd.

Pinned

  1. Gerapy Gerapy Public

    Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

    Python 3.2k 621

  2. GerapyAutoExtractor GerapyAutoExtractor Public

    Auto Extractor Module

    Python 307 73

  3. GerapyPyppeteer GerapyPyppeteer Public

    Downloader Middleware to support Pyppeteer in Scrapy & Gerapy

    Python 135 37

  4. GerapyRabbitMQ GerapyRabbitMQ Public

    Distribution Support for Scrapy & Gerapy using RabbitMQ

    Python 8 1

  5. GerapyRedis GerapyRedis Public

    Distribution Support for Scrapy & Gerapy using Redis

    Python 8 1

  6. GerapyProxy GerapyProxy Public

    A package for supporting proxy in Scrapy & Gerapy

    Python 10 4

Repositories

Showing 10 of 12 repositories

Top languages

Loading…

Most used topics

Loading…