Skip to content
@apify

Apify

We're making the web more programmable.
README.md

Apify Banner

Apify is the largest ecosystem where developers build, deploy, and publish data extraction and web automation tools. We call them Actors.

discord X/Twitter youtube linkedin

Learn About Apify 🧑‍🎓

  • Find hundreds of ready-made Actors for your web scraping or automation project on Apify Store.
  • Learn everything about web scraping and automation with our free courses that will turn you into an expert scraping developer.
  • Publish your web scrapers as paid Actors on the Apify platform, attract people who need these solutions, and get regular passive income.
  • View our livestreams and video content at the Apify YouTube channel.
  • Learn more through tutorials and thought leadership content about web scraping on Apify Blog and Crawlee Blog.

We are hiring! 🕸️

Check out the open positions at Apify and help us make the web more programmable.

Pinned Loading

  1. crawlee-python crawlee-python Public

    Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Wo…

    Python 5.4k 358

  2. crawlee crawlee Public

    Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, an…

    TypeScript 17k 762

  3. apify-cli apify-cli Public

    Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.

    TypeScript 134 21

  4. proxy-chain proxy-chain Public

    Node.js implementation of a proxy server (think Squid) with support for SSL, authentication and upstream proxy chaining.

    JavaScript 892 147

  5. got-scraping got-scraping Public

    HTTP client made for scraping based on got.

    TypeScript 621 49

  6. fingerprint-suite fingerprint-suite Public

    Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

    TypeScript 1.2k 124

Repositories

Showing 10 of 153 repositories
  • actor-templates Public

    This project is the 🏠 home of Apify Actor templates to help users quickly get started. Contributions welcome!

    apify/actor-templates’s past year of commit activity
    Python 27 20 12 3 Updated Mar 6, 2025
  • crawlee-python Public

    Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

    apify/crawlee-python’s past year of commit activity
    Python 5,367 Apache-2.0 358 70 5 Updated Mar 6, 2025
  • apify-sdk-python Public

    The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides useful features like actor lifecycle management, local storage emulation, and actor event handling.

    apify/apify-sdk-python’s past year of commit activity
    Python 126 Apache-2.0 11 15 4 Updated Mar 6, 2025
  • crawlee Public

    Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

    apify/crawlee’s past year of commit activity
    TypeScript 17,024 Apache-2.0 762 135 (1 issue needs help) 21 Updated Mar 6, 2025
  • fingerprint-suite Public

    Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

    apify/fingerprint-suite’s past year of commit activity
    TypeScript 1,229 Apache-2.0 124 22 10 Updated Mar 6, 2025
  • apify-actor-docker Public

    Base Docker images for Apify actors.

    apify/apify-actor-docker’s past year of commit activity
    Dockerfile 75 Apache-2.0 25 9 1 Updated Mar 6, 2025
  • actor-web-automation-agent Public

    This is the experimental version of Web Automation Agent. The agent uses natural language instructions to browse the web and extract data.

    apify/actor-web-automation-agent’s past year of commit activity
    TypeScript 32 Apache-2.0 22 9 0 Updated Mar 6, 2025
  • apify-docs Public

    This project is the home of Apify's documentation.

    apify/apify-docs’s past year of commit activity
    API Blueprint 32 Apache-2.0 85 75 (2 issues need help) 13 Updated Mar 6, 2025
  • workflows Public

    Apify's reusable github workflows

    apify/workflows’s past year of commit activity
    Python 7 4 4 (1 issue needs help) 6 Updated Mar 6, 2025
  • actors-mcp-server Public

    Model Context Protocol (MCP) Server for Apify's Actors

    apify/actors-mcp-server’s past year of commit activity
    TypeScript 46 Apache-2.0 3 0 1 Updated Mar 6, 2025
View all repositories