Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides useful features like actor lifecycle management, local storage emulation, and actor event handling.

This repo is a part of blog series on several web scraping projects where we will explore scraping techniques to crawl data from simple websites to websites using advanced protection.

Apify API client for Python

Apify actor to run web spiders written in Python in the Scrapy library

An easy-to-use tool for making web service with API from your own Python functions.

Uses Apify to scrape Google Search Engine Results pages for all American Films between 1950-2020 and then parses the knowledge panel structured data.

Build a tool to query Google Maps API for local restaurants and output the results to TSV

scrape news articles from investing.com as much as you want

Our project leverages data mining techniques, including Apify, Airflow, BERT, PostgreSQL, and Power BI, to conduct in-depth sentiment analysis for bank branches. We successfully identify customer sentiments, highlight positive and negative aspects, and provide valuable insights for enhancing the customer experience and gaining a competitive edge.

Example of Python Scrapy project. It scrapes book data from https://books.toscrape.com/.

Our project's mission is to build a resilient data warehouse solution, facilitating comprehensive analysis of customer feedback for each CIH Bank branch. In the ever-competitive banking landscape, harnessing customer sentiment is paramount for service improvement, elevated satisfaction, and data-informed decisions

Python client for Apify API.

thousands of Python scrapers for store locator

Ask questions related to langchain course brought by Activeloop.