GooglePlayStore Crawler

Crawler to collect tweets and favorites of any user.

A web crawler that is easy to use and follows politeness policies.

Web crawler for emails

A python-based web scraper/snapshot tool.

[Project] Capstone Design - Spam Detection

A Crawler that mines all the collections of products and its information from webstores created on Cafe24 platform.

Automatic IMDB movies, ratings, and reviews crawler

Web scrapers for instagram, XHS and investor contacts

A simple web crawler bot written in Python that retrieves and saves the HTML content of a specified webpage.

Scraping famous movies and actors from wiki page with BeautifulSoup and flask for providiing APIs

This is a project to crawl information about facial cleansers at Hasaki with the aim of analyzing and extracting data

Python crawler - implementing Google and Bing browsers

This repo contains web-crawling scripts

This is for beginner reptile beginners, there are a few simple but challenging projects

Crawler that checks for available appointments and sends Telegram notification in case of earlier available appointment

This Python script is a multi-threaded tool for retrieving data from the CommonCrawl index. It allows you to specify a domain or a list of domains, and it will retrieve all URLs associated with those domains that are indexed by CommonCrawl.

Learning resources for beginners to learn how to create web crawlers (spiders) in Python

Ice Breaker is comprehensive fullstack app leveraging generative AI and LangChain to find LinkedIn profiles and generate engaging ice breakers. LangChain ReAct agents ensure accurate URL retrieval and JSON cleaning, identifying a summary, facts, topics, and ice breakers. The frontend is built with HTML/CSS, and Flask powers the backend development.