A Platform designed to track different products on the biggest Ecommerce in MENA region

This is a hobby project. It helps me to decide if i should open crate or sell it.

El proyecto consiste en la recopilación de información de documentos descalificados de páginas web como la CIA, Mossad y la NSA.

Web search engine for the SM Caen soccer club

Batyr is a web application that can be used to improve listening skills.

A Django project with Scrapy. Help you to get sources more conveniently.

scrapy app of python for learning

사용자 위치 기반 편의시설 위치 및 정보 제공 / 각종 커뮤니티 글 모아보기 기능

Scrape salaries from Glassdoor, store them in AWS DynamoDB and visual analysis with plotly's Dash

Dados sobre clubes e jogadores do campeonato brasileiro de futebol das séries A e B da temporada 2023.

Web-Application, which shows information about the product from online stores. Built with Django and Scrapy!

Uso de scrapy para integración con Drupal

Scrapyd Dashboard

Real Estate Rental Info Data Collector

IMDb crawler - Scrapy, MongoDB, Docker, Flask

项目整体分为scrapy-redis分布式爬虫爬取数据、基于ElasticSearch数据检索和前端界面展示三大模块。做此项目是为了熟悉scrapy-redis的基本流程，以及其背后的原理，同时熟悉ElasticSearch的使用。本项目可以作为一个基于ES存储的简单但是相对全面的全栈开发的Demo。项目中所采用的组件均在win10本地环境搭建（伪分布），旨在演示项目流程。你可以参考该项目，并将其扩展到多个主机上，实现分布式ES以及分布式Scrapy。

Scrapinghub Learning Center. Report issues in Jira: Report issues in Jira: https://scrapinghub.atlassian.net/projects/WEB

Dynamic configurable crawl (动态可配置化爬虫)