EstateVision is a web scraping and data display project that scrapes real estate listings from sreality.cz and saves the data in a PostgreSQL database. A simple Flask server serves a webpage displaying the first 500 items from the database.
To run this project, you'll need Docker and Docker Compose installed on your system.
- Clone the repository to your local machine.
- Navigate to the project directory where the
compose.yamlfile is located. - Run the project using Docker Compose: docker-compose up
Docker will build the images and start the containers necessary for the Scrapy spider and Flask application.
Once the Docker containers are running, you can view the scraped data by visiting the following URL in your web browser: http://localhost:8080/
This page will display the first 500 scraped real estate listings with their titles and images.
app.py: Flask app to display scraped data.run_spider.py: Runs the Scrapy spider.sreality_spider.py: Scrapy spider for real estate listings.requirements.txt: Lists dependencies.Dockerfile: Instructions to build the app's Docker image.compose.yaml: Configures the app's services.