GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.
Sign up
Fetching latest commit…
| Type | Name | Latest commit message | Commit time |
|---|---|---|---|
| Failed to load latest commit information. | |||
|
roomscraper | ||
|
|
.gitignore | ||
|
|
LICENSE | ||
|
|
README.md | ||
|
|
requirements.txt | ||
|
|
scrapy.cfg | ||
Scapes all real estate listing photos for Houston, TX from Realtor.com. Because you never know when you might need five thousand photos of empty rooms.
To run your own crawl:
git clone https://github.com/mouse-reeve/roomscraper.git
cd roomscraper
virtualenv venv
source venv/bin/activate
pip install -r requirements.txt
scrapy crawl realtor -o test.json