Skip to content

Spider built with scrapy and ScrapySplash to crawl Airbnb listings

Notifications You must be signed in to change notification settings

diatche/airbnb-scraper

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

60 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

airbnb_scraper

Installation

Install MongoDB and run server locally.

Clone, then run:

python3 -m venv env
source ./env/bin/activate
./setup.sh

Usage

Run the spider with:

scrapy crawl airbnb \
    -a city="{cityname}" \
    -a currency="{code}" \
    -a price_min="{price_min}" \
    -a price_max="{price_max}" \
    -a instant_book={boolean} \
    -a room_type="{room_type_code}"

All options are optional except city.

Most Airbnb URL query options are also supported.

Example:

scrapy crawl airbnb \
    -a city="Auckland-CBD--Auckland--New-Zealand" \
    -a currency=NZD \
    -a instant_book=true \
    -a room_type="Entire home/apt"

Acknowledgements

Original source written by kailu3/airbnb-scraper.

About

Spider built with scrapy and ScrapySplash to crawl Airbnb listings

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 99.5%
  • Shell 0.5%