Skip to content
This repository has been archived by the owner on Jul 24, 2020. It is now read-only.

Harwood/PropertyScraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

PropertyScraper

asciicast

Description

Displays rental information for a given Airbnb listing url.

For usage run:

./property_scraper.py --help

Findings are stored in an SQLite database table listings with the following columns.

  • url
  • name
  • market,
  • score),
  • review_count
  • type
  • bed
  • bath
  • guest
  • price
  • photo_url
  • description
  • amenities (CSV)

NOTE: It appears Airbnb will throttle results. If this occurs a warning will be printed to stderr and the scraper will quit.

Usage

Requires Python 3

./property_scraper.py "https://www.airbnb.co.uk/rooms/14531512"
./property_scraper.py urls.txt
echo "https://www.airbnb.co.uk/rooms/14531512" | ./property_scraper.py -

Future Improvements

  • CLI flags
  • Database storage
  • Handle mutiple urls
  • Add requirements.txt
  • Proper testing
  • Implement with different libraries and languages to explore performance variations
  • Create Slack bot

Releases

No releases published

Packages

No packages published

Languages