Skip to content

Python scraper program for scraping airfare data from a website, saves results as json. Built with argparse, lxml, collections, json, requests

Notifications You must be signed in to change notification settings

ddanskin/python-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Airfare Scraper

This command line python program scrapes airfare prices for a round-trip flight from a given origin to a given destination with dates given for departure and return flights. This project was built for educational purposes only and would run into problems with large scale use, the most likely of which would be being blocked by the website.

To Use

Download the program. In the command line type python3 scraper.py (origin airport code) (destination airport code) (depart date MM/DD/YYYY) (return date MM/DD/YYYY)

scraper_preview

Result file will look like this: scrape_data_preview

Built with the following python packages

  • Requests
  • ArgParse
  • json
  • lxml
  • Collections

Acknowledgements

Special thanks to Scrape Hero and Hackernoon for providing excellent scraping tutorials

License

MIT © ddanskin

About

Python scraper program for scraping airfare data from a website, saves results as json. Built with argparse, lxml, collections, json, requests

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages