GitHub - CincyPy/webscraping-demo: A demonstration of web scraping with Beautiful Soup and requests

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commits
README.txt		README.txt
demo.py		demo.py

Repository files navigation

Web Scraping with Beautiful Soup

Installation:
Beautiful Soup: pip3 install beautifulsoup4
requests: pip3 install requests

Documentation:
https://www.crummy.com/software/BeautifulSoup/bs4/doc/

Strategy:
Pick a datasource (beware of terms of use barring scraping)
Determine the URL (for searches/paging)
Determine page structure and translate into code

To run the demo:
python3 demo.py