Web Scraper tool

Depreciated, replaced by individual repos that start with scrape- over at https://github.com/xtream1101?tab=repositories

Python web scraper to archive various sites
Developed using Python 3.4

Python Dependencies

• BeautifulSoup4
• pdfkit
• requests

System Dependencies

• wkhtmltopdf (Install)

Usage

• Config: Rename config.ini.sample to config.ini and edit to your needs

• Running: python main.py configFile

Supported Sites

• Wallhaven
• Hubble Images
• IT eEooks
• Tuebl
• IconFinder
• Find Icons (Currently does not work)
• xkcd
• xkcd's what if
• How Stuff Works
• Questionable Content