Okscraper is a python module which helps standardize and simplify the scraping process of websites and documents.
Documentation: http://okscraper.readthedocs.org/
- If you are using django you should also check out okscraper-django which provides some django-specific features on top of okscraper.