FakerWiki is a library for local testing of Python ScraperWiki scripts.
Python
Latest commit bb98b7f Sep 9, 2011 Christopher Groskopf Merge pull request #2 from bymerej/master
fixed URL for scraperwiki
Permalink
Failed to load latest commit information.
scraperwiki Initial import. Oct 27, 2010
.gitignore Updated gitignore for dist stuff. Oct 27, 2010
README.textile Fix URL for scaperwiki. Sep 8, 2011
requirements.txt Initial import. Oct 27, 2010
setup.py Updated setup.py. Oct 27, 2010

README.textile

FakerWiki

Fakerwiki is a library for local testing of Python ScraperWiki scripts. Mostly it’s just a copy of the ScraperWiki library with the database bits removed.

Usage

cd fakerwiki
mkvirtualenv --no-site-packages fakerwiki
pip install -r requirements.txt
python setup.py install
python your_script_name.py

You can also use ‘pip install fakerwiki’, but this obviously won’t build out your virtualenv with the standard scraperwiki packages from the requirements.txt in the repository.

What works?

scraperwiki.scrape()
scraperwiki.datastore.save()

What could be added easily?

scraperwiki.datastore.retrieve()
scraperwiki.datastore.fetch()
scraperwiki.metadata.save()
scraperwiki.metadata.get()
geocoding with dummy data
local caching of scraped pages

License

GPLv3 (same as ScraperWiki)