Skip to content

onyxfish/fakerwiki

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FakerWiki

Fakerwiki is a library for local testing of Python ScraperWiki scripts. Mostly it’s just a copy of the ScraperWiki library with the database bits removed.

Usage

cd fakerwiki
mkvirtualenv --no-site-packages fakerwiki
pip install -r requirements.txt
python setup.py install
python your_script_name.py

You can also use ‘pip install fakerwiki’, but this obviously won’t build out your virtualenv with the standard scraperwiki packages from the requirements.txt in the repository.

What works?

scraperwiki.scrape()
scraperwiki.datastore.save()

What could be added easily?

scraperwiki.datastore.retrieve()
scraperwiki.datastore.fetch()
scraperwiki.metadata.save()
scraperwiki.metadata.get()
geocoding with dummy data
local caching of scraped pages

License

GPLv3 (same as ScraperWiki)

About

FakerWiki is a library for local testing of Python ScraperWiki scripts.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages