Skip to content
This repository was archived by the owner on Nov 27, 2019. It is now read-only.

scraperwiki/file-upload-tool

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

84 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

File upload tool

This is a ScraperWiki tool for uploading spreadsheets of a predefined format, and automatically extracting information from them.

The tool uses filters to do the extraction. Filters are written in Python, and will probably use the xypath library for traversing grids of cells.

Developing a filter

Brief version:

If you're a third-party developer writing a new filter, please submit a pull request.

Currently only Python filters are supported. They should be self-contained Python files, stored in the filter directory.

Each filter should contain a main() function which accepts a single argument: a filename to extract (for example: /home/incoming/some_file.xls).

Filters should have unit tests, stored in filter/test.

Once you've completed your filter, make sure to list it, along with its human-readable name, in http/filters.json.

For more information about how filters should work, and how you can write and run unit tests for them, see filter/README.md.

About

A ScraperWiki tool for uploading spreadsheets of a predefined format

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 5