CKAN plugin for the automatic extraction of data sources
Branch: master
Clone or download
Pull request Compare This branch is even with unaguil:master.
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
ckanext
examples/justizianet_crawler
.gitignore
MANIFEST.in
README.md
setup.py

README.md

ckanext-extractor

Plugin for automatic extraction of data sources.

Tested with CKAN 1.8

Installation

Install plugin

python setup.py install

Update CKAN development.ini file to load the plugin

ckan.plugins = stats extractor

Initialize new tables on CKAN database (Change user & pass)

python ckanext/extractor/model/initDB.py

Apply patch to CKAN code for adding periodic task support to paster launcher

Copy patch content from https://gist.github.com/4547407 to a file named beat_support.patch and execute next line on CKAN source directory

git apply beat_support.patch

Celery task queue initialization This plugin uses Celery (http://celeryproject.org/) for task queueing.

Start the CKAN instance

paster serve development.ini

Start the Celery server

paster celeryd run beat