The Sentinel watches various data source and updates digipres.org
Python Shell
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
digipres.github.io @ 6beb185
initial-upload
projections
pywikibot @ 58d30bc
.gitignore
.gitmodules
.project
.pydevproject
.travis.yml
LICENSE
README-registries.md
README.md
aggregates.py
deploy.sh
passwordfile.enc
update.sh
user-config.py

README.md

Sentinel

Build Status

This is the watcher that watches the watched and reports the reports to http://www.digipres.org

How it works

Overall, this system works as follows:

  • Every night, we launch a Travis CI job that:
    • Checks out the Jekyll source for digipres.org.
    • Updates copies of various data sources held elsewhere.
    • Analyses that data into aggregated forms.
    • Add this updated, aggregated data to the digipres.github.io sources and data folders.
    • Commits the changes to the digipres.org repository (which the causes the website to get updated)

There are a few different aggregation processes in place currently:

See README-registries.md to see how the format register aggregation works.

To Do

COPTR Bot

Talking to the wiki requires the 'pywikipedia' codebase which is installed here as a git submodule. See the pywikibot instructions for details: https://www.mediawiki.org/wiki/Manual:Pywikibot

Automated build and update process

travis env set GIT_NAME "Andrew Jackson"
travis env set GIT_EMAIL anj@anjackson.net
travis env set GH_TOKEN XXXXXX

See also password.enc etc.

http://docs.travis-ci.com/user/encrypting-files/

opf:foreg andy$ curl -u anjackson -d '{"scopes":["public_repo"],"note":"CI: sentinel"}' https://api.github.com/authorizations Enter host password for user 'anjackson': { "id": 12861208, "url": "https://api.github.com/authorizations/12861208", "app": { "name": "CI: sentinel (API)", "url": "https://developer.github.com/v3/oauth_authorizations/", "client_id": "00000000000000000000" }, "token": "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX", "note": "CI: sentinel", "note_url": null, "created_at": "2014-11-13T21:35:54Z", "updated_at": "2014-11-13T21:35:54Z", "scopes": [ "public_repo" ] }