README.md

Sentinel

This is the watcher that watches the watched and reports the reports to http://www.digipres.org

How it works

WARNING! This is outdated since we no longer use Travis!

Overall, this system works as follows:

• Every night, we launch a Travis CI job that:
  • Checks out the Jekyll source for digipres.org.
  • Updates copies of various data sources held elsewhere.
  • Analyses that data into aggregated forms.
  • Add this updated, aggregated data to the digipres.github.io sources and data folders.
  • Commits the changes to the digipres.org repository (which the causes the website to get updated)

There are a few different aggregation processes in place currently:

• The COPTR wiki is scanned to build version two of the POWRR Tool Grid.
• The COPTR and File Formats wikis user contributions are noted.
• Various format registries are brought together and presented so that they can be compared.

See README-registries.md to see how the format register aggregation works.

To Do

• Find ToDos in notes/code and put them here or in issues.
• Link to PRONOM itself.
• http://en.wikipedia.org/wiki/Alphabetical_list_of_filename_extensions_%28M%E2%80%93R%29
• http://www.webarchive.org.uk/aadda-discovery/formats?f[0]=content_type_ext:%22.bmp%22
• https://twitter.com/benfinoradin/status/532212803630039041

COPTR Bot

Talking to the wiki requires the 'pywikipedia' codebase which is installed here as a git submodule. See the pywikibot instructions for details: https://www.mediawiki.org/wiki/Manual:Pywikibot

Automated build and update process

travis env set GIT_NAME "Andrew Jackson"
travis env set GIT_EMAIL anj@anjackson.net
travis env set GH_TOKEN XXXXXX

See also password.enc etc.

http://docs.travis-ci.com/user/encrypting-files/

opf:foreg andy$ curl -u anjackson  -d '{"scopes":["public_repo"],"note":"CI: sentinel"}' https://api.github.com/authorizations
Enter host password for user 'anjackson':
{
  "id": 12861208,
  "url": "https://api.github.com/authorizations/12861208",
  "app": {
    "name": "CI: sentinel (API)",
    "url": "https://developer.github.com/v3/oauth_authorizations/",
    "client_id": "00000000000000000000"
  },
  "token": "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX",
  "note": "CI: sentinel",
  "note_url": null,
  "created_at": "2014-11-13T21:35:54Z",
  "updated_at": "2014-11-13T21:35:54Z",
  "scopes": [
    "public_repo"
  ]
}