WHODIDIT: OpenStreetMap Changeset Analyzer
This tool downloads replication diffs from OSM Planet site, calculates statistics on changes and registers which 0.01-degree tiles were affected, and stores this in a MySQL database. A series of PHP scripts and a JS frontend are used to access that data.
You can check a working installation at https://simon04.dev.openstreetmap.org/whodidit/
Perl and system dependencies
You will need
libxml2 and the development headers:
apt-get install libxml2-dev
Install Perl dependencies
cpan DBIx::Simple LWP::Simple XML::LibXML::Reader Devel::Size
Make a directory outside www root (for example,
parse_osc.pl there. Then create mysql database with utf8 collation and grant a user
right to create and update tables there. After that, create database tables:
./parse_osc.pl -h <host> -d <database> -u <user> -p <password> -c -v
Add the script to crontab:
6 * * * * /home/?/whodidit/parse_osc.pl -h <host> -d <database> -u <user> -p <password> \ -l https://planet.openstreetmap.org/replication/hour/ \ -s /home/?/whodidit/state.txt -w /usr/local/bin/wget
Now each hour your database will be updated with fresh data. Note that the same osmChange file should not be processed twice: the database has no means of skipping already processed files.
Make a directory inside www root, for example,
/var/www/whodidit. Put all files
www directory in it. Then create another directory,
and put there all four PHP scripts from
Update the line
<script>var scripts = 'http://localhost/wdi/scripts/';</script> in
with the absolute URL of the directory you've put PHP files in. Then edit
db.inc.php script, updating
$frontend_url variable with the absolute path to
Then write your database parameters into
connect() function in
db.inc.php, and you're set.
What do scripts do?
parse_osc.pl: This script downloads and parses replication diffs, storing changeset information in a MySQL database. It can create tables (with
-cswitch). Run it without parameters to see a list of all possible options.
db.inc.php: Global settings for PHP scripts, also two useful functions (which can be updated in later versions, so be careful not to lose your settings -- sorry).
tiles.php: Queries the database for tiles in an area. Returns JSON with either error message (large areas and areas that have more than 1000 tiles are rejected) or all tiles with changeset numbers and other information.
changeset.php: Returns a JSON with detailed information for requested changeset ids. When called with
latest=1parameter, returns the latest changeset.
rss.php: As the title suggests, it generated an RSS feed with the latest changesets in a bbox.
index.html: The HTML page is a front-end to WDI infrastructure. It makes use of all PHP scripts and allows user to check WDI tiles and aquire RSS links.
The tool has been created by Ilya Zverev, licensed WTFPL, and has been modified/extended by Simon Legner. See https://github.com/simon04/whodidit/graphs/contributors for the full and detailed list of contributors. It internally uses OpenLayers, licensed BSD.