IMPORTANT! Please use conciliator instead, which does what refine_viaf does, plus more. This project is no longer being maintained.
refine_viaf implements a VIAF (Virtual International Authority File) Reconciliation Service for OpenRefine. This is used for resolving many types of names (ie. persons, organizations, geographic regions) to standard IDs representing those entities.
This project was rewritten in Java in Dec 2015. For more info, see this page. The old version written in Python is no longer being maintained, but can be found in the python-deprecated branch.
-
Support for the following types of names provided by VIAF: Corporate Names, Geographic Names, Personal Names, Works, Expressions
-
"Proxy mode" to retrieve IDs used by source institutions, instead of VIAF IDs. (NOTE: hyperlinks to source record pages in OpenRefine are supported for BNE, DNB, ICCU, JPG, LC, NDL, SELIBR, SUDOC, and WKP. Links are BROKEN for BNC, BNF, DBC, and NUKAT. For all other sources, the links will take you to the VIAF page.)
-
Good performance (uses threads; stable memory usage; caches results)
-
Super easy to run
If your needs are low and you can't or don't want to run this software yourself, you can use the public server at http://refine.codefork.com/. Visit that address for more instructions.
Install Java 1.7 or greater if you don't already have it.
Download the .jar file for the latest release. Alternatively, you can download the source code tarball or clone this repository, and build the .jar file using maven.
Run this command:
java -jar refine_viaf-1.5.2.jar
That's it! You should see some messages as the application starts up. Now you're ready to configure OpenRefine to use the service. When you're done with it, hit Ctrl-C to quit the application.
-
In OpenRefine, chose a column of names you want to reconcile, and select "Reconcile" and "Start Reconciling..." in the column pull-down menu.
-
Click "Add Standard Service..."
-
To reconcile against names from any VIAF source, type in:
http://localhost:8080/reconcile/viaf
To reconcile against a specific VIAF source, append its code to the end of the path. For example, to search only names from the Bibliothèque nationale de France, type in:
http://localhost:8080/reconcile/viaf/BNF
To retrieve the IDs used by source institutions, rather than VIAF IDs, use "proxy mode." For example, to search only names from the Library of Congress and retrieve their IDs, type in:
http://localhost:8080/reconcile/viafproxy/LC
-
Follow the instructions on the dialog box to start reconciling names.
To build from the source code, install maven and type:
mvn package
If you want to host this software on a server for long-term usage or
if you want to enable logging for debugging purposes, take a look at
run.sh
for some helpful options.
You can change several run-time options (including the service name
that appears in OpenRefine and turning caching on/off) by editing the
refine_viaf.properties
file.
Specification for the Reconciliation Service API:
https://github.com/OpenRefine/OpenRefine/wiki/Reconciliation-Service-Api
This code drew inspiration from these other projects:
If so, please take a few seconds to leave a comment on this page. Hearing from users really motivates me to continue improving this project.
This code is distributed under a GNU General Public License. See the file LICENSE for details.