This a module to extract RDF from an HTML5 page annotated with microdata. The module implements the algorithm defined and published by the W3C Semantic Web Interest Group task force, in March 2012. The module can be used to produce serialized versions of the extracted graph, or simply an RDFLib Graph Object.
HTML Python CSS JavaScript
Latest commit 8092180 Dec 15, 2016 @iherman iherman no message


pyMicrodata distiller/parser library. The distribution contains:

  • ./pyMicrodata: the Python library. You should copy the directory somewhere into your PYTHONPATH. Alternatively, you can also run the

    python install

    script in the directory.

  • ./scripts/ can be used as a CGI script to invoke the library. It has to be adapted to the local server setup, namely in setting the right paths

  • ./scripts/ script that can be run locally on to transform a file into RDF (on the standard output). Run the script with "-h" to get the available flags.

  • ./Doc-pyMicrodata: (epydoc) documentation of the classes and functions

  • ./generatePyMicrodataDoc: a shell script to generate the documentation (using epydoc)

  • ./epydoc.css: the CSS file the documentation generation uses (it is then copied to the documentation area itself)

The package primarily depends on:

  • RDFLib Version 3.2.0 or higher is strongly recommended.
  • html5lib (in the additional packages folder)
  • several details or simply a more complete serialization depends on the pyrdfa3 package on github: Although the basic RDF conversion works without this, some serializations may not be available and the vocabulary expansion mechanism would not work either.

The package has been tested on Python version 2.4 and higher. Python 2.7 is strongly recommended. The package has been adapted to Python 3, though not yet thoroughly tested, because html5lib does not have yet a Python 3 version.

For the details on the conversion of Microdata to RDF, see:

Release notes (starting from version 1.0)

  • this is the first fully released version

  • Version 2.0: adapted to the new version of the microdata->RDF note. Differences, and its effect on the code, are:

    • The content of the registry is greatly reduced, see Appendix C
    • Remove the vocab expansion flag (although probably wise to keep it on the top, entry level, and just remove it from the real processing, to avoid backward compatibility issues for deployed code