This automated tool implements 6 metrics about resolvability, parsability, and consistency of RDF resources, as described in the research manuscript: Automated Approach for Minimal Quality Assessment of RDF Resources for Reuse.
Run the following command to install dependencies with pip
installed:
pip install -r requirements.txt
Require Python 3.7 or later.
Two steps need to be performed to validate an RDF resource:
-
Edit
config.py
.- Decide the
ListOfLABEL
. ThisListOfLABEL
will be used to (a) locate the resource to be tested, (2) support the naming the assessment report and the directory for storing it. - Add {
LABEL
:Path of RDF resource
} toWhichResource
. You should set correctPath of RDF resource
so as to successfully load the test RDF resource. ThisPath of RDF resource
can be a URI, e.g.,'rdf': 'http://www.w3.org/1999/02/22-rdf-syntax-ns#'
, or a local path, e.g.,'rdf':'resources/foaf.rdf'
.
- Decide the
-
Run
$ python run_assessment.py
.- After running, a pickle file of storing the RDF graph for the target resource will be generated in the directory
pickle/{LABEL}_graph.pickle'
. Once created, the tool will directly load the pickle, reducing the parsing time. This is very useful for resources of large size. - After evaluation, four CSV files will be generated that contains URIs with labels indicating resolvability,
parsability, and consistency in the directory
output/{LABEL}/
; an assessment report will be generated in the directoryoutput/{LABEL}/report-{LABEL}.ttl
in the form of Turtle.
- After running, a pickle file of storing the RDF graph for the target resource will be generated in the directory
So far there has been two use cases:
- Evaluate 8 ontologies in RDF (see
test resources
file orListOfLabelsForConceptualPaper
inconfig.py
) - Evaluate 16 rare disease resources in RDF (see
ListOfLabelsForRareDiseaseResources
inconfig.py
)
If only assess these resources, you can assign ListOfLabelsForConceptualPaper
or
ListOfLabelsForRareDiseaseResources
to ListOfLABEL
.
If you want to further customise this tool to your own 'playground', it might be necessary to have following information.
There are four folders:
resources
: to store RDF resourcesmetrics
: contain scripts that implement metricsoutput
: to store assessment reports and data frames storing intermediate resultsfunctions
: contain scripts that implement some basic functions
The structure (and built-in functions) of assessment report is described in functions/generate_report.py
.
If you have any questions or problems in using this tool, please create Issues.