Accessible Universal Diagrams through Language.
A Web-based Natural Language Interface (NLI) to semantically-enhanced diagrams in RDF/OWL format.
Built with Flask, NLTK, the Stanford Parser, and RDFLib. Code for initial Natural Language Processing (NLP) and dialogue handling derived from FREyA.
This repository contains the research Web application prototype employed for the evaluation of a NLI to diagrams as an advanced alternative to traditional accessible diagram counterparts such as tactile and tabular graphics.
The block diagram above outlines the most relevant components of the proposed framework of NLI to graphics that AUDiaL belongs to. Namely:
- A formal mapping of visualization semantics from graphic primitives to ontological resources
- Semantically-enhanced vector graphics, which can be authored using our Semantic Annotator for Inkscape (SAI)
- Ontologically-supported NLP that maps phrases found within a user's query in natural language to Semantic Concepts found in a semantically-enhanced diagram
- Domain-dependant task handling on semantically-enhanced diagrams
- User-specific annotation techniques allowing for partial compensation for the loss of cognitive benefits derived from the lack of sight
- Output of task result to the user in natural language
- An accessible Web-based User Interface allowing blind users to access the prototype in an efficient manner
In-depth information about AUDiaL and its general framework can be found in the docs directory of this repository.
Please follow the installation instructions.
-
Run locally:
python path/to/project/__init__.py- Visit
127.0.0.1:54634
-
Debug with PyDev:
python "path\to\pydev\pydevd.py" --multiproc --qt-support=auto --client 127.0.0.1 --port 54634 --file path/to/project/__init__.py