Abduction-based Discourse Processing System
This is a repository of the ISI metaphor project team, in which we store all the resources and tools constituting our natural language understanding system based on abductive reasoning, implemented for four languages:
The system is largely based on ideas summarized in [Hobbs, 1993].
Our abductive Natural Language Understanding pipeline is shown below.
Text fragments are given as input to the pipeline. The text fragments are parsed. For Russian and Spanish tagging, we use TreeTagger. For Farsi tagging, we use the Stanford NLP tagger. For parsing, we use the dependency parser Malt for Spanish, Russian, and Farsi. For English, the whole processing is performed by the Boxer semantic parser.
The parses are input to the module converting them into logical forms. A logical form (LF) is a conjunction of propositions, which have generalized eventuality arguments that can be used for showing relationships among the propositions. We use logical representations of natural language texts as described in [Hobbs, 1995]. For Spanish, Russian, and Farsi, we have developed logical form converters. For English, we use the LF converter built in the Boxer semantic parser.
Logical forms and a knowledge base are input to the abductive reasoner based on Integer Linear Programming [Inoue et al., 2012]. The reasoner produces flat first order logic interpretations in the textual format and proof graphs in the PDF format.
More details about each component can be found here.
Installation and running
- Clone Metaphor-ADP repository:
git clone https://github.com/isi-metaphor/metaphor-adp
- Build Docker image:
- Run Docker image:
- Run the system. See instructions
Note: If you prefer to run natively rather than using Docker, see instructions
- Linux or macOS
- at least 4 cores CPU
- at least 8GB RAM
Jonathan Gordon, Jerry R. Hobbs, Jonathan May, Michael Mohler, Fabrizio Morbini, Bryan Rink, Marc Tomlinson, and Suzanne Wertheim. 2015. A Corpus of Rich Metaphor Annotation. In Proceedings of the Third Workshop on Metaphor in NLP. Data
Jonathan Gordon, Jerry R. Hobbs, Jonathan May, and Fabrizio Morbini. 2015. High-Precision Abductive Mapping of Multilingual Metaphors. In Proceedings of the Third Workshop on Metaphor in NLP.
Naoya Inoue, Ekaterina Ovchinnikova, Kentaro Inui, and Jerry R. Hobbs. 2014. Weighted Abduction for Discourse Processing Based on Integer Linear Programming. In Sukthankar et al. (eds.): Plan, Activity, and Intent Recognition, pp. 33-55.
Ekaterina Ovchinnikova, Ross Israel, Suzanne Wertheim, Vladimir Zaytsev, Niloofar Montazeri, and Jerry R. Hobbs. 2014. Abductive Inference for Interpretation of Metaphors. In Proceedings of the ACL 2014 Workshop on Metaphor in NLP. Baltimore, MD.
Ekaterina Ovchinnikova, Niloofar Montazeri, Theodore Alexandrov, Jerry R. Hobbs, Michael C. McCord, and Rutu Mulkar-Mehta. 2013. Abductive Reasoning with a Large Knowledge Base for Discourse Processing. In Hunt, H., Bos, J. and Pulman, S. (eds.): Computing Meaning, vol. 4, pp. 104-24.
Ekaterina Ovchinnikova. 2012. Integration of World Knowledge for Natural Language Understanding. Atlantis Press, Springer.
Naoya Inoue, Ekaterina Ovchinnikova, Kentaro Inui, and Jerry R. Hobbs. 2012. Coreference Resolution with ILP-based Weighted Abduction. In Proceedings of COLING, pp.1291-1308.
Ekaterina Ovchinnikova, Niloofar Montazeri, Theodore Alexandrov, Jerry R. Hobbs, Michael C. McCord, and Rutu Mulkar-Mehta. 2011. Abductive Reasoning with a Large Knowledge Base for Discourse Processing. In Proceedings the 9th International Conference on Computational Semantics (IWCS'11), pp. 225-234.
This work was supported by the Intelligence Advanced Research Projects Activity (IARPA) via Department of Defense US Army Research Lab contract W911NF-12-C-0025. The US Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright annotation thereon. Disclaimer: The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of IARPA, DoD/ARL, or the US Government.