Skip to content
Relational NLP: Convert text into relational facts.
Python Makefile
Branch: master
Clone or download
hayesall ⚗️ Bump version for development on master
Bump `__version__`: `0.3.2` -> `0.3.3.dev`
Latest commit 10ecea4 Aug 11, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
documentation
example_files
rnlp
.gitignore
.travis.yml
LICENSE
Makefile
README.rst
requirements.txt
setup.cfg
setup.py

README.rst

rnlp

Python Package Index (PyPi) latest version. License. Master branch build status. Master branch code coverage. Documentation build status and link to documentation.

Relational NLP Preprocessing (rnlp): A Python package and tool for converting text into a set of relational facts.

Installation

Stable builds on PyPi

pip install rnlp

Quick-Start

rnlp can be used either as a command line interface (CLI) tool or as an imported Python Package.

CLI Imported
$ python -m rnlp -f example_files/doi.txt
Reading corpus from file(s)...
Creating background file...
100%|████████| 18/18 [00:00<00:00, 38it/s]
from rnlp.corpus import declaration
import rnlp

doi = declaration()
rnlp.converter(doi)

The relations created by rnlp include the following:

  • Sentence's Relative Position in Block:
    • earlySentenceInBlock: Sentence occurs within the first third of a block.
    • midWaySentenceInBlock: Sentence occurs between the first third and the last third of a block's length.
    • lateSentenceInBlock: Sentence occurs within the last third of a block's length.
  • Word's Relative Position in Sentence:
    • earlyWordInSentence: Word occurs within the first third of a sentence.
    • midWayWordInSentence: Word occurs between a third and two-thirds of a sentence.
    • lateWordInSentence: Word occurs within the last third of a sentence.
  • Relative Position Between Items:
    • nextWordInSentence: Pointer from a word to its neighbor.
    • nextSentenceInBlock: Pointer from a sentence to its neighbor.
  • Existential Semantics:
    • sentenceInBlock: Sentence occurs in a particular block.
    • wordInSentence: Word occurs in a particular sentence.
  • Low-Level Information about words:
    • wordString: A string representation of a word.
    • partOfSpeechTag: The word's part of speech (as determined by the nltk part-of-speech tagger).

---

Files contain a toy corpus (example files/) and an image of a BoostSRL tree for predicting if a word in a sentence is the word "you".

https://raw.githubusercontent.com/hayesall/rnlp/master/documentation/img/output.png

The tree says that if the word string contained in word 'b' is "you" then 'b' is the word "you" with a high probability. (This is of course true). A more interesting inference is the False branch that says that if word 'b' is an early word in sentence 'a' and word 'anon12035' is also an early word in sentence 'a' and if the word string contained in word 'anon12035' is "Thank", then the word 'b' has decent chance of being the word "you". (The model was able to learn that the word "you" often occurs with the word "Thank" in the same sentence when "Thank" appears early in that sentence).

You can’t perform that action at this time.