nalaf - (Na)tural (La)nguage (F)ramework
nalaf is a NLP framework written in python. The goal is to be a general-purpose module-based and easy-to-use framework for common text mining tasks. At the moment two tasks are covered: named-entity recognition (NER) and relationship extraction. These modules support both training and annotating. Associated to these, helper components such as cross-validation training or reading and conversion from different corpora formats are given. At the moment, NER is implemented with Conditional Random Fields (CRFs) and relationship extraction with Support Vector Machines (SVMs) using either linear or tree kernels.
Historically, the framework started from 2 joint theses at Rostlab at Technische Universität München with a focus on bioinformatics / BioNLP. Concretely the first goal was to do extraction of NL mutation mentions. Soon after another master's thesis used and generalized the framework to do relationship extraction of transcription factors (TF) interacting with gene or gene products. The nalaf framework is planned to be used in other BioNLP tasks at Rostlab.
As a result of the original BioNLP focus, some parts of the code are tailored to the biomedical domain. However, current efforts are underway to generalize all parts and this process is almost done. Development is not active and code maintenance is not guaranteed.
Current maintainer: Juan Miguel Cejuela (@juanmirocks).
(editable version on Lucidchart of the pipeline diagram; requires log in)
- Requires Python 3 (>= 3.5)
pip3 install nalaf python3 -m nalaf.download_data
git clone https://github.com/Rostlab/nalaf.git cd nalaf python3 setup.py install python3 -m nalaf.download_data
python3 setup.py nosetests -a '!slow' # Exclude the slow ones
HOWTO Run, Examples
example_annotate.py for a simple example of annotation with a pre-trained NER model for protein names extraction:
python3 example_annotate.py -p 15878741 12625412
python3 example_annotate.py -s "This is c.A1003G an example"# see issue https://github.com/Rostlab/nalaf/issues/159
python3 example_annotate.py -d resources/example.txt# see issue https://github.com/Rostlab/nalaf/issues/159