Text Annotation Service

Luis Rei luis.rei@ijs.si @lmrei

Introduction

Annotator for text documents.

A tornado-powered web service with a zmq powered backend.

Prelude

License

For the Licecnse see LICENSE.md (MIT). External tools are under their own licenses (obviously) and are not distributed here.

Project, Evaluation and Corpora

Twitter Annotator was built for the xLiMe project.

The sentiment classifier built and trained for SYMPHONY.

For Project evaluation metrics see the EVALUATION.md file.

List of Corpora:

* The [xLiMe Twitter Corpus](https://github.com/lrei/xlime_twitter_corpus).
* [Ritter Twitter Corpus](https://github.com/aritter/twitter_nlp)
* [SemEval 2014 Task 9](http://alt.qcri.org/semeval2014/task9/)
* [TASS 2015](http://www.sngularmeaning.team/TASS2015/tass2015.php)

Install

    git clone git@github.com:lrei/twitter_annotator.git
    cd twitter_annotator
    pip install -r requirements.txt
    chmod +x annotator.py
    chmod +x annotatorservice.py
    chmod +x sgd.py

External Dependencies

NOTE: you need to setup the models in the same directory (or change settings).

Normalization

python -c "import nltk; nltk.download('stopwords')"

NER

NER requires Java 8 and Stanford NER as well as models for each language. See the tree section below. Unzip models and tool to their respective directories.

POS

POS requires Java 8 and Stanford POS Tagger as well as models for each language. See the tree section below.

python -c "import nltk; nltk.download('universal_tagset')"

Unzip models and tool to their respective directories.

Sentiment

The models for sentiment are available for download here

To extract:

    tar -jxf senti_model.tar.bz2

Components

Twitter Annotator (main service)

Running the Service

Type

```
./annotator.py --help
```

To see the options. E.g

```
./annotator.py --port 1984 --n_jobs 10
```

To terminate:

```
kill -s INT <pid>
```

Test Client

This is a very basic client that can serve as an example of how to write an annotator client or it can be used to test if it's working.

Pass the port number where the annotator service is running

```
./test_client.py [PORT]
```

Press CTRL-C to quit. the test client

Text Classifier (sgd.py)

Running as a pipe:

```
chmod +x sgd.py
cat test.txt | ./sgd.py --model models/model_file --preprocess > result.txt
```

Where test.txt is line-delimited text

Running as a zmq service

Using Library

```
clf = sgd.load('model_file')
sgd.classify(clf, text, preprocess=True)
```

Train

To train and Test, files should be headerless TSV files with

col[0] = tokenized text
col[1] = class value