Skip to content
This repository

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP

Python port of jspos, a port of the FastTag Part of Speech Tagger

branch: master

Fetching latest commit…

Octocat-spinner-32-eaf2f5

Cannot retrieve the latest commit at this time

Octocat-spinner-32 Lexer.py
Octocat-spinner-32 Lexicon.py
Octocat-spinner-32 POSTagger.py
Octocat-spinner-32 README
Octocat-spinner-32 TestPOSTagger.py
Octocat-spinner-32 license.txt
README
ABOUT:

pypos is a Python port of Percy Wegmann's Javascript port of Mark Watson's 
FastTag Part of Speech Tagger which was itself based on Eric Brill's trained 
rule set and English lexicon. 

pypos also includes a basic lexer that can be used to extract words and other
tokens from text strings.

jspos is available at http://code.google.com/p/jspos/

LICENSE:

pypos is licensed under the GNU LGPLv3

FILES:

Lexicon.py - Python version of Eric Brill's English lexicon
Lexer.py - Lexer to break a sentence into taggable tokens (e.g. words)
POSTagger.py - the Part of Speech tagger

You'll typically need to include all 3 files.

USAGE:

words 		= Lexer().lex("This is some sample text. This text can contain multiple sentences.")
taggedWords 	= POSTagger().tag(words)

for x in taggedWords:
	word = x[0]
	tag  = x[1]

ACKNOWLEDGEMENTS:

Thanks to Percy Wegmann for his Javascript port, jspos, of which this is a fairly direct copy.
Thanks to Mark Watson for writing FastTag, which served as the basis for jspos.

TAGS:

CC Coord Conjuncn           and,but,or
CD Cardinal number          one,two
DT Determiner               the,some
EX Existential there        there
FW Foreign Word             mon dieu
IN Preposition              of,in,by
JJ Adjective                big
JJR Adj., comparative       bigger
JJS Adj., superlative       biggest
LS List item marker         1,One
MD Modal                    can,should
NN Noun, sing. or mass      dog
NNP Proper noun, sing.      Edinburgh
NNPS Proper noun, plural    Smiths
NNS Noun, plural            dogs
POS Possessive ending       Õs
PDT Predeterminer           all, both
PP$ Possessive pronoun      my,oneÕs
PRP Personal pronoun         I,you,she
RB Adverb                   quickly
RBR Adverb, comparative     faster
RBS Adverb, superlative     fastest
RP Particle                 up,off
SYM Symbol                  +,%,&
TO ÒtoÓ                     to
UH Interjection             oh, oops
VB verb, base form          eat
VBD verb, past tense        ate
VBG verb, gerund            eating
VBN verb, past part         eaten
VBP Verb, present           eat
VBZ Verb, present           eats
WDT Wh-determiner           which,that
WP Wh pronoun               who,what
WP$ Possessive-Wh           whose
WRB Wh-adverb               how,where
, Comma                     ,
. Sent-final punct          . ! ?
: Mid-sent punct.           : ; Ñ
$ Dollar sign               $
# Pound sign                #
" quote                     "
( Left paren                (
) Right paren               )
Something went wrong with that request. Please try again.