v0.3.4

Adds token_class option to tokenization and propagates the param to diffengines

v0.3.3

• Adds word-level handling of apostrophes in wikitext_split.

v0.3.2

• Adds URL token to wikitext_split
• Adds CJK character splitting to wikitext_split

v0.3.1

v0.3.0 yields substantial performance improvements

This version fixes a critical bug in segment matcher that appears when match content is moved in such a way that LCS identifies the result of the move as an 'insert'.

v0.0.2

Includes the basic system structure, a wrapper around difflib.SequenceMatcher and a complete implementation of SegmentMatcher with an abstract Segmenter structure.