Aggressive Tokenizer from nodenatural/natural
JavaScript
Switch branches/tags
Nothing to show
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
.gitignore
History.md
Makefile
Readme.md
component.json
index.js

Readme.md

aggressive-tokenizer

Aggressive tokenizer (from node-natural)

Installation

$ component install danzajdband/aggressive-tokenizer

Usage

var tokenizer = require('aggressive-tokenizer');

tokenizer.tokenize('viva la pepa    ');
  //['viva', 'la', 'pepa']

API

AggresiveTokenizer#trim

AggresiveTokenizer#tokenize

License

MIT