Skip to content

textrecipes 0.2.0

Choose a tag to compare

@EmilHvitfeldt EmilHvitfeldt released this 14 Apr 17:50
  • step_tokenize() got an engine argument to specify packages other then tokenizers to tokenize.
  • spacyr have been added as an engine to step_tokenize().
  • step_lemma() has been added to extract lemma attribute from tokenlists.
  • step_pos_filter() has been added to allow filtering of tokens bases on their pat of speech tags.
  • step_ngram() has been added to generate ngrams from tokenlists.
  • step_stem() not correctly uses the options argument. (Thanks to @grayskripko for finding bug, #64)