CRAN v3.2.2
Bug fixes and stability enhancements
fcm()
computes the marginal frequency of upper-case tokens correctly (#2176).tokens_chunk()
keeps all the docid, including those of empty documents, in the original object.tokens_select()
recycles values when the length ofstartpos
orendpos
is less thanndoc(x)
.tokens_lookup()
anddfm_lookup()
can apply very large dictionaries (more than 100,000 keys).