Skip to content

Commit

Permalink
fix docs
Browse files Browse the repository at this point in the history
  • Loading branch information
PSeitz committed Nov 18, 2019
1 parent a2df513 commit 7031cd7
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/tokenize.rs
Expand Up @@ -2,7 +2,7 @@
//!
//! `'en', 'ja', 'englishNumeral', 'japaneseNumeral','englishPunctuation', 'japanesePunctuation','kanji', 'hiragana', 'katakana', 'space', 'other'`.
//!
//! If `{ compact: true }` then many same-language tokens are combined (spaces + text, kanji + kana, numeral + punctuation).
//! If `compact` true then many same-language tokens are combined (spaces + text, kanji + kana, numeral + punctuation).
//! `tokenize_detailed` returns an array containing `{ type, value }` instead of `'value'`
//! # Example
//! ```
Expand Down

0 comments on commit 7031cd7

Please sign in to comment.