doc: add description about none

mroonga · Sep 27, 2018 · de367d2 · de367d2
1 parent ea5b720
commit de367d2
Showing 1 changed file with 5 additions and 0 deletions.
diff --git a/doc/source/tutorial/storage.rst b/doc/source/tutorial/storage.rst
@@ -128,6 +128,11 @@ You can specify one of the following values as the tokenizer. "tokenizer" in Mro
        ``content`` as is. For example, this value is used for prefix
        search.
 
+   * - ``none``
+     - .. versionadded:: 8.07 It does not tokenize at all. Use
+       ``none`` if you want to treat ``content`` as is. For example,
+       this value is used for prefix search.
+
    * - ``TokenBigram``
      - It tokenises in bigram. But continuous alphabets, numbers or
        symbols are treated as a token. So there can exist tokes with 3