Skip to content
This repository has been archived by the owner on Sep 20, 2022. It is now read-only.

[HIVEMALL-122] Added tokenize_cn UDF #91

Merged
merged 4 commits into from Jul 1, 2017
Merged

[HIVEMALL-122] Added tokenize_cn UDF #91

merged 4 commits into from Jul 1, 2017

Commits on Jun 29, 2017

  1. Added tokenize_cn UDF, using org.apache.lucene.analysis.cn.smart.Smar… 

    …tChineseAnalyzer
    @partyyoung
    partyyoung committed Jun 29, 2017
    Configuration menu
    Copy the full SHA
    5eb8037 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2017

  1. Added usage of tokenize_cn

    @partyyoung
    partyyoung committed Jun 30, 2017
    Configuration menu
    Copy the full SHA
    1f81953 View commit details
    Browse the repository at this point in the history

  2. the user guide: sec <2.3.English/Japanese Text Tokenizer> be renamed … 

    …as <2.3.Text Tokenizer>
    @partyyoung
    partyyoung committed Jun 30, 2017
    Configuration menu
    Copy the full SHA
    e24c4fc View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2017

  1. fixed some typos about NLP module

    @partyyoung
    partyyoung committed Jul 1, 2017
    Configuration menu
    Copy the full SHA
    efc3a6d View commit details
    Browse the repository at this point in the history