ChinaStemmingTokenizer

[BadDeveloper2022]

`<?php
namespace VFou\Search\Tokenizers;
use Lizhichao\Word\VicWord;
class ChinaStemmingTokenizer implements TokenizerInterface
{
public static function tokenize($data)
{

    $fc = new VicWord();
    return array_map(function ($value) use ($fc) {
        $arr = $fc->getAutoWord($value);
        $newItems = [];
        foreach ($arr as $key => $val) {
            $newItems[] = $val[0];
        }
        return $newItems;
    }, $data);
}

}
`
https://github.com/lizhichao/VicWord
composer require lizhichao/word

---

The Chinese word segmentation database has no problem with word segmentation.
But when searching, a list that should not appear appears.