Adding tokenizer factory to reduce code duplication

[george-larionov]

Adding tokenizer factory to reduce code duplication in several places. A side effect of this change is that the 3 places where we use tokenizers (regular text index, bloom filter text index, and tokens function) now all use the same defaults and params checks. Before, the bloom filter text index allowed any value for ngram_length, while the other two allowed only values between 2 and 8. I decided to make the allowed values be between 1 and 8 for all, but this could be changed if needed.

Changelog category (leave one):

• Improvement

Changelog entry (a user-readable short description of the changes that goes into CHANGELOG.md):

Ngrams tokenizer can now be built with ngram_length = 1.

Documentation entry for user-facing changes

• Documentation is written (mandatory for new features)

[clickhouse-gh]

Workflow [PR], commit [c5de17c]

Summary: ❌

job_name	test_name	status	info	comment
Stateless tests (arm_asan, targeted)		failure
	02346_text_index_hits	FAIL	cidb
Integration tests (amd_tsan, 2/6)		failure
	test_storage_s3_queue/test_5.py::test_failed_startup	FAIL	cidb
BuzzHouse (amd_debug)		failure
	Logical error: Inconsistent AST formatting in A: the query:	FAIL	cidb

[rschu1ze]

Stateless tests (arm_asan, targeted)

• 02346_text_index_hits: timed out, unrelated, will make a fix for this separately

Integration tests (amd_tsan, 2/6)

• test_storage_s3_queue/test_5.py::test_failed_startup: test_storage_s3_queue/test_5.py::test_failed_startup is flaky #88918

BuzzHouse (amd_debug)

• Logical error: Inconsistent AST formatting in A: the query is unrelated (10+ open bugs exist)