Ytsaurus table engine and table function.

[MikhailBurdukov]

https://ytsaurus.tech/ is an open source big data platform for distributed storage and processing.
It's already using a technology called CHYT (ClickHouse over YT) which helps to process data quickly, however it's not a fully featured ClickHouse cluster.

Examples:

Table engine

CREATE TABLE test( `a` UInt32, `b` String) ENGINE = Ytsaurus('http://localhost:8000', '//tmp/test', 'password')

SELECT * FROM test;
   ┌──a─┬─b──┐
1. │ 10 │ 20 │
   └────┴────┘

Table Function

SELECT *
FROM ytsaurus('http://localhost:8000', '//tmp/test', 'password', '`a` UInt32, `b` String')

Query id: 0d3fb990-1862-49ef-8424-e5d5186c80b4

   ┌──a─┬─b──┐
1. │ 10 │ 20 │
   └────┴────┘

Technical comment:
By now integration with ytsaurus cluster built over http protocol. Description: https://ytsaurus.tech/docs/en/user-guide/proxy/http-reference

Resolves : #60879

Changelog category (leave one):

• Experimental Feature

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Ytsaurus table engine and table function.

Documentation entry for user-facing changes

• Documentation is written (mandatory for new features)

[clickhouse-gh]

Workflow [PR], commit [8e85c1b]

[nikitamikhaylov]

Should it be YTsaurus with capital T? https://ytsaurus.tech/

[MikhailBurdukov]

@kssenii
Hi! Can I get ci approval? After adding the docs manual approve is required.

[clickhouse-gh]

Dear @kssenii, this PR hasn't been updated for a while. You will be unassigned. Will you continue working on it? If so, please feel free to reassign yourself.

[MikhailBurdukov]

@kssenii
Hi! I also made implementation of YTsaurus dictionary source. Is it okey for you to review all together or better to make a separate PR?

[kssenii]

@kssenii
Hi! I also made implementation of YTsaurus dictionary source. Is it okey for you to review all together or better to make a separate PR?

Hi, it is ok if you push it in this PR and I will review together. I am on vacation for two more weeks and after will review. Sorry for the long wait.

[MikhailBurdukov]

@kssenii Hi! Could you run the CI and review changes, pls?

[MikhailBurdukov]

@kssenii @pamarcos ping 🙏

[kssenii]

Please add a description for this setting as well

[kssenii]

Suggested change

	, log(getLogger(" (" + table_id_.table_name + ")"))
	, log(getLogger("StorageYTsaurus(" + table_id_.getFullTableName() + ")"))

[MikhailBurdukov]

@kssenii
Should we restart the CI? Failures for me looks unrelated:
failure Run server init.d 0.35 13:40:40
Error response from daemon: No such container: d257d96c238723e0ed7b49339402aee146799c2c1ce1042d13491b0c753508b9

[kssenii]

Sorry I was late and there is again a conflict... So let's just resolve it and checks will rerun.

[MikhailBurdukov]

@kssenii Pinging to merge before new conflicts in theSettingsChangesHistory.cpp 😁😁

[kssenii]

I am too late again 😢

[MikhailBurdukov]

Ci is not running(

[pamarcos]

Ci is not running(

There was a conflict. I fixed it in acadc07 and approved the workflow to run

[MikhailBurdukov]

Lets merge?

[kssenii]

Just resolved conflicts in private synchronization PR, need to wait now for tests to finish there