Remove Normalization From Clickhouse

[jbfbell]

We will not be migrating Clickhouse to Destinations V2 at this time, instead we will remove normalization and update the raw table format

• Remove Normalization option and normalization container
• Implement New Raw Table Format w/o migrator
• Add Breaking change window of 3 months
• Update connector docs

[mattdavenport]

@jbfbell We are currently evaluating Airbyte+Clickhouse for a BI platform. Just so I'm clear, this task would effectively remove the method by which data is moved from a source to our Clickhouse destination into actual columns (normalization), and at that point Airbyte would only support inserting raw JSON blobs from sources into the Clickhouse destination?

[jbfbell]

@mattdavenport you are correct, we will update Clickhouse to use the new Destination V2 Raw Table Format (the table with a JSON blob of the record data).

Airbyte will continue to support custom DBT transformations via DBT cloud which might be a good alternative to normalization

[jbfbell]

Potentially could have issues:

• not required to upgrade CDK, but might make our lives easier
• updating to the new CDK version could also make our lives harder

[MaxMusing]

@jbfbell are there any plans to migrate ClickHouse to Destinations V2? Or rough estimate in how much work it would take? Normalization for ClickHouse would be greatly appreciated 🙏

Edit: found this discussion.