Roadmap 2022

[zhangyangyu]

This is TiBigData roadmap 2022.

It's under iterative edition and we welcome everyone to make advice.

Features

Flink

• Fast Lookup with PK & Secondary Indices
• Support Pre Split & Auto Random & Auto Increment when batch load
• Support Upsert & Delete DML
• Unified Batch & Streaming Processing
• Support Catalog
• Support External Connector Interface
• Support FDW integration and Cloud EMR integration
• Support Async Query
• SSL Support
• Telemetry

Spark (we'd like to merge TiSpark into TiBigData)

• Support Pre Split & Auto Random & Auto Increment when batch load
• Support Upsert & Delete DML
• Unified Batch & Streaming Processing
• Support Catalog
• Support External Connector Interface
• Support FDW integration and Cloud EMR integration
• Support Async Query
• SSL Support
• Telemetry

Quality

• Establish GA criteria

[humengyu2012]

What's the Async Query?

[sunxiaoguang]

What's the Async Query?

It's about using FDW to submit asynchronous query to Spark / Flink from TiDB directly.

[gbzy]

It's important to support tikv native writing, the writing speed is the bottleneck of flink batch job.

[sunxiaoguang]

It's important to support tikv native writing, the writing speed is the bottleneck of flink batch job.

This particular feature is what you want

• Support Upsert & Delete DML