Release-0.5.0 Roadmap

[Aireed]

We will release the issue in 0.5.0

Feature Development

• [Feature]: Support Spark 3.3 for Mixed format #261
• [Feature]: Support Spark 3.2 for Mixed format #1383
• [Feature]: Support MOR with Flink Engine in runtime batch mode for Mixed format #5
• [Feature]: Support Iceberg on S3 or other non-hadoop storage system. #1476
• [Feature]: Add self-optimizing detail in optimized tab of table  #1535
• [Feature]: Support to manage optimizer groups in dashboard #1537
• [Feature]: Remove the Independent DeleteFiles for the Iceberg Format Table #1628
• [Feature]: Support lookup join on Mixed format tables with Flink #1322
• [Subtask]: Make AMS as an Iceberg Catalog provider via implement RestCatalogAPI #1339

Improvement

• [Improvement]: AMS module refactoring in 0.5 #1372
• [Improvement]: Add new task allocation rules to make the number of concurrency and read cost more balanced #1311
• [Improvement]: Improve query speed for Mixed tables in Spark #1349
• [Spark][Improvement]: Add scala code style check for spark module #1059
• [Improvement][Spark]: Speed up commit process for Mixed Hive format tables #1350
• [Subtask]: Introdue the concept of the InternalCatalog and ExternalCatalog #1544

Bug Tracking

• [Bug]: The position-delete written by iceberg directly through the base table cannot take effect when read by Arctic #1347
• [Bug]: When AMS is deployed HA, use Kerberos to access non-Kerberos zookeeper will throw an exception #1346
• [Bug]: High CPU occupancy of AMS #1332
• [Bug]: jacoco-maven-plugin report EOFException in Flink Module CI #1330
• [Bug]:[Spark] select failed after update on keyed table for kerberos auth failed.  #488
• [Bug]: The column ‘_transaction_id’ and '_change_action' will be null when querying change table with spark #1385
• [Bug]: Hive function can't be used when using ArcticSparkSessionCatalog under spark 3.3 #1397
• [Bug]: Find duplicate records when enable rocksdb map #1751
• [Bug]: when partition value contains spaces, optimize can't process correctly #1653
• [Bug]: Build failed when change hadoop version to 3.2.1 #1646

Document Improvement

• [Improvement]: Optimize the description of Spark CreateTableLike #1340
• [Improvement]: Improve the project documentation #1510