[Feature]: Support automatically generating and managing Tags and Branchs for Table

[zhoujinsong]

Description

Tags and branches are common concepts for managing multiple versions of data. Apache Iceberg has supported tags and branches since version 0.14, and the functionality has been improved in version 1.2.0. Using tags and branches can achieve more sophisticated management of snapshot lifecycles, addressing the following scenarios:

• Long-term Time Travel: fulfilling the audit needs of long-term historical data
• WAP (Write Audit Publish) writing: supporting audit the written data before formal publishing.

Use case/motivation

The Tag/Branch management functionality of Arctic is expected to provide the following capabilities on top of Iceberg:

• More user-friendly: including management of tags/branches on Web UI, automatic creation, and lifecycle management
• More accurate: correcting data on the branch, generating more precise tags (Iceberg can currently only generate imprecise tags/branches on discrete snapshots, and the accuracy depends on the granularity of the snapshot commits)
• More universal: supporting tags/branches on multiple table formats under Arctic.

Describe the solution

Refer to the documentation for detailed design.
https://docs.google.com/document/d/1_56YHZO7XSkkZV7bTFQ7yWNVfiV0TknwOIMt0j8Me6Y/edit?usp=sharing

Subtasks

• [Subtask]: Store max transaction id on the snapshot level for Mixed Format Table #1720
• [Subtask]: Expire snapshots and orphan files clean handle the Iceberg statistic files #1722
• [Subtask]: Automatically create tags on snapshots daily for Iceberg Format Table #1723
• [Subtask]: Display Tags and Branches on the Transactions page #2034
• [Subtask]: Support Http interface for Tags and Branches #2145
• [Subtask]: [Dashboard] Support filters of Snapshots page for table #2198
• [Subtask]: Automatically create tags on snapshots hour-level for iceberg Table Formats #2257
• [Subtask]: Automatically delete expired iceberg Table tag and branch #2412

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct