INFRA: Open rebase for large commit

[baibaichen]

What changes are proposed in this pull request?

This PR implements the proposal outlined in #11352

Here are guidelines:

1. We normally squash PRs when merging.
2. Rebase is only used for very large PRs—specifically, when adding support for a new Spark version, which must be split into three commits.

How was this patch tested?

Pass GHA

[baibaichen]

cc @zhouyuan @FelixYBW