refactor: Remove not used classes from org.apache.hudi.spark.internal

[geserdugarov]

Describe the issue this Pull Request addresses

#2328 added support of bulk insert using DSv2 for Spark 3.0 at 2020.

Later #8076 added support of bulk insert for insert overwrite (table) by

String targetFormat;
targetFormat = "org.apache.hudi.spark3.internal";
records.write().format(targetFormat)
    .option(DataSourceInternalWriterHelper.INSTANT_TIME_OPT_KEY, instantTime)
    .options(opts)
    .options(customOpts)
    .options(optsOverrides)
    .mode(SaveMode.Append)
    .save();

in DatasetBulkInsertCommitActionExecutor, which calls org.apache.hudi.spark3.internal.DefaultSource.

#13301 moved the code from hudi-spark3-common to hudi-spark-common module.

And then #13360 unified code paths, and switched bulk insert to call of HoodieDatasetBulkInsertHelper::bulkInsert without call of org.apache.hudi.spark.internal.

So, there is no internal calls of org.apache.hudi.spark.internal classes anymore. And all the following pack of classes could be removed:

Summary and Changelog

Removes classes in org.apache.hudi.spark.internal that are not used anymore.

Impact

No impact. First, they are named as internal. Second, there is no .../META-INF/services/org.apache.spark.sql.sources.DataSourceRegister files, which calls org.apache.hudi.spark.internal.*. This means that users couldn't call those classes.

Risk Level

None

Documentation Update

None

Contributor's checklist

• Read through contributor's guide
• Enough context is provided in the sections above
• Adequate tests were added if applicable

[geserdugarov]

test-hudi-trino-plugin pipeline failed due to not related issue:

TestHudiMinioConnectorSmokeTest>AbstractTestQueryFramework.init:119->createQueryRunner:33 » 
IllegalState Previous attempts to find a Docker environment failed. Will not retry. Please see logs and check configuration

[hudi-bot]

CI report:

• df80d0b Azure: SUCCESS

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build

[wombatu-kun]

nice!