[SPARK-14407][SQL] Hides HadoopFsRelation related data source API into execution/datasources package #12178

[liancheng]

What changes were proposed in this pull request?

This PR moves HadoopFsRelation related data source API into execution/datasources package.

Note that to avoid conflicts, this PR is based on #12153. Effective changes for this PR only consist of the last three commits. Will rebase after merging #12153.

How was this patch tested?

Existing tests.

[SparkQA]

Test build #55720 has finished for PR 12361 at commit ba71c95.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #55791 has finished for PR 12361 at commit 673352e.

• This patch fails Scala style tests.
• This patch does not merge cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #55814 has finished for PR 12361 at commit 4221aca.

• This patch fails from timeout after a configured wait of 250m.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #56223 has finished for PR 12361 at commit 5db3662.

• This patch passes all tests.
• This patch does not merge cleanly.
• This patch adds the following public classes (experimental):
  • case class FilePartition(index: Int, files: Seq[PartitionedFile]) extends RDDPartition
  • abstract class OutputWriterFactory extends Serializable
  • abstract class OutputWriter
  • case class HadoopFsRelation(
  • trait FileFormat
  • case class Partition(values: InternalRow, files: Seq[FileStatus])
  • trait FileCatalog
  • class HDFSFileCatalog(
  • case class FakeFileStatus(

[SparkQA]

Test build #56257 has finished for PR 12361 at commit 340f304.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[yhuai]

test this please

[SparkQA]

Test build #56277 has finished for PR 12361 at commit 340f304.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[yhuai]

Thanks! @liancheng I am going to merge this.

[tedyu]

Do we need @param for this ?