[SPARK-3298][SQL] Add flag control overwrite registerAsTable / registerTempTable

[OopsOutOfMemory]

https://issues.apache.org/jira/browse/SPARK-3298

add a flag allowOverwrite to control overwrite registerTempTable.

By default it is true means registerTempTable command will overwrite the previous table has same name.
(like var tempTable)

If set it to false, means the registerTempTable command will check the same name table exists in catalog or not and if exists throw a table already exists exception.
(like final tempTable)

You could drop it first and then register it again.

[OopsOutOfMemory]

@marmbrus Any comments here ?

[AmplabJenkins]

Can one of the admins verify this patch?

[OopsOutOfMemory]

/cc @scwf @chenghao-intel

[squito]

Jenkins this is OK to test

[squito]

this is mentioned in the jira, but its worth noting again here that this changes the behavior slightly, since it wouldn't throw an exception before.

[squito]

lets try this again ...
Jenkins this is OK to test

[squito]

ok to test

[SparkQA]

Test build #26119 has started for PR 4175 at commit 9538bfe.

• This patch merges cleanly.

[SparkQA]

Test build #26119 has finished for PR 4175 at commit 9538bfe.

• This patch fails PySpark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26119/
Test FAILed.

[squito]

I think these failures are real, looks like you need to do a similar updating of the args to registerTempTable in the pyspark tests, eg. here

there are more places too, look in the test console output for the full list

[OopsOutOfMemory]

Thanks, squito :)
I'm working on this issue.

[SparkQA]

Test build #26141 has started for PR 4175 at commit 26c6011.

• This patch merges cleanly.

[SparkQA]

Test build #26141 has finished for PR 4175 at commit 26c6011.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26141/
Test PASSed.