[SPARK-3060] spark-shell.cmd doesn't accept application options in Windows OS

[tsudukim]

Added equivalent module as utils.sh and modified spark-shell2.cmd to use it to parse options.

Now we can use application options.
ex) bin\spark-shell.cmd --master spark://master:7077 -i path\to\script.txt

[AmplabJenkins]

Can one of the admins verify this patch?

[andrewor14]

add to whitelist

[andrewor14]

Thanks @tsudukim! Great to see this being fixed. The 1.2 deadline is a little close at this point so I'm not sure if we can pull in the changes here because windows batch is so complicated. I'll look at this after the release.

[SparkQA]

Test build #23582 has started for PR 3350 at commit 3a11361.

• This patch merges cleanly.

[SparkQA]

Test build #23585 has started for PR 3350 at commit 4551e56.

• This patch merges cleanly.

[SparkQA]

Test build #23582 has finished for PR 3350 at commit 3a11361.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23582/
Test PASSed.

[SparkQA]

Test build #23585 has finished for PR 3350 at commit 4551e56.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23585/
Test PASSed.

[andrewor14]

Hey @tsudukim what is the status on this PR, are the changes ready from your side? Have you tested this on a Windows environment?

[tsudukim]

Hi @andrewor14 yes I've tested on my environment. Would you check it?

[andrewor14]

Alright, LGTM I'm merging this into master thanks!

[andrewor14]

I've renamed this file to windows-utils.cmd to be more consistent