Doesn't allow us to specify a directory path as an argument to submit_py_files parameter in spark_processor.run method

[koustavmukherjee]

As per https://github.com/aws/sagemaker-python-sdk/blob/master/src/sagemaker/spark/processing.py#L76 the comments local directory paths should be allowed.

However, when we try to pass a directory path we get the following error:

submit_deps path file:///home/ec2-user/SageMaker/code/ is not a valid local file. Please specify a list of one or more S3 URIs, local file paths, and/or local directory paths

Most likely this spawns from the check below:

sagemaker-python-sdk/src/sagemaker/spark/processing.py

Line 441 in 12a6918

if not os.path.isfile(dep_path):

exists check instead of isfile here might help resolve the issue.

[Olamyy]

@bveeramani Can I take this up if no one else has?