EMR Job with Docker image always use the deploy mode as cluster

[mdrmuhaimin]

Describe the bug

Calling the submit_emr_job function

wr.emr.submit_spark_step(
    cluster_id,
    s3_path,
    deploy_mode="client",
    docker_image=image_path
)

Always yield deploy_mode as cluster despite explicitly mentioning otherwise

How to Reproduce

wr.emr.submit_spark_step(
    cluster_id,
    s3_path,
    deploy_mode="client",
    docker_image=image_path
)

Expected behavior

Deploy mode should be client

Your project

No response

Screenshots

No response

OS

Mac

Python version

3.9.9

AWS DataWrangler version

2.15

Additional context

No response

[jaidisido]

Good catch, thank you for the fix. It will be available in the next release, in the meantime you can install it from the main branch