ClientError: An error occurred (OperationAborted) when calling the CreateBucket operation: A conflicting conditional operation is currently in progress against this resource. Please try again.

[chanansh]

Describe the bug

If I parallelize get_query I get the following error:
ClientError: An error occurred (OperationAborted) when calling the CreateBucket operation: A conflicting conditional operation is currently in progress against this resource. Please try again.

Environment
latest awswrangler

To Reproduce

Hard, it depends on my own data. I used joblib.Parallel

[jaidisido]

This might be related to this recent change. Need to investigate

[jaidisido]

This has now been merged to main and can be tested:

pip uninstall awswrangler -y
pip install git+https://github.com/awslabs/aws-data-wrangler.git@main

until it's available in the next release.