We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Describe the bug Using s3.to_parquetwith mode overwrite_partitions fails since the call to delete_objects does not propagate the boto3_session
s3.to_parquet
overwrite_partitions
delete_objects
boto3_session
To Reproduce
import awswrangler as wr import pandas as pd import boto3 # The custom boto3 session sess = boto3.Session(aws_access_key_id='<foo>', aws_secret_access_key='<bar>') # The dataframe to write df = pd.DataFrame({'one': [0,], 'two': ["spam"], 'three': [True]}) wr.s3.to_parquet( df=df, path='s3://path', dataset=True, mode="overwrite_partitions", partition_cols=["two"], boto3_session=sess )
The previous snipet results in an authentication error, probably because of the missing boto3_session parameter in the delete call:
if mode == "overwrite_partitions": delete_objects(path=prefix, use_threads=use_threads
The text was updated successfully, but these errors were encountered:
Hi @hjuhel-cdpq! Thank you very much for report it.
Will be fixed and released later today in the version 1.0.2.
1.0.2
Sorry, something went wrong.
Fix missing boto3_session argument #172
6a55fdc
Merge pull request #174 from awslabs/boto3-session-missing
3e4f2e5
Thanks @hjuhel-cdpq, this issue is resolved on version 1.0.2. Please, give feedback when possible.
igorborgest
No branches or pull requests
Describe the bug
Using
s3.to_parquet
with modeoverwrite_partitions
fails since the call todelete_objects
does not propagate theboto3_session
To Reproduce
The previous snipet results in an authentication error, probably because of the missing boto3_session parameter in the delete call:
The text was updated successfully, but these errors were encountered: