credentials
param in kedrio.io.csv_s3.CSVS3DataSet
breaks since s3fs 0.4.1.
#309
Labels
Issue: Bug Report 🐞
Bug that needs to be fixed
Description
Using dict keys 'aws_access_key_id' and 'aws_secret_access_key' in the credentials param in
kedrio.io.csv_s3.CSVS3DataSet
causes errors since s3fs 0.4.1.I have made a pull request to s3fs to fix it on their side. But this report is just to let you know in case my PR is rejected or ignored. And even if the PR is accepted, since s3fs 0.4.1 & 0.4.2 are already out perhaps you'll need to be aware of this if your users report such issues and to fix your requirements.txt to avoid it. Either s3fs<=0.4.0 or hopefully >=0.4.3 if my PR gets accepted by next release.
Context
I am unable to pass credentials to CSVS3DataSet as per its docstring. And would have to downgrade s3fs to get it to work.
Steps to Reproduce
Expected Result
Instantiate dataset obj.
Actual Result
Raised TypeError
Your Environment
s3fs==0.4.1
kedro==0.15.8
The text was updated successfully, but these errors were encountered: