Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Helm deployment: The Access Key Id you provided does not exist #8805

Closed
gajus opened this issue Dec 15, 2021 · 14 comments
Closed

Helm deployment: The Access Key Id you provided does not exist #8805

gajus opened this issue Dec 15, 2021 · 14 comments
Labels
area/platform issues related to the platform autoteam community team/compose team/prod-eng type/bug Something isn't working

Comments

@gajus
Copy link

gajus commented Dec 15, 2021

Getting this error when trying to add source:

Screen Shot 2021-12-14 at 10 33 59 PM

Using Helm chart with the following values:

postgresql:
  enabled: true
logs:
  s3:
    enabled: false
@gajus
Copy link
Author

gajus commented Dec 15, 2021

Reverting to the commit before this change makes it work.

There is a regression.

@alafanechere
Copy link
Contributor

Hi @gajus your problem happens for a specific source selection or is it common to all sources during set up and you think its related to S3 logs setup. Could you please share your server log?

@alafanechere
Copy link
Contributor

alafanechere commented Dec 15, 2021

@vnourdin and @davinchia do you have an insight about the root cause of this regression that appeared after merging #8736?

@alafanechere alafanechere added area/platform issues related to the platform and removed needs-triage labels Dec 15, 2021
@alafanechere alafanechere changed the title The Access Key Id you provided does not exist Helm deployment: The Access Key Id you provided does not exist Dec 15, 2021
@vnourdin
Copy link
Contributor

I can't find what could trigger such error 🤔
I just renamed the helm value used to set AWS credentials env variables but kept the same default value.
There is also this change, but I don't see why it would create any problem neither.

@gajus, could you compare AWS credentials in the ConfigMap airbyte-env and in the worker env variables both before and after my changes ? If you don't overwrite them, it should always be minio:minio123

@mohamagdy
Copy link
Contributor

@gajus did you upgrade from previous versions of Airbyte and had MinIO running as a dependency or is it a fresh installation of Airbyte?

@gajus
Copy link
Author

gajus commented Dec 15, 2021

I did fresh install in both cases. The latest version does not work. The one from a commit from before the one I referenced works fine. I can replicate this consistently since I built and rebuilt our test environment many times.

@mohamagdy
Copy link
Contributor

I see. I had some other issues with the referenced merge listed here.

For me this works:

logs:
  accessKey:
    password: <access-key>
  secretKey:
    password: <secret-key>
  minio:
    enabled: true

# Yes again!
minio:
  accessKey:
    password: <access-key>
  secretKey:
    password: <secret-key>

@thodquach
Copy link

I met this problem with default values.yaml.
chart version: "0.39.10-alpha"
How can we fix this for now?

@yoavtzelnick
Copy link

yoavtzelnick commented Jun 8, 2022

Having the same problem as @thodquach .
I think this is caused by 0.39.9-alpha (#13432) with updating the Chart.yaml minio version from 7 to 11.

@stasrelevanceai
Copy link

We also faced with this error yesterday. This helped:

minio:
  accessKey:
    password: minio
  secretKey:
    password: minio123
  auth:
   rootUser: minio
   rootPassword: minio123

auth block was added as the latest version minio requires different configuration: https://github.com/bitnami/charts/tree/master/bitnami/minio#to-900

airbyte helm chart should be updated with a newer configuration for minio helm chart.

@OmarSultan85
Copy link

@stasrelevanceai Thank for providing that, this worked for me

@isabelbicalho
Copy link

Any updates? I get this error with S3 destination

@stasrelevanceai
Copy link

@isabelbicalho have you tried this code?
#8805 (comment)

It worked for us. With the new version of minio, braking changes were introduced in helm configuration that needs to be addressed in airbyte helm as well.

@marcosmarxm
Copy link
Member

Closing due inactivity. @gajus please test last version of Helm deployment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/platform issues related to the platform autoteam community team/compose team/prod-eng type/bug Something isn't working
Projects
None yet
Development

No branches or pull requests