Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

storage-config secret format is different between kserve and modelmesh #115

Closed
Jooho opened this issue Oct 31, 2023 · 4 comments · Fixed by #116
Closed

storage-config secret format is different between kserve and modelmesh #115

Jooho opened this issue Oct 31, 2023 · 4 comments · Fixed by #116
Assignees
Labels
kind/bug Something isn't working rhods-2.5

Comments

@Jooho
Copy link
Contributor

Jooho commented Oct 31, 2023

odh-model-controller is responsible for generating storage-config which is the main secret to accessing models.

For modelmesh, the secret storage-config is

{"access_key_id":"AKIAIOSFODNN7EXAMPLE","default_bucket":"modelmesh-example-models","endpoint_url":"http://minio:9000","region":"us-south","secret_access_key":"wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY","type":"s3"}

but for kserve, it looks like

apiVersion: v1
data:
  AWS_ACCESS_KEY_ID: YWRtaW4=
  AWS_SECRET_ACCESS_KEY: cGFzc3dvcmQ=
kind: Secret
metadata:
  annotations:
    serving.kserve.io/s3-endpoint: minio.minio.svc:9000
    serving.kserve.io/s3-region: us-east-2
    serving.kserve.io/s3-useanoncredential: "false"
    serving.kserve.io/s3-usehttps: "0"
  name: storage-config

odh-model-controller needs to generate right format of storage-config secret based on deployment type(kserve, modelmesh)

@spolti
Copy link
Member

spolti commented Oct 31, 2023

feel free to assign to me, can handle after the CVE stuff

@VedantMahabaleshwarkar VedantMahabaleshwarkar added the kind/bug Something isn't working label Oct 31, 2023
@Jooho
Copy link
Contributor Author

Jooho commented Oct 31, 2023

@spolti thank! when @VedantMahabaleshwarkar sends a PR, please review it.

@VedantMahabaleshwarkar
Copy link
Contributor

Overall the storage secret can remain the same, the only difference is the name of the key for the bucket. Kserve expects the key bucket while Modelmesh expects the key default_bucket. I've added both as a patch so that it works. However we should open an issue upstream to have the same format everywhere

@heyselbi
Copy link
Contributor

heyselbi commented Nov 9, 2023

@VedantMahabaleshwarkar please attach the RHODS PRs once they are open/merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Something isn't working rhods-2.5
Projects
Status: Done
Status: Done
Development

Successfully merging a pull request may close this issue.

4 participants