Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue with the apache/superset:dockerize #26788

Closed
3 tasks done
rnpaiva opened this issue Jan 24, 2024 · 19 comments
Closed
3 tasks done

Issue with the apache/superset:dockerize #26788

rnpaiva opened this issue Jan 24, 2024 · 19 comments
Assignees

Comments

@rnpaiva
Copy link

rnpaiva commented Jan 24, 2024

Bug description

Kubernetes can't pull the image apache/superset:dockerize . I tested in my local and it's not possible as well .

How to reproduce the bug

docker pull apache/superset:dockerize

Screenshots/recordings

Screenshot from 2024-01-24 14-53-34
Screenshot from 2024-01-24 14-50-15
Screenshot from 2024-01-24 15-05-47

Superset version

3.0.3

Python version

3.9

Node version

16

Browser

Chrome

Additional context

No response

Checklist

  • I have searched Superset docs and Slack and didn't find a solution to my problem.
  • I have searched the GitHub issue tracker and didn't find a similar bug report.
  • I have checked Superset's logs for errors and if I found a relevant Python stacktrace, I included it here as text in the "additional context" section.
@mistercrunch
Copy link
Member

Fix is getting crafted here -> #26787

@kamilrotter
Copy link

Hey @mistercrunch , we can't pull image using tag 'latest', is that the same issue?
image

@mistercrunch
Copy link
Member

Yes should be the same, we had conflicting tags before that just happened to make the amd builds get the proper base docker tags because they were running sequentially with amd last. Now that we parallelize the build, and because arm is emulated and slower, it tends to take over the tags. Now I'm adding suffixes to all arm builds so that tags won't conflict.

@jun0tpyrc
Copy link

or do docker multi-arch build to make things work implicitly...
most other images in chart are amd64 only

@jun0tpyrc
Copy link

or may do docker multi-arch build to make things work implicitly...
most other images in chart are amd64 only

@kevin-delisle-peakpower

or may do docker multi-arch build to make things work implicitly... most other images in chart are amd64 only

This is the right way of dealing with this. Modifying your build to assemble a multi-arch image means no one has to worry about pulling alternate tags to get the build that's right for them, and it avoids adding complexity to the tagging structure.

@rnpaiva
Copy link
Author

rnpaiva commented Jan 30, 2024

it's happening again

@rnpaiva
Copy link
Author

rnpaiva commented Jan 30, 2024

do you have the dockerfile please ? I'll compile and push in my ECR

@kevin-delisle-peakpower

@rnpaiva As a workaround, I pinned my dependencies to a specific release instead of using the dockerize image.
If you browse Docker Hub, there's a bunch of tags that look like apache/superset:<commit-hash>-dockerize-linux-amd64-<base-image-version>: https://hub.docker.com/r/apache/superset/tags?page=1&name=docker

(ex. e6f9ef159d113f9cf698791e5f965855e7be0169-dockerize-linux-amd64-3.9-slim-bookworm)

@edu-sistec
Copy link

Hello, kevin-delisle-peakpower
I have problems booting in docker, I think it's also due to the AMR64 architecture.

As you say there are these options but I have tried some and I get errors.

I don't understand if the error is the image that is wrong, or the missing file 'config.json' if I should create it, but there is no information about where this file 'config.json' should be located , nor that it has to be introduced.

Have you been able to run some of these images? Which ones exactly? Did you have to do anything special?

Thanks
1

@kevin-delisle-peakpower
Copy link

kevin-delisle-peakpower commented Jan 30, 2024

@edu-sistec I used the apache/superset:b0c8f620d6517b400a9676c01393cda8a57b0d64-dockerize-linux-amd64-3.9-slim-bookworm image, in particular.
I only used it for the initImage portion of the Helm chart when I installed it, since that was what I was running into problems with. We're still using a tagged release for the "main" container instance of the installation.

I'm not versed in the use of Superset's docker-compose install, but if there's a section that's meant to run the postgres initialization, that's probably where you'd want to use this image.

@mistercrunch
Copy link
Member

mistercrunch commented Jan 31, 2024

Ok i merged that PR, eventually should get a apache/superset:dockerize-latest to point to as we push the next release

@edu-sistec
Copy link

Hello kevin-delisle-peakpower

Hello,

I am now seeing that you are booting the amd64 image.
I used your comments to try to boot the arm64 image, because I'm on an arm64 architecture.
I get these errors, I attach an image
Am I doing something wrong in docker-compose?

Thank you so much
1

@mistercrunch
Copy link
Member

no bash!?

@mistercrunch
Copy link
Member

I don't really use docker here on my local setup and it looks like it's busted for my new mac (linux/arm64/v8), can't really help. I really like docker conceptually but in practice it's a different story.

@jun0tpyrc
Copy link

jun0tpyrc commented Feb 1, 2024

for those who using helm install and want a quick workaround with min changes , that place in helm values to temp modify before there is a tag for default initImage that does multi-arch in auto

 initImage:
   repository: apache/superset
-  tag: dockerize
+  tag: ea6cbcef3e980e42d3a19b8fc5928f973fd7be4a-dockerize-linux-amd64-3.9-slim-bookworm # NOTE: https://github.com/apache/superset/issues/26788
   pullPolicy: IfNotPresent

@edu-sistec
Copy link

Hello jun0tpyrc,

I tried to do what you say (I attach image 1) but still it want to take the standard Superset image.
I have also put in the docker-compse file the image I would like to use (I attach image 2), and it keeps saying that it cannot run the 'bach'.
Is there something I'm not doing right?

thank you so much,
Edu

1
2

@arundh93
Copy link

arundh93 commented Feb 5, 2024

Any update on this issue?

@mistercrunch
Copy link
Member

This should help #27055

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants