Add support for arm64

[holdenk]

Given the proliferation of arm based cloud instances and the nvidia arm platforms it would make sense to support running on arm64.

[lucaskjaero]

I also have this issue. Thanks for raising it @holdenk .

[vl-shopback]

any news?

[ljy2010a]

any news?

[shechostr]

any news?

[gonzalezzfelipe]

Hey there, adding my 2 cents here, because I just got it working. It looks like this has no more support so I'll tell you the steps I did to get it working

#. Change this line from GOARCH=amd64 to GOARCH=arm64.
#. Run docker buildx build --platform linux/arm64 --build-arg SPARK_IMAGE=apache/spark:v3.2.2 -t your-repo/your-image:v3.2.2-arm .

I'm currently testing that no problems arise from this, but it seems like these are the only change requirements. Then update the values of the helmchart to use this image and that should be it.

[mfidemraizer]

@gonzalezzfelipe I've done so, and I'm getting the following error once container is started:

exec: "/usr/bin/entrypoint.sh": permission denied: unknown

[ZachThill]

@mfidemraizer,
I was just working on this trying to deploy spark operator on an AWS Graviton cluster. After successfully building the image and attempting to run the container on docker desktop, I got the same error as you:

To fix this issue, I added a new RUN line to my dockerfile that changes the permissions of the entrypoint.sh file and was able to initialize the container successfully:

COPY spark-operator/entrypoint.sh /usr/bin/
RUN chmod +x /usr/bin/entrypoint.sh
ENTRYPOINT ["/usr/bin/entrypoint.sh"]

[manojmukkamala]

tested spark 3.5.0 on RPi microk8s today using docker image and can confirm it is working fine by following the instructions above.