rocker/rstudio for apple silicon linux/arm64/v8 platform

[dvillaj]

Hi,

I am experiencing the following error when I try to run the container on a Macbook Pro M1 (MacOS 11.2.3):

WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested

When I try to log-in in RStudio I get the following error: Error: Incorrect or invalid username/password

.

I have tried with the latest version of Docker Desktop (3.3.1) and disabling/enabled experimental features.

[eitsupi]

See this issue for arm64 build of RStudio.
rstudio/rstudio#8809

In addition, even if the above issue is resolved and RStudio for arm can be installed, RStudio Package Manager (RSPM) does not provide R binary packages for arm64, so Docker images like rocker/tidyverse will take a very long time to build...

[echuber2]

As a stopgap measure, does the amd64 version work (maybe slowly) with Rosetta 2 emulation enabled? We have a version of the rocker image here that has auth turned off for limited usage; reportedly, some people are able to run it on M1 Macs: https://github.com/PrairieLearn/PrairieLearn/tree/master/workspaces/rstudio

[eitsupi]

Hi, I have noticed that when using rocker/binder, it is possible to bypass this issue error and run the amd64 version of RStudio Server on arm mac because RStudio Server is run by jupyter-rsession-proxy.
If you really want to use RStudio Server on arm mac, this workaround may be worth trying.
https://www.rocker-project.org/images/versioned/binder.html

[eitsupi]

The arm64 version of RStudio daily builds are now available for focal (rstudio/rstudio#8809 (comment)).
The following Dockerfile should work on arm64 platforms now!

FROM rocker/r-ver:4.2.1

ENV S6_VERSION=v2.1.0.2
ENV RSTUDIO_VERSION=daily
ENV DEFAULT_USER=rstudio
ENV PANDOC_VERSION=default
ENV PATH=/usr/lib/rstudio-server/bin:$PATH

RUN /rocker_scripts/install_rstudio.sh
RUN /rocker_scripts/install_pandoc.sh

EXPOSE 8787

CMD ["/init"]

[yufree]

Thanks for @eitsupi 's post and now the rocker/rstudio can work on arm64.

However, If I add /rocker_scripts/install_tidyverse.sh to the dockerfile above, the compile will fail due to two packages ( arrow and duckdb ) of dplyr database backends. I removed those two packages and add libharfbuzz-dev libfribidi-dev libfreetype6-dev libpng-dev libtiff5-dev libjpeg-dev packages, the tidyverse and verse version can work. I wonder if it's possible to add options to skip certain backends?

Meanwhile, the /rocker_scripts/install_quarto.sh will also fail.

Here is an example Dockerfile with tidyverse supported.

[eitsupi]

@yufree
Thanks for sharing the example Dockerfile, as @benz0li pointed out, currently install_tidyverse.sh and install_quarto.sh cannot run on arm64.

1. Cannot build the duckdb package on arm64 platform due to R problem (will be fixed in R 4.3.0)
2. Building the arrow package is very hard and cannot be completed on a Raspberry Pi 4 due to machine spec as far as I have tested.
   There is also a problem that install_tidyverse.sh lacks cmake installation, so older arrow versions try to install the amd64 version of cmake even on arm64.
3. quarto cli do not have arm64 builds, so it cannot be installed.

I think we need to document which Rocker scripts are executable on arm64. (#405)

I wonder if it's possible to add options to skip certain backends?

I agree that there is a need to skip arrow and duckdb as they are time consuming or impossible to build.
However, since it is up to the user to decide which R packages they wants to install, the option I currently consider promising is to skip installation of all R packages.
#312 (comment)

[chendaniely]

I can confirm that the solution from @nikdata works. Tested this out with a few students in a class I'm teaching.
There's a few things you need to do to get it working:

1. Get the latest version of docker desktop
2. You need to update OSX to Ventura 13+ (anything older won't work)
3. Enable rosetta from command line: softwareupdate --install-rosetta

Then you will see the checkbox under the experimental settings (settings > features in development > use rosetta)

Run the image:

docker run --rm \
  -p 127.0.0.1:8787:8787 \
  -e DISABLE_AUTH=true \
  rocker/rstudio

Because it's doing things through Rosetta. I haven't confirmed how packages and installations + compiling are handled. 🤞

edit (2 weeks later): you can swap out rocker/rstudio for rocker/tidyverse it'll save you a RUN command later. Also I found out that you need to specify :4.1.3, at the moment the 4.2 and :latest tags don't seem to work

docker run --rm \
  -p 127.0.0.1:8787:8787 \
  -e DISABLE_AUTH=true \
  rocker/tidyverse:4.1.3

FWIW I installed and ran some rstan stuff. and the example stuff worked. So it seems that any of the compiled stuff within the container should work as normal.

[Martins6]

I'm using Mac with M2 chip. You guys helped a lot as well, thanks!

Just to complement the answer from @chendaniely, I had to specify the platform argument as well. The final results is the following to make it work, hope it helps someone!

docker run --rm \
  --platform linux/x86_64 \
  -p 8787:8787 \
  -e PASSWORD=YOURNEWPASSWORD \
  -e DISABLE_AUTH=true \
  rocker/rstudio

[AdamCiuris]

I can confirm that the solution from @nikdata works. Tested this out with a few students in a class I'm teaching. There's a few things you need to do to get it working:

1. Get the latest version of docker desktop
2. You need to update OSX to Ventura 13+ (anything older won't work)
3. Enable rosetta from command line: softwareupdate --install-rosetta

Then you will see the checkbox under the experimental settings.

Run the image:

docker run --rm \
  -p 127.0.0.1:8787:8787 \
  -e DISABLE_AUTH=true \
  rocker/rstudio

Because it's doing things through Rosetta. I haven't confirmed how packages and installations + compiling are handled. 🤞

Thank you! We spent two days on this and this fixed it. Remember to update docker and tick the two settings in docker desktop that let you use rosetta!

[hughcross]

Thanks to everyone for their input and testing. I have not updated to Ventura yet (work computer, so have to go by their schedule), but once I do I will check this out.

[SameOldSamOld]

This thread has been extremely useful for me on my Apple M2. Thank you very much.

Below is the fix that finally helped me build my Dockerfile successfully!

docker build --platform linux/x86_64 -t my_container:1.0 .

[chendaniely]

I edited my original comment. It seems that for many of my students and me, we need to use :4.1.3 right now.

Try that version if :latest or :4.2.2 isn't working.

Maybe that's what the platform tag fixed 🤷

[eitsupi]

FYI, Quarto CLI 1.3 releases (now prerelease) include deb packages for arm64, so we will probably be able to build rocker/rstudio for arm64 in its complete form soon.

[eitsupi]

I have created a PR #651 to enable arm64 builds of rocker/rstudio with RStudio 2023.05.1 or later.
Ref: rstudio/rstudio#12411

[diazrenata]

Thank you, @eitsupi, for incredible work on this (going back years)! I understand if this may not be possible, but I am wondering if it would be feasible to release versions of rocker/tidyverse that are also arm64 compatible? It would be incredibly helpful, but I completely understand if either time or the upstream dependencies and build times are prohibitive!

[eitsupi]

Thanks @diazrenata.
As you understand, the rocker/tidyverse takes a tremendous amount of time to build the arrow and duckdb packages, and I expect that the current workflow as is will probably not be able to build them stably due to the 360 minute GitHub Actions limit with arm64 emulation.
It might be possible to build if the current workflow (which builds all images that depend on rocker/r-ver) is split into multiple parts to get around the 360 minute limit.

If the Posit Package Manager starts supporting binary installation of arm64 Ubuntu, it could make it easier to build.
(I believe @glin mentioned somewhere that they were considering this.)

[eitsupi]

rocker/rstudio:latest arm64 image has been pushed to DockerHub today.