Building a Dockerfile on 3.12.0

[Sharpz7]

2021-10-13 13:00:54 (90.0 MB/s) - ‘Python-3.9.1.tgz’ saved [25372998/25372998]

ls: cannot access '.': Operation not permitted
configure: error: working directory cannot be determined
The command '/bin/sh -c apt-get install -y     build-essential     zlib1g-dev     libncurses5-dev     libgdbm-dev     libnss3-dev     libssl-dev     libsqlite3-dev     libreadline-dev     libffi-dev     curl     libbz2-dev &&    wget https://www.python.org/ftp/python/3.9.1/Python-3.9.1.tgz &&    tar -xf Python-3.9.1.tgz &&    cd Python-3.9.1 &&    ./configure --enable-optimizations &&    make -j 2 &&    sudo make altinstall' returned a non-zero code: 2

Exited with code exit status 2

This is the error when trying to run the following command in a dockerfile. The user is set to root, with no workdir specified. Any Ideas?

The Dockerfile correctly builds on 3.11.1

[code-asher]

Could you post the Dockerfile or enough of it to reproduce? I tried making one using codercom/code-server:3.12.0 but it worked for me (I had to add apt-get update and wget though).

FROM codercom/code-server:3.12.0

USER root

RUN apt-get update && apt-get install -y \
  wget \
  build-essential \
  zlib1g-dev \
  libncurses5-dev \
  libgdbm-dev \
  libnss3-dev \
  libssl-dev \
  libsqlite3-dev \
  libreadline-dev \
  libffi-dev \
  curl \
  libbz2-dev

RUN wget https://www.python.org/ftp/python/3.9.1/Python-3.9.1.tgz
RUN tar -xf Python-3.9.1.tgz
RUN cd Python-3.9.1 && ./configure --enable-optimizations && make -j 2 && make altinstall

[Sharpz7]

https://hastebin.com/ayetotawes.properties

I have removed the copying that happens after the user is set to coder, but if you think this is the problem I can extend access

[code-asher]

Thank you for posting that!

I built that Dockerfile after changing it to 3.12.0 (and after removing the get-docker.sh section since I do not have that file) but it built without any errors for me. All I did was put it in a directory and run docker build .. Any ideas on what else I can do to try reproducing?

[Sharpz7]

I changed the order to the following:

https://hastebin.com/neloqadofu.properties

and the new error is

Step 3/25 : RUN apt-get install -y     build-essential     zlib1g-dev     libncurses5-dev     libgdbm-dev     libnss3-dev     libssl-dev     libsqlite3-dev     libreadline-dev     libffi-dev     curl     libbz2-dev &&    wget https://www.python.org/ftp/python/3.9.1/Python-3.9.1.tgz &&    tar -xf Python-3.9.1.tgz &&    cd Python-3.9.1 &&    ./configure --enable-optimizations &&    make -j 2 &&    sudo make altinstall
 ---> Running in d2ca148b449d
Reading package lists...
Building dependency tree...
Reading state information...
E: Unable to locate package build-essential

All I can think of is I am running it within CircleCI...

So a Docker in Docker error?

Also on a more personal note, do you see any glaring issues in the Docker file in terms of speed? Its really getting to me the massive build times ;)

[Sharpz7]

I moved to 3.11.1 add other changes, and that has now failed with the same error: so here is my thinking.

RUN apt-get update -y is the problem line. On CircleCI (assuming its Docker in Docker they use) I need to do this command to get essential modules.

This could also be messing with the permissions specifically on codeserver 3.12.0 due to another compatibility issues with Docker in Docker builds

[code-asher]

Ah yup you will need `apt-get update` before `apt-get install`. In terms of speed I am not really sure since I am not very familiar with Docker. I think there are some tricks you can do with layers and splitting into multiple Dockerfiles but I am not sure.

[Sharpz7]

Okay, so I need to update on circleci since it's docker in docker? But then doing that I get the problem I did before, with python3.9 failing to install cause of bad permissions. Maybe it's a sudo problem?

…

On Mon, 25 Oct 2021, 20:32 Asher, ***@***.***> wrote: Ah yup you will need `apt-get update` before `apt-get install`. In terms of speed I am not really sure since I am not very familiar with Docker. I think there are some tricks you can do with layers and splitting into multiple Dockerfiles but I am not sure. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#4352 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ALCTWHQB5UM4FMVPGXGPCNDUIWWGNANCNFSM5F57GFPQ> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

[code-asher]

You should be able to edit your Dockerfile and add `RUN apt-get update` before the first `RUN apt-get install` line.

[code-asher]

You maybe also need USER root, see the example I posted above: #4352 (comment)

[Sharpz7]

Hi,

Doing what you said is what caused this issue in the first place:

021-10-26 16:02:43 (86.6 MB/s) - ‘Python-3.9.1.tgz’ saved [25372998/25372998]

ls: cannot access '.': Operation not permitted
configure: error: working directory cannot be determined
The command '/bin/sh -c apt-get install -y     build-essential     zlib1g-dev     libncurses5-dev     libgdbm-dev     libnss3-dev     libssl-dev     libsqlite3-dev     libreadline-dev     libffi-dev     libbz2-dev &&    wget https://www.python.org/ftp/python/3.9.1/Python-3.9.1.tgz &&    tar -xf Python-3.9.1.tgz &&    cd Python-3.9.1 &&    ./configure --enable-optimizations &&    make -j 2 &&    sudo make altinstall' returned a non-zero code: 2

Exited with code exit status 2
CircleCI received exit code 2

https://www.toptal.com/developers/hastebin/ebocoferuf.properties

This is why I am sure now it is a CircleCI docker in docker problem.

There is both a USER root and sudo apt-get update here

[code-asher]

Ahhhhhh I see I misread what you wrote, sorry to run around in circles! You are probably right that it is a CircleCI problem since we cannot reproduce locally. Could you split the `apt-get install` and `wget` commands to be on different lines to see which is failing? I wonder if the `wget` is failing rather than the install line. Maybe it is trying to put it in a directory that does not exist yet since the workdir is `/home/coder`? If that is the case maybe prepending the `wget` command with `cd /tmp` will fix it. You could also try prepending with `sudo` instead of using `USER root` but I am not sure if that will work or if it will fix the problem.

[Sharpz7]

I'll try all this and get back to you soon Thanks! :)

…

On Wed, 27 Oct 2021, 16:58 Asher, ***@***.***> wrote: Ahhhhhh I see I misread what you wrote, sorry to run around in circles! You are probably right that it is a CircleCI problem since we cannot reproduce locally. Could you split the `apt-get install` and `wget` commands to be on different lines to see which is failing? I wonder if the `wget` is failing rather than the install line. Maybe it is trying to put it in a directory that does not exist yet since the workdir is `/home/coder`? If that is the case maybe prepending the `wget` command with `cd /tmp` will fix it. You could also try prepending with `sudo` instead of using `USER root` but I am not sure if that will work or if it will fix the problem. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#4352 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ALCTWHW2JEWPOJDMULZWD7TUJAOSXANCNFSM5F57GFPQ> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.