nginx: [emerg] mkdir() "/var/tmp/nginx/client_body" failed (1: Operation not permitted)

[mcroach]

First time setting up the container for two separate domains (keepitsimple.tv and keepitsimple.today)

docker run
-d
--privileged
--name=nginx
--net isolated_nw
-v /share/Container/application-data/nginx/config:/config
-e PGID=1001
-e PUID=1002
-e EMAIL=mcroach@outlook.com
-e URL=keepitsimple.tv
-e SUBDOMAINS=nzbget,plexpy,radarr,request,requests,sonarr,www
-e EXTRA_DOMAINS=keepitsimple.today,nas.keepitsimple.today,www.keepitsimple.today
-e ONLY_SUBDOMAINS=false
-e DHLEVEL=2048
-p 443:443
-e TZ="US/Central"
-h atlas.nginx
linuxserver/letsencrypt

Receive the following error continuously on launch of the container (never gets past this):
nginx: [emerg] mkdir() "/var/tmp/nginx/client_body" failed (1: Operation not permitted)

Receive the same error on container release 76 and release 75.

[aptalca]

Can you provide me info on the host and docker version, etc?

I do not experience that, tested on a number of hosts

[CHBMB]

No response in nearly 2 months, so I'm going to close this.

[ethanopp]

@mcroach were you ever able to fix this? I am having the same issues

@aptalca - I'm running on QNAP TVS-473

docker -version:

Client:
Version: 17.07.0-ce
API version: 1.31
Go version: go1.8.3
Git commit: fd7dc00
Built: Thu Feb 8 15:57:38 2018
OS/Arch: linux/amd64

Server:
Version: 17.07.0-ce
API version: 1.31 (minimum version 1.12)
Go version: go1.8.3
Git commit: fd7dc00
Built: Thu Feb 8 15:57:38 2018
OS/Arch: linux/amd64
Experimental: false

Happening with several docker containers in addition to letsencrypt, here is an example of one of my statements:

docker create --name=Muximux --restart always
-v /share/CACHEDEV1_DATA/Container/Muximux:/config
-e PUID=1001 -e PGID=100
-e TZ=America/New_York
-p 3333:80
linuxserver/muximux

[aptalca]

Please post a log

[ethanopp]

Last line just keeps repeating...

[s6-init] making user provided files available at /var/run/s6/etc...exited 0.                                                                                                                                                                                                                                                                   
[s6-init] ensuring user provided files have correct perms...exited 0.                                                                                                                                                                                                                                                                           
[fix-attrs.d] applying ownership & permissions fixes...                                                                                                                                                                                                                                                                                         
[fix-attrs.d] done.                                                                                                                                                                                                                                                                                                                             
[cont-init.d] executing container initialization scripts...                                                                                                                                                                                                                                                                                     
[cont-init.d] 10-adduser: executing...                                                                                                                                                                                                                                                                                                          
                                                                                                                                                                                                                                                                                                                                                
-------------------------------------                                                                                                                                                                                                                                                                                                           
          _         ()                                                                                                                                                                                                                                                                                                                          
         | |  ___   _    __                                                                                                                                                                                                                                                                                                                     
         | | / __| | |  /  \                                                                                                                                                                                                                                                                                                                    
         | | \__ \ | | | () |                                                                                                                                                                                                                                                                                                                   
         |_| |___/ |_|  \__/                                                                                                                                                                                                                                                                                                                    
                                                                                                                                                                                                                                                                                                                                                
                                                                                                                                                                                                                                                                                                                                                
Brought to you by linuxserver.io                                                                                                                                                                                                                                                                                                                
We gratefully accept donations at:                                                                                                                                                                                                                                                                                                              
https://www.linuxserver.io/donations/                                                                                                                                                                                                                                                                                                           
-------------------------------------                                                                                                                                                                                                                                                                                                           
GID/UID                                                                                                                                                                                                                                                                                                                                         
-------------------------------------                                                                                                                                                                                                                                                                                                           
                                                                                                                                                                                                                                                                                                                                                
User uid:    1001                                                                                                                                                                                                                                                                                                                               
User gid:    100                                                                                                                                                                                                                                                                                                                                
-------------------------------------                                                                                                                                                                                                                                                                                                           
                                                                                                                                                                                                                                                                                                                                                
[cont-init.d] 10-adduser: exited 0.                                                                                                                                                                                                                                                                                                             
[cont-init.d] 20-config: executing...                                                                                                                                                                                                                                                                                                           
mkdir: cannot create directory ‘/var/lib/nginx/tmp/client_body’: Operation not permitted                                                                                                                                                                                                                                                        
chown: changing ownership of '/var/lib/nginx/html/50x.html': Operation not permitted                                                                                                                                                                                                                                                            
chown: changing ownership of '/var/lib/nginx/html/index.html': Operation not permitted                                                                                                                                                                                                                                                          
chown: changing ownership of '/var/lib/nginx/html': Operation not permitted                                                                                                                                                                                                                                                                     
chown: changing ownership of '/var/lib/nginx/logs': Operation not permitted                                                                                                                                                                                                                                                                     
chown: changing ownership of '/var/lib/nginx/modules': Operation not permitted                                                                                                                                                                                                                                                                  
chown: changing ownership of '/var/lib/nginx/run': Operation not permitted                                                                                                                                                                                                                                                                      
chown: changing ownership of '/var/lib/nginx/tmp': Operation not permitted                                                                                                                                                                                                                                                                      
chown: changing ownership of '/var/lib/nginx': Operation not permitted                                                                                                                                                                                                                                                                          
chown: changing ownership of '/var/tmp/nginx': Operation not permitted                                                                                                                                                                                                                                                                          
[cont-init.d] 20-config: exited 0.                                                                                                                                                                                                                                                                                                              
[cont-init.d] 30-keygen: executing...                                                                                                                                                                                                                                                                                                           
using keys found in /config/keys                                                                                                                                                                                                                                                                                                                
[cont-init.d] 30-keygen: exited 0.                                                                                                                                                                                                                                                                                                              
[cont-init.d] 40-install: executing...                                                                                                                                                                                                                                                                                                          
[cont-init.d] 40-install: exited 0.                                                                                                                                                                                                                                                                                                             
[cont-init.d] done.                                                                                                                                                                                                                                                                                                                             
[services.d] starting services                                                                                                                                                                                                                                                                                                                  
[services.d] done.                                                                                                                                                                                                                                                                                                                              
nginx: [emerg] mkdir() "/var/tmp/nginx/client_body" failed (1: Operation not permitted)                                                                                                                                                                                                                                                         
nginx: [emerg] mkdir() "/var/tmp/nginx/client_body" failed (1: Operation not permitted)

[aptalca]

The real problem is chown operation not permitted. Is this on a mounted share? samba, nfs?

[ethanopp]

mounted volume:

docker create --name=Muximux --restart always
-v /share/CACHEDEV1_DATA/Container/Muximux:/config
-e PUID=1001 -e PGID=100
-e TZ=America/New_York
-p 3333:80
linuxserver/muximux

Running several other linuxserver.io with this config with no issues.. for example plex works fine:

docker create
--name=Plex --restart always
--net=host
-e VERSION=latest
-e PUID=1001 -e PGID=100
-e TZ=America/New_York
-v "/share/CACHEDEV1_DATA/Container/Plex":/config
-v "/share/CACHEDEV1_DATA/Library/TV Shows":/data/tvshows
-v /share/CACHEDEV1_DATA/Library/Movies:/data/movies
-v "/share/CACHEDEV1_DATA/Container/Plex/Library/Application Support/Plex Media Server/Cache/Transcode":/transcode
linuxserver/plex

[aptalca]

Something is off with your docker service. Not being able to change ownership of files "inside the image" indicates an issue with docker.

Plex does most if not all of the writing to the config folder, bu is mapped to a folder on the host. Nginx caches inside the image.

For now you can try changing the cache locations to folders under /config via the nginx site config. But it won't solve the larger issue.

[j0nnymoe]

@ethanopp I'll move my letencrypt container to my QNAP as soon as I can to see if I experience the same issue.

[ethanopp]

Alright - In the meantime I'll try deleting all images and doing a fresh container station install on the QNAP

[j0nnymoe]

Could you try deploying the container via the instructions in my guide please? https://www.linuxserver.io/2017/09/17/how-to-setup-containers-on-qnap/

I don't use the Container folder for anything and I avoid using the admin user group too.

Cheers

[ethanopp]

@j0nnymoe - Great guide! didn't know this existed :D

I've just entirely reinstalled docker, deleting all images/containers.

I also created new dock user, and shared folder, and additionally tried setting up the docker via the container station gui (I normally just pass docker create statements through ssh).

...Still getting the same errors.

[ethanopp]

Just out of curiosity, I even tried installing the muximux container with no settings passed and when it runs it still gives the same error... This would lead me to believe the issue is not with the shared folder (since I am not referencing it at all) and it is also not due to user permissions (since I am running as root).

...any other ideas?

[ethanopp]

I just SSH'd into the docker to check the pems "/var/tmp/nginx/client_body"

it seems that /var/tmp/nginx is empty?

root@3c577e37c48c:/var/tmp/nginx$ ls -l
total 0

LetsEncrypt error is slightly different:
nginx: [emerg] mkdir() "/var/tmp/nginx/uwsgi" failed (1: Operation not permitted)

Also looked in the letsencrypt nginx dir and it is empty