Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docker pull fail with failed to register layer: Error processing tar file(exit status 1): invalid argument #97

Open
1 of 3 tasks
linarnan opened this issue Sep 6, 2017 · 8 comments

Comments

@linarnan
Copy link

linarnan commented Sep 6, 2017

  • This is a bug report
  • This is a feature request
  • I searched existing issues before opening this one

Behavior

I'm building vm image for openstack, I wanna pull some docker images during build image process.
some how it can't start docker daemon during package installation.

so i just start daemon manually

here is my script:

cgroups-mount

/usr/bin/dockerd --dns 8.8.8.8 -H unix:///var/run/docker.sock --log-level debug &

docker pull docker.example.com/example/sdn-web:dev
docker pull docker.example.com/example/dhcp-server:dev

docker images

kill `cat /var/run/docker.pid`

looks like pull image correctly, but have some problem while register layer

Steps to reproduce the behavior

Output of docker version:

17.06.2~ce-0~ubuntu

Output of docker info:

Setting up docker-ce (17.06.2~ce-0~ubuntu) ...
runlevel:/var/run/utmp: No such file or directory
invoke-rc.d: policy-rc.d denied execution of start.
Setting up cgroup-lite (1.9) ...
invoke-rc.d: unknown initscript, /etc/init.d/cgroup-lite not found.
runlevel:/var/run/utmp: No such file or directory
invoke-rc.d: policy-rc.d denied execution of start.
Processing triggers for libc-bin (2.19-0ubuntu6.13) ...
Processing triggers for ureadahead (0.100.0-16) ...
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 59997  100 59997    0     0   930k      0 --:--:-- --:--:-- --:--:--  945k
dib-run-parts Wed Sep  6 11:29:56 UTC 2017 50-install-additional-packages completed
dib-run-parts Wed Sep  6 11:29:56 UTC 2017 Running /tmp/in_target.d/install.d/51-docker-images
DEBU[0000] Listener created for HTTP on unix (/var/run/docker.sock) 
WARN[0000] libcontainerd: makeUpgradeProof could not open /var/run/docker/libcontainerd/containerd 
INFO[0000] libcontainerd: new containerd process, pid: 8514 
WARN[0000] containerd: low RLIMIT_NOFILE changing to max  current=1024 max=4096
DEBU[0000] libcontainerd: containerd health check returned error: rpc error: code = 14 desc = grpc: the connection is unavailable 
DEBU[0001] libcontainerd: containerd health check returned error: rpc error: code = 14 desc = grpc: the connection is unavailable 
WARN[0001] failed to rename /var/lib/docker/tmp for background deletion: rename /var/lib/docker/tmp /var/lib/docker/tmp-old: no such file or directory. Deleting synchronously 
DEBU[0001] Using default logging driver json-file       
DEBU[0001] Golang's threads limit set to 56250          
DEBU[0001] Using graph driver aufs                      
DEBU[0001] Max Concurrent Downloads: 3                  
DEBU[0001] Max Concurrent Uploads: 5                    
INFO[0001] Graph migration to content-addressability took 0.00 seconds 
WARN[0001] Your kernel does not support swap memory limit 
WARN[0001] Your kernel does not support cgroup rt period 
WARN[0001] Your kernel does not support cgroup rt runtime 
INFO[0001] Loading containers: start.                   
DEBU[0001] Option Experimental: false                   
DEBU[0001] Option DefaultDriver: bridge                 
DEBU[0001] Option DefaultNetwork: bridge                
WARN[0001] Running modprobe nf_nat failed with message: `modprobe: ERROR: ../libkmod/libkmod.c:556 kmod_search_moddep() could not open moddep file '/lib/modules/4.4.0-93-generic/modules.dep.bin'`, error: exit status 1 
WARN[0001] Running modprobe xt_conntrack failed with message: `modprobe: ERROR: ../libkmod/libkmod.c:556 kmod_search_moddep() could not open moddep file '/lib/modules/4.4.0-93-generic/modules.dep.bin'`, error: exit status 1 
DEBU[0001] Fail to initialize firewalld: Failed to connect to D-Bus system bus: dial unix /var/run/dbus/system_bus_socket: connect: no such file or directory, using raw iptables instead 
DEBU[0001] /sbin/iptables, [--wait -t nat -D PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t nat -D OUTPUT -m addrtype --dst-type LOCAL ! --dst 127.0.0.0/8 -j DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t nat -D OUTPUT -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t nat -D PREROUTING] 
DEBU[0001] /sbin/iptables, [--wait -t nat -D OUTPUT]    
DEBU[0001] /sbin/iptables, [--wait -t nat -F DOCKER]    
DEBU[0001] /sbin/iptables, [--wait -t nat -X DOCKER]    
DEBU[0001] /sbin/iptables, [--wait -t filter -F DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -X DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -F DOCKER-ISOLATION] 
DEBU[0001] /sbin/iptables, [--wait -t filter -X DOCKER-ISOLATION] 
DEBU[0001] /sbin/iptables, [--wait -t nat -n -L DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t nat -N DOCKER]    
DEBU[0001] /sbin/iptables, [--wait -t filter -n -L DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -n -L DOCKER-ISOLATION] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION -j RETURN] 
DEBU[0001] /sbin/iptables, [--wait -A DOCKER-ISOLATION -j RETURN] 
DEBU[0001] /sbin/iptables, [--wait -t filter -n -L DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C DOCKER-USER -j RETURN] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -D FORWARD -j DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -I FORWARD -j DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -n -L DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C DOCKER-USER -j RETURN] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -D FORWARD -j DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -I FORWARD -j DOCKER-USER] 
INFO[0001] Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address 
DEBU[0001] Allocating IPv4 pools for network bridge (ad7e70e3da28bdd4b27db9760b605220e5db6ef46ec8411e437605508c835e97) 
DEBU[0001] RequestPool(LocalDefault, 172.17.0.0/16, , map[], false) 
DEBU[0001] RequestAddress(LocalDefault/172.17.0.0/16, 172.17.0.1, map[RequestAddressType:com.docker.network.gateway]) 
DEBU[0001] /sbin/iptables, [--wait -t nat -C POSTROUTING -s 172.17.0.0/16 ! -o docker0 -j MASQUERADE] 
DEBU[0001] /sbin/iptables, [--wait -t nat -C DOCKER -i docker0 -j RETURN] 
DEBU[0001] /sbin/iptables, [--wait -t nat -I DOCKER -i docker0 -j RETURN] 
DEBU[0001] /sbin/iptables, [--wait -D FORWARD -i docker0 -o docker0 -j DROP] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -i docker0 -o docker0 -j ACCEPT] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -i docker0 ! -o docker0 -j ACCEPT] 
DEBU[0001] /sbin/iptables, [--wait -t nat -C PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t nat -A PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t nat -C OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8] 
DEBU[0001] /sbin/iptables, [--wait -t nat -A OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -j DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -j DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-ISOLATION] 
DEBU[0001] /sbin/iptables, [--wait -D FORWARD -j DOCKER-ISOLATION] 
DEBU[0001] /sbin/iptables, [--wait -I FORWARD -j DOCKER-ISOLATION] 
DEBU[0001] /sbin/iptables, [--wait -t filter -n -L DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C DOCKER-USER -j RETURN] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -D FORWARD -j DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -I FORWARD -j DOCKER-USER] 
INFO[0001] Loading containers: done.                    
INFO[0001] Daemon has completed initialization          
INFO[0001] Docker daemon                                 commit=cec0b72 graphdriver=aufs version=17.06.2-ce
DEBU[0001] Registering routers                          
DEBU[0001] Registering GET, /containers/{name:.*}/checkpoints 
DEBU[0001] Registering POST, /containers/{name:.*}/checkpoints 
DEBU[0001] Registering DELETE, /containers/{name}/checkpoints/{checkpoint} 
DEBU[0001] Registering HEAD, /containers/{name:.*}/archive 
DEBU[0001] Registering GET, /containers/json            
DEBU[0001] Registering GET, /containers/{name:.*}/export 
DEBU[0001] Registering GET, /containers/{name:.*}/changes 
DEBU[0001] Registering GET, /containers/{name:.*}/json  
DEBU[0001] Registering GET, /containers/{name:.*}/top   
DEBU[0001] Registering GET, /containers/{name:.*}/logs  
DEBU[0001] Registering GET, /containers/{name:.*}/stats 
DEBU[0001] Registering GET, /containers/{name:.*}/attach/ws 
DEBU[0001] Registering GET, /exec/{id:.*}/json          
DEBU[0001] Registering GET, /containers/{name:.*}/archive 
DEBU[0001] Registering POST, /containers/create         
DEBU[0001] Registering POST, /containers/{name:.*}/kill 
DEBU[0001] Registering POST, /containers/{name:.*}/pause 
DEBU[0001] Registering POST, /containers/{name:.*}/unpause 
DEBU[0001] Registering POST, /containers/{name:.*}/restart 
DEBU[0001] Registering POST, /containers/{name:.*}/start 
DEBU[0001] Registering POST, /containers/{name:.*}/stop 
DEBU[0001] Registering POST, /containers/{name:.*}/wait 
DEBU[0001] Registering POST, /containers/{name:.*}/resize 
DEBU[0001] Registering POST, /containers/{name:.*}/attach 
DEBU[0001] Registering POST, /containers/{name:.*}/copy 
DEBU[0001] Registering POST, /containers/{name:.*}/exec 
DEBU[0001] Registering POST, /exec/{name:.*}/start      
DEBU[0001] Registering POST, /exec/{name:.*}/resize     
DEBU[0001] Registering POST, /containers/{name:.*}/rename 
DEBU[0001] Registering POST, /containers/{name:.*}/update 
DEBU[0001] Registering POST, /containers/prune          
DEBU[0001] Registering PUT, /containers/{name:.*}/archive 
DEBU[0001] Registering DELETE, /containers/{name:.*}    
DEBU[0001] Registering GET, /images/json                
DEBU[0001] Registering GET, /images/search              
DEBU[0001] Registering GET, /images/get                 
DEBU[0001] Registering GET, /images/{name:.*}/get       
DEBU[0001] Registering GET, /images/{name:.*}/history   
DEBU[0001] Registering GET, /images/{name:.*}/json      
DEBU[0001] Registering POST, /commit                    
DEBU[0001] Registering POST, /images/load               
DEBU[0001] Registering POST, /images/create             
DEBU[0001] Registering POST, /images/{name:.*}/push     
DEBU[0001] Registering POST, /images/{name:.*}/tag      
DEBU[0001] Registering POST, /images/prune              
DEBU[0001] Registering DELETE, /images/{name:.*}        
DEBU[0001] Registering OPTIONS, /{anyroute:.*}          
DEBU[0001] Registering GET, /_ping                      
DEBU[0001] Registering GET, /events                     
DEBU[0001] Registering GET, /info                       
DEBU[0001] Registering GET, /version                    
DEBU[0001] Registering GET, /system/df                  
DEBU[0001] Registering POST, /auth                      
DEBU[0001] Registering GET, /volumes                    
DEBU[0001] Registering GET, /volumes/{name:.*}          
DEBU[0001] Registering POST, /volumes/create            
DEBU[0001] Registering POST, /volumes/prune             
DEBU[0001] Registering DELETE, /volumes/{name:.*}       
DEBU[0001] Registering POST, /build                     
DEBU[0001] Registering POST, /swarm/init                
DEBU[0001] Registering POST, /swarm/join                
DEBU[0001] Registering POST, /swarm/leave               
DEBU[0001] Registering GET, /swarm                      
DEBU[0001] Registering GET, /swarm/unlockkey            
DEBU[0001] Registering POST, /swarm/update              
DEBU[0001] Registering POST, /swarm/unlock              
DEBU[0001] Registering GET, /services                   
DEBU[0001] Registering GET, /services/{id}              
DEBU[0001] Registering POST, /services/create           
DEBU[0001] Registering POST, /services/{id}/update      
DEBU[0001] Registering DELETE, /services/{id}           
DEBU[0001] Registering GET, /services/{id}/logs         
DEBU[0001] Registering GET, /nodes                      
DEBU[0001] Registering GET, /nodes/{id}                 
DEBU[0001] Registering DELETE, /nodes/{id}              
DEBU[0001] Registering POST, /nodes/{id}/update         
DEBU[0001] Registering GET, /tasks                      
DEBU[0001] Registering GET, /tasks/{id}                 
DEBU[0001] Registering GET, /tasks/{id}/logs            
DEBU[0001] Registering GET, /secrets                    
DEBU[0001] Registering POST, /secrets/create            
DEBU[0001] Registering DELETE, /secrets/{id}            
DEBU[0001] Registering GET, /secrets/{id}               
DEBU[0001] Registering POST, /secrets/{id}/update       
DEBU[0001] Registering GET, /configs                    
DEBU[0001] Registering POST, /configs/create            
DEBU[0001] Registering DELETE, /configs/{id}            
DEBU[0001] Registering GET, /configs/{id}               
DEBU[0001] Registering POST, /configs/{id}/update       
DEBU[0001] Registering GET, /plugins                    
DEBU[0001] Registering GET, /plugins/{name:.*}/json     
DEBU[0001] Registering GET, /plugins/privileges         
DEBU[0001] Registering DELETE, /plugins/{name:.*}       
DEBU[0001] Registering POST, /plugins/{name:.*}/enable  
DEBU[0001] Registering POST, /plugins/{name:.*}/disable 
DEBU[0001] Registering POST, /plugins/pull              
DEBU[0001] Registering POST, /plugins/{name:.*}/push    
DEBU[0001] Registering POST, /plugins/{name:.*}/upgrade 
DEBU[0001] Registering POST, /plugins/{name:.*}/set     
DEBU[0001] Registering POST, /plugins/create            
DEBU[0001] Registering GET, /distribution/{name:.*}/json 
DEBU[0001] Registering GET, /networks                   
DEBU[0001] Registering GET, /networks/                  
DEBU[0001] Registering GET, /networks/{id:.+}           
DEBU[0001] Registering POST, /networks/create           
DEBU[0001] Registering POST, /networks/{id:.*}/connect  
DEBU[0001] Registering POST, /networks/{id:.*}/disconnect 
DEBU[0001] Registering POST, /networks/prune            
DEBU[0001] Registering DELETE, /networks/{id:.*}        
INFO[0001] API listen on /var/run/docker.sock           
DEBU[0003] Calling GET /_ping                           
DEBU[0003] Calling POST /v1.30/images/create?fromImage=docker.example.com%2Fexample%2Fsdn-web&tag=dev 
DEBU[0003] hostDir: /etc/docker/certs.d/docker.example.com 
DEBU[0003] Trying to pull docker.example.com/example/sdn-web from https://docker.example.com v2 
DEBU[0003] Pulling ref from V2 registry: docker.example.com/example/sdn-web:dev 
DEBU[0003] pulling blob "sha256:9dca49a3b1201458a6f853fb6798684b061437163f0bb96fd021ede26e0dd145" 
DEBU[0003] pulling blob "sha256:88286f41530e93dffd4b964e1db22ce4939fffa4a4c665dab8591fbab03d4926" 
DEBU[0003] pulling blob "sha256:cf196aa71150120c980916e82a912b929a5caa7dcfef909aa67a2f086d35942e" 
dev: Pulling from  #example/sdn-web
88286f41530e: Downloading [>                                                  ]  32.25kB/1.99MB
9dca49a3b120: Pulling fs layer 
cf196aa71150: Pulling fs layer 
9dca49a3b120: Download complete 
88286f41530e: Extracting [==================================================>]   1.99MB/1.99MB
a2b5f806716a: Waiting 
cf196aa71150: Downloading [==========>                                        ]  6.553MB/31.32MB
f3004e331b8c: Downloading [>                                                  ]  48.63kB/4.335MB
cf196aa71150: Downloading [==================>                                ]  11.47MB/31.32MB
f3004e331b8c: Downloading [=======================>                           ]  2.064MB/4.335MB
a638c359d6fc: Downloading [===============>                                   ]  3.932MB/12.41MB
cf196aa71150: Downloading [============================>                      ]  18.02MB/31.32MB
cf196aa71150: Downloading [===============================================>   ]  29.49MB/31.32MB
cf196aa71150: Download complete 
a638c359d6fc: Download complete 
DEBU[0003] Downloaded a638c359d6fc to tempfile /var/lib/docker/tmp/GetImageBlob215982109 
DEBU[0003] Downloaded cf196aa71150 to tempfile /var/lib/docker/tmp/GetImageBlob103352691 
INFO[0003] Attempting next endpoint for pull after error: failed to register layer: Error processing tar file(exit status 1): invalid argument 
failed to register layer: Error processing tar file(exit status 1): invalid argument
DEBU[0003] Calling GET /_ping                           
DEBU[0003] Calling POST /v1.30/images/create?fromImage=docker.example.com%2Fexample%2Fdhcp-server&tag=dev 
DEBU[0003] hostDir: /etc/docker/certs.d/docker.example.com 
DEBU[0003] Trying to pull docker.example.com/example/dhcp-server from https://docker.example.com v2 
DEBU[0003] Pulling ref from V2 registry: docker.example.com/example/dhcp-server:dev 
DEBU[0003] pulling blob "sha256:f25e451100bc39f358a4934ccbc004b987992c426857086f61499ee726f7e845" 
DEBU[0003] pulling blob "sha256:2dbe4abf311d67ec224f926d4b21b9be6f96dfba9be139e6936156a67b75a1ad" 
DEBU[0003] pulling blob "sha256:7ae2bc99836a3d8b74c62d43d8294da509c895b2d7f409c3be0b23a3a1ecb6ec" 
dev: Pulling from example/dhcp-server
f25e451100bc: Pulling fs layer 
2dbe4abf311d: Downloading [==>                                                ]  3.577kB/71.48kB
2dbe4abf311d: Download complete 
2dbe4abf311d: Downloading [==================================================>]  71.48kB/71.48kB
57c2f519b1e5: Waiting 
f25e451100bc: Downloading [>                                                  ]  540.1kB/65.79MB
cd04ee32e601: Waiting 
218f6d046559: Waiting 
a3ed95caeb02: Download complete 
57c2f519b1e5: Downloading [>                                                  ]  540.1kB/118.5MB
DEBU[0003] Downloaded 7ae2bc99836a to tempfile /var/lib/docker/tmp/GetImageBlob653997452 
f25e451100bc: Downloading [===============================================>   ]  62.18MB/65.79MB
f25e451100bc: Extracting [=========>                                         ]  12.26MB/65.79MB
f25e451100bc: Extracting [==================================================>]  65.79MB/65.79MB
DEBU[0003] Downloaded 3c2cd0026e1f to tempfile /var/lib/docker/tmp/GetImageBlob718051173 
57c2f519b1e5: Downloading [===================>                               ]  45.42MB/118.5MB
57c2f519b1e5: Downloading [==============================================>    ]  110.3MB/118.5MB
57c2f519b1e5: Download complete 
218f6d046559: Downloading [==================================================>]     281B/281B
049bc9893912: Download complete 
DEBU[0004] Downloaded f25e451100bc to tempfile /var/lib/docker/tmp/GetImageBlob815346634 
DEBU[0005] Downloaded 57c2f519b1e5 to tempfile /var/lib/docker/tmp/GetImageBlob201051806 
DEBU[0007] Cleaning up layer fb7164d9df1c7cdb94d85cd570b96cb64c3f5aebd93dcf4ede0bfa02b3404ef1: Error processing tar file(exit statcd04ee32e601: Download complete 
INFO[0007] Attempting next endpoint for pull after error: failed to register layer: Error processing tar file(exit status 1): invalid argument 
failed to register layer: Error processing tar file(exit status 1): invalid argument
DEBU[0007] Calling GET /_ping                           
DEBU[0007] Calling GET /v1.30/images/json               
REPOSITORY          TAG                 IMAGE ID            CREATED             SIZE
INFO[0007] Processing signal 'terminated'               
DEBU[0007] start clean shutdown of all containers with a 15 seconds timeout... 
DEBU[0007] Cleaning up old mountid : start.             
DEBU[0007] Unix socket /run/docker/libnetwork/a1398bd73097fa4fda6f1a99f0b52245dec253ccc580ef7aaba9668fdf225f57.sock doesn't exist. cannot accept client connections 
DEBU[0007] Cleaning up old mountid : done.              
DEBU[0007] Clean shutdown succeeded                     
INFO[0007] stopping containerd after receiving terminated 
DEBU[0008] libcontainerd: containerd health check returned error: rpc error: code = 9 desc = grpc: the client connection is closing 

Additional environment details (AWS, VirtualBox, physical, etc.)
vm disk image building process (use https://docs.openstack.org/diskimage-builder/latest/index.html)

@linarnan linarnan changed the title docker pull fail with failed to register layer docker pull fail with failed to register layer: Error processing tar file(exit status 1): invalid argument Sep 6, 2017
@linarnan
Copy link
Author

linarnan commented Sep 7, 2017

same as this issue
i'm in uncompatiable Backing filesystem : tmpfs

Containers: 0
 Running: 0
 Paused: 0
 Stopped: 0
Images: 0
Server Version: 17.06.2-ce
Storage Driver: aufs
 Root Dir: /var/lib/docker/aufs
 Backing Filesystem: tmpfs
 Dirs: 0
 Dirperm1 Supported: false
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins: 
 Volume: local
 Network: bridge host macvlan null overlay
 Log: awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 6e23458c129b551d5c9871e5174f6b1b7f6d1170
runc version: 810190ceaa507aa2727d7ae6f4790c76ec150bd2
init version: 949e6fa
Kernel Version: 4.4.0-93-generic
Operating System: Ubuntu 14.04.5 LTS
OSType: linux
Architecture: x86_64
CPUs: 8
Total Memory: 7.677GiB
Name: linarnan-ubuntu
ID: XLPG:RGIB:UTIS:I44Q:AO4A:4NZJ:4VQL:SXK3:54B2:OQCQ:V62F:URNR
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Experimental: false
Insecure Registries:
 127.0.0.0/8
Live Restore Enabled: false

just close this.

@linarnan linarnan closed this as completed Sep 7, 2017
@linarnan linarnan reopened this Sep 12, 2017
@linarnan
Copy link
Author

after given image-disk-create --no-tmpfs ...
able to use backing filesystem with ext4 but still have same problem here

@linarnan
Copy link
Author

build cmd:
disk-image-create -a amd64 --no-tmpfs --install-type package --image-size 5G -o ubuntu-${DIB_RELEASE}.qcow2 ubuntu bootloader devuser local-config openssh-server cleanup-kernel-initrd cloud-init-datasources

@pillarlei
Copy link

pillarlei commented Jul 25, 2018

I have the same

pillarlei@DESKTOP-V3N3P9H:~$ sudo docker pull redis
Using default tag: latest
latest: Pulling from library/redis
be8881be8156: Extracting [==================================================>] 22.49MB/22.49MB
d6f5ea773ca3: Download complete
735cc65c0db4: Download complete
ff89c30e4d8c: Download complete
59bf782a86b3: Download complete
ce8aaa9fe90a: Download complete
failed to register layer: Error processing tar file(exit status 1): invalid argument

pillarlei@DESKTOP-V3N3P9H:~$ docker info
Containers: 0
Running: 0
Paused: 0
Stopped: 0
Images: 0
Server Version: 18.06.0-ce
Storage Driver: overlay2
Backing Filesystem:
Supports d_type: true
Native Overlay Diff: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
Volume: local
Network: bridge host macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: d64c661f1d51c48782c9cec8fda7604785f93587
runc version: 69663f0bd4b60df09991c08812a60108003fa340
init version: fec3683
Kernel Version: 4.4.0-17134-Microsoft
Operating System: Ubuntu 18.04 LTS
OSType: linux
Architecture: x86_64
CPUs: 8
Total Memory: 15.89GiB
Name: DESKTOP-V3N3P9H
ID: 3H42:T2GW:QWLI:AMZW:YKTH:3QCI:H5IL:SWYC:G337:PO2F:SIZQ:4CYI
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
127.0.0.0/8
Live Restore Enabled: false

WARNING: No memory limit support
WARNING: No swap limit support
WARNING: No kernel memory limit support
WARNING: No oom kill disable support
WARNING: No cpu cfs quota support
WARNING: No cpu cfs period support
WARNING: No cpu shares support
WARNING: No cpuset support

how can I deal with it.

@linarnan
Copy link
Author

linarnan commented Sep 19, 2018

another same post here: moby/moby#34817 ,
maybe u can found solution there. (i haven't found solution yet)
are you in some chroot/ vm env. ?

@hitendra26
Copy link

I have same issue. However, I am in chroot environment. Wondering if it's possible to make docker work in such environment.

./docker info

DEBU[2019-05-27T14:15:14.212268660Z] Calling GET /_ping
DEBU[2019-05-27T14:15:14.213233780Z] Calling GET /v1.39/info
WARN[2019-05-27T14:15:14.214784160Z] Could not get operating system name: Error opening /usr/lib/os-release: open /usr/lib/os-release: no such file or directory
Containers: 0
Running: 0
Paused: 0
Stopped: 0
Images: 0
Server Version: 18.09.4
Storage Driver: overlay2
Backing Filesystem: extfs
Supports d_type: true
Native Overlay Diff: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
Volume: local
Network: bridge host macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: bb71b10fd8f58240ca47fbb579b9d1028eea7c84
runc version: 2b18fe1d885ee5083ef9f0838fee39b62d653e30
init version: fec3683
Kernel Version: 4.1.51-ws-symbol
OSType: linux
Architecture: aarch64
CPUs: 2
Total Memory: 870.7MiB
Name: (none)
ID: AWJE:2XHF:F6IX:AFBY:RKSO:ZAD5:QORR:OWBG:RXWM:UHBC:24JT:PT55
Docker Root Dir: /mnt/usb/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
127.0.0.0/8
Live Restore Enabled: false

WARNING: No cpu cfs quota support
WARNING: No cpu cfs period support

./docker run hello-world

DEBU[2019-05-27T13:59:01.403488020Z] Calling GET /_ping
DEBU[2019-05-27T13:59:01.406786120Z] Calling POST /v1.39/containers/create
DEBU[2019-05-27T13:59:01.407900660Z] form data: {"AttachStderr":true,"AttachStdin":false,"AttachStdout":true,"Cmd":null,"Domainname":"","Entrypoint":null,"Env":[],"HostConfig":{"AutoRemove":false,"Binds":null,"BlkioDeviceReadBps":null,"BlkioDeviceReadIOps":null,"BlkioDeviceWriteBps":null,"BlkioDeviceWriteIOps":null,"BlkioWeight":0,"BlkioWeightDevice":[],"CapAdd":null,"CapDrop":null,"Cgroup":"","CgroupParent":"","ConsoleSize":[0,0],"ContainerIDFile":"","CpuCount":0,"CpuPercent":0,"CpuPeriod":0,"CpuQuota":0,"CpuRealtimePeriod":0,"CpuRealtimeRuntime":0,"CpuShares":0,"CpusetCpus":"","CpusetMems":"","DeviceCgroupRules":null,"Devices":[],"DiskQuota":0,"Dns":[],"DnsOptions":[],"DnsSearch":[],"ExtraHosts":null,"GroupAdd":null,"IOMaximumBandwidth":0,"IOMaximumIOps":0,"IpcMode":"","Isolation":"","KernelMemory":0,"Links":null,"LogConfig":{"Config":{},"Type":""},"MaskedPaths":null,"Memory":0,"MemoryReservation":0,"MemorySwap":0,"MemorySwappiness":-1,"NanoCpus":0,"NetworkMode":"default","OomKillDisable":false,"OomScoreAdj":0,"PidMode":"","PidsLimit":0,"PortBindings":{},"Privileged":false,"PublishAllPorts":false,"ReadonlyPaths":null,"ReadonlyRootfs":false,"RestartPolicy":{"MaximumRetryCount":0,"Name":"no"},"SecurityOpt":null,"ShmSize":0,"UTSMode":"","Ulimits":null,"UsernsMode":"","VolumeDriver":"","VolumesFrom":null},"Hostname":"","Image":"hello-world","Labels":{},"NetworkingConfig":{"EndpointsConfig":{}},"OnBuild":null,"OpenStdin":false,"StdinOnce":false,"Tty":false,"User":"","Volumes":{},"WorkingDir":""}
Unable to find image 'hello-world:latest' locally
DEBU[2019-05-27T13:59:01.413317800Z] Calling GET /v1.39/info
WARN[2019-05-27T13:59:01.414791760Z] Could not get operating system name: Error opening /usr/lib/os-release: open /usr/lib/os-release: no such file or directory
DEBU[2019-05-27T13:59:01.438037600Z] Calling POST /v1.39/images/create?fromImage=hello-world&tag=latest
DEBU[2019-05-27T13:59:01.438664080Z] Trying to pull hello-world from https://registry-1.docker.io v2
DEBU[2019-05-27T13:59:02.340561960Z] Pulling ref from V2 registry: hello-world:latest
DEBU[2019-05-27T13:59:02.340799640Z] docker.io/library/hello-world:latest resolved to a manifestList object with 9 entries; looking for a unknown/arm match
DEBU[2019-05-27T13:59:02.340851620Z] found deprecated partial match for linux/arm/v8 with media type application/vnd.docker.distribution.manifest.v2+json, digest sha256:1e44d8bca6fb0464794555e5ccd3a32e2a4f6e44a20605e4e82605189904f44d
DEBU[2019-05-27T13:59:02.340898100Z] found deprecated partial match for linux/arm/v8 with media type application/vnd.docker.distribution.manifest.v2+json, digest sha256:d1fd2e204af0a2bca3ab033b417b29c76d7950ed29a44e427d1c4d07d14f04f9
DEBU[2019-05-27T13:59:02.340938600Z] found multiple matches in manifest list, choosing best match sha256:1e44d8bca6fb0464794555e5ccd3a32e2a4f6e44a20605e4e82605189904f44d
latest: Pulling from library/hello-world
DEBU[2019-05-27T13:59:02.498004860Z] pulling blob "sha256:590e13f69e4afcc08e9060a320ec5e4622d2771ace9dc26b024dc786fcb5b36e"
590e13f69e4a: Downloading 1.027kB/1.027kB
590e13f69e4a: Extracting 1.027kB/1.027kB
590e13f69e4a: Extracting 1.027kB/1.027kB
DEBU[2019-05-27T13:59:03.433254360Z] Cleaning up layer 22e8d4d817b6220a7884a028ba7b1e52b09f83b760a34acc3b9ffaf07f1f4cc4: Error processing tar file(exit status 1): invalid argument
INFO[2019-05-27T13:59:03.434607560Z] Attempting next endpoint for pull after error: failed to register layer: Error processing tar file(exit status 1): invalid argument
./docker: failed to register layer: Error processing tar file(exit status 1): invalid argument.
See './docker run --help'.

@mike-bioinfo
Copy link

mike-bioinfo commented Apr 25, 2021

I solved this problem reading this info:

https://docs.docker.com/engine/security/rootless/#docker-pull-errors

I figured it out reading this link:

https://docs.oracle.com/cd/E37670_01/E75728/html/ol-docker-userns-remap.html

And increasing those value contained in those files (/etc/subuid and /etc/subgid) and reboot (not mentioned) as this link recommended:

https://ubuntu.com/blog/custom-user-mappings-in-lxd-containers

The only thing that I noticed is that my path to the storage disk was renamed from "DATA" to "DATA1" and I don't know why this happened. DATA is innaccesible from terminal with the typical "permission denied" message and from GUI file browser it appeared as always "DATA". But hey, I finally was able to pull the image that I wanted and I can continue with my life happily ever after. :D!

UPDATE: I had to change back those values for /etc/subuid and /etc/subgid since my storage disk (ntfs filesystem) was changing names every time I rebooted. It looks like that strange behavior is because ntfs is not supported to do this kind of things, a solution was change back default parameter in /etc/docker/daemon.json file, run docker pull "image", then move all folders from /var/lib/docker/ to the new location (ntfs disk) following these instructions

https://www.guguweb.com/2019/02/07/how-to-move-docker-data-directory-to-another-location-on-ubuntu/

I had to move it to another location because my ssd is very small and those images are quite big to be stored in my ssd.

I hope this could help you guys.

@kexul
Copy link

kexul commented Sep 26, 2023

@mike-bioinfo try this one, https://pdiway.com/articles/how-to-move-docker-data-directory/, it solved my issue with ntfs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants