/dev/shm troubles in docker 1.4.1 #9820

bobrik · 2014-12-26T19:20:50Z

This doesn't work:

root@callisto ~ $ docker run --rm ubuntu:14.04 date
FATA[0000] Error response from daemon: mkdir /home/docker/overlay/d2dbd3b3186dc7899502af99203459dc083b210c6c6efbb69d01ee871f534565-init/merged/dev/shm: invalid argument

But this works:

root@callisto ~ $ docker run --rm busybox date
Fri Dec 26 19:19:18 UTC 2014

root@callisto ~ $ docker info
Containers: 6
Images: 50
Storage Driver: overlay
Execution Driver: native-0.2
Kernel Version: 3.18.1-031801-generic
Operating System: Ubuntu 14.04.1 LTS
CPUs: 2
Total Memory: 3.791 GiB
Name: callisto
ID: ZWU6:UVBQ:HL5R:AAB5:GKYQ:2MSR:UPQW:TN6H:32C4:JJFX:WLWA:YPNZ
WARNING: No swap limit support

cc @alexlarsson

The text was updated successfully, but these errors were encountered:

xiaods · 2014-12-27T06:14:05Z

in my env, It works like a charm.

$ docker info
Containers: 3
Images: 56
Storage Driver: aufs
 Root Dir: /mnt/sda1/var/lib/docker/aufs
 Dirs: 62
Execution Driver: native-0.2
Kernel Version: 3.16.7-tinycore64
Operating System: Boot2Docker 1.4.1 (TCL 5.4); master : 86f7ec8 - Tue Dec 16 23:11:29 UTC 2014
CPUs: 8
Total Memory: 1.961 GiB
Name: boot2docker
ID: 2XCF:IDQ7:LAT7:TE7R:GZVX:DC7L:VSJA:2JZF:4U5J:QPMM:RQIQ:77BV
Debug mode (server): true
Debug mode (client): false
Fds: 12
Goroutines: 15
EventsListeners: 0
Init Path: /usr/local/bin/docker
Docker Root Dir: /mnt/sda1/var/lib/docker
Username: xds2000
Registry: [https://index.docker.io/v1/]
dxiao at localhost in ~
$ docker version
Client version: 1.4.1
Client API version: 1.16
Go version (client): go1.3.3
Git commit (client): 5bc2ff8
OS/Arch (client): darwin/amd64
Server version: 1.4.1
Server API version: 1.16
Go version (server): go1.3.3
Git commit (server): 5bc2ff8
$ docker images
REPOSITORY                TAG                 IMAGE ID            CREATED             VIRTUAL SIZE
ubuntu                    14.04               04c5d3b7b065        11 days ago         192.7 MB
dxiao at localhost in ~
$ docker run --rm ubuntu:14.04 date
Sat Dec 27 06:13:03 UTC 2014

please check ImagesID

bobrik · 2014-12-27T09:30:13Z

@xiaods you use aufs, I use overlayfs. It works if I use btrfs, but I want overlayfs.

Here's what strace says:

[pid  8564] <... epoll_wait resumed> {{EPOLLIN, {u32=3746114920, u64=140509306236264}}}, 128, -1) = 1
[pid  8564] futex(0x12a01b8, FUTEX_WAKE, 1) = 1
[pid  8560] <... futex resumed> )       = 0
[pid  8564] accept4(7,  <unfinished ...>
[pid  8560] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid  8564] <... accept4 resumed> {sa_family=AF_INET, sin_port=htons(46620), sin_addr=inet_addr("127.0.0.1")}, [16], SOCK_CLOEXEC|SOCK_NONBLOCK) = 8
[pid  8560] <... select resumed> )      = 0 (Timeout)
[pid  8564] epoll_ctl(6, EPOLL_CTL_ADD, 8, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=3746114744, u64=140509306236088}} <unfinished ...>
[pid  8560] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid  8564] <... epoll_ctl resumed> )   = 0
[pid  8564] getsockname(8, {sa_family=AF_INET, sin_port=htons(2375), sin_addr=inet_addr("127.0.0.1")}, [16]) = 0
[pid  8560] <... select resumed> )      = 0 (Timeout)
[pid  8564] setsockopt(8, SOL_TCP, TCP_NODELAY, [1], 4 <unfinished ...>
[pid  8560] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid  8564] <... setsockopt resumed> )  = 0
[pid  8564] accept4(7,  <unfinished ...>
[pid  8560] <... select resumed> )      = 0 (Timeout)
[pid  8564] <... accept4 resumed> 0xc2081efab8, [112], SOCK_CLOEXEC|SOCK_NONBLOCK) = -1 EAGAIN (Resource temporarily unavailable)
[pid  8560] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid  8564] read(8, 0xc208193000, 4096) = -1 EAGAIN (Resource temporarily unavailable)
[pid  8560] <... select resumed> )      = 0 (Timeout)
[pid  8564] epoll_wait(6,  <unfinished ...>
[pid  8560] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid  8564] <... epoll_wait resumed> {{EPOLLOUT, {u32=3746114744, u64=140509306236088}}}, 128, 0) = 1
[pid  8564] epoll_wait(6,  <unfinished ...>
[pid  8560] <... select resumed> )      = 0 (Timeout)
[pid  8560] futex(0x12a01b8, FUTEX_WAIT, 0, NULL <unfinished ...>
[pid  8564] <... epoll_wait resumed> {{EPOLLIN|EPOLLOUT, {u32=3746114744, u64=140509306236088}}}, 128, -1) = 1
[pid  8564] futex(0x12a01b8, FUTEX_WAKE, 1) = 1
[pid  8560] <... futex resumed> )       = 0
[pid  8564] read(8,  <unfinished ...>
[pid  8560] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid  8564] <... read resumed> "POST /v1.16/containers/create HT"..., 4096) = 906
[pid  8560] <... select resumed> )      = 0 (Timeout)
[pid  8560] select(0, NULL, NULL, NULL, {0, 20}) = 0 (Timeout)
[pid  8560] select(0, NULL, NULL, NULL, {0, 20}) = 0 (Timeout)
[pid  8560] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid  8564] write(2, "\33[34mINFO\33[0m[0169] POST /v1.16/"..., 66 <unfinished ...>
[pid  8560] <... select resumed> )      = 0 (Timeout)
[pid  8564] <... write resumed> )       = 66
[pid  8560] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid  8564] write(2, "\33[34mINFO\33[0m[0169] +job create("..., 66) = 66
[pid  8560] <... select resumed> )      = 0 (Timeout)
[pid  8564] open("/home/docker/repositories-overlay", O_RDONLY|O_CLOEXEC <unfinished ...>
[pid  8560] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid  8564] <... open resumed> )        = 9
[pid  8564] fstat(9,  <unfinished ...>
[pid  8560] <... select resumed> )      = 0 (Timeout)
[pid  8564] <... fstat resumed> {st_mode=S_IFREG|0600, st_size=333, ...}) = 0
[pid  8560] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid  8564] read(9, "{\"Repositories\":{\"ubuntu\":{\"14.0"..., 845) = 333
[pid  8560] <... select resumed> )      = 0 (Timeout)
[pid  8564] read(9,  <unfinished ...>
[pid  8560] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid  8564] <... read resumed> "", 512) = 0
[pid  8564] close(9 <unfinished ...>
[pid  8560] <... select resumed> )      = 0 (Timeout)
[pid  8564] <... close resumed> )       = 0
[pid  8560] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid  8564] open("/home/docker/graph/04c5d3b7b0656168630d3ba35d8889bd0e9caafcaeb3004d2bfbc47e7c5d35d2/json", O_RDONLY|O_CLOEXEC) = 9
[pid  8560] <... select resumed> )      = 0 (Timeout)
[pid  8564] read(9,  <unfinished ...>
[pid  8560] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid  8564] <... read resumed> "{\"id\":\"04c5d3b7b0656168630d3ba35"..., 512) = 512
[pid  8564] read(9, "tdin\":false,\"StdinOnce\":false,\"E"..., 1024) = 1024
[pid  8564] read(9, "\"Size\":0}\n", 2048) = 10
[pid  8564] open("/home/docker/graph/04c5d3b7b0656168630d3ba35d8889bd0e9caafcaeb3004d2bfbc47e7c5d35d2/layersize", O_RDONLY|O_CLOEXEC) = 10
[pid  8564] fstat(10, {st_mode=S_IFREG|0600, st_size=1, ...}) = 0
[pid  8564] read(10, "0", 513)          = 1
[pid  8564] read(10, "", 512)           = 0
[pid  8564] close(10)                   = 0
[pid  8564] close(9)                    = 0
[pid  8564] open("/home/docker/graph/d735006ad9c1b1563e021d7a4fecfd75ed36d4384e2a1c42e78d8261b83d6271/json", O_RDONLY|O_CLOEXEC) = 9
[pid  8564] read(9, "{\"id\":\"d735006ad9c1b1563e021d7a4"..., 512) = 512
[pid  8564] read(9, "tdin\":false,\"StdinOnce\":false,\"E"..., 1024) = 1024
[pid  8564] read(9, "795e040c69e0fb08078bcf8a745c0863"..., 2048) = 47
[pid  8564] open("/home/docker/graph/d735006ad9c1b1563e021d7a4fecfd75ed36d4384e2a1c42e78d8261b83d6271/layersize", O_RDONLY|O_CLOEXEC) = 10
[pid  8564] fstat(10, {st_mode=S_IFREG|0600, st_size=4, ...}) = 0
[pid  8564] read(10, "1895", 516)       = 4
[pid  8564] read(10, "", 512)           = 0
[pid  8564] close(10)                   = 0
[pid  8564] close(9)                    = 0
[pid  8564] open("/home/docker/graph/70c8faa62a44b9f6a70ec3a018ec14ec95717ebed2016430e57fec1abc90a879/json", O_RDONLY|O_CLOEXEC) = 9
[pid  8564] read(9, "{\"id\":\"70c8faa62a44b9f6a70ec3a01"..., 512) = 512
[pid  8564] read(9, "tdin\":false,\"StdinOnce\":false,\"E"..., 1024) = 1024
[pid  8564] read(9, "ir::Cache::pkgcache \\\"\\\"; Dir::C"..., 2048) = 1242
[pid  8564] open("/home/docker/graph/70c8faa62a44b9f6a70ec3a018ec14ec95717ebed2016430e57fec1abc90a879/layersize", O_RDONLY|O_CLOEXEC) = 10
[pid  8564] fstat(10, {st_mode=S_IFREG|0600, st_size=6, ...}) = 0
[pid  8564] read(10, "194533", 518)     = 6
[pid  8564] read(10, "", 512)           = 0
[pid  8564] close(10)                   = 0
[pid  8564] close(9)                    = 0
[pid  8564] open("/home/docker/graph/c7b7c64195686444123ef370322b5270b098c77dc2d62208e8a9ce28a11a63f9/json", O_RDONLY|O_CLOEXEC) = 9
[pid  8564] read(9, "{\"id\":\"c7b7c64195686444123ef3703"..., 512) = 512
[pid  8564] read(9, "tdin\":false,\"StdinOnce\":false,\"E"..., 1024) = 1024
[pid  8564] read(9, "8b41f47004d07312b8bc16dfb0cdd69b"..., 2048) = 72
[pid  8564] open("/home/docker/graph/c7b7c64195686444123ef370322b5270b098c77dc2d62208e8a9ce28a11a63f9/layersize", O_RDONLY|O_CLOEXEC) = 10
[pid  8564] fstat(10, {st_mode=S_IFREG|0600, st_size=9, ...}) = 0
[pid  8564] read(10, "192480298", 521)  = 9
[pid  8564] read(10, "", 512)           = 0
[pid  8564] close(10)                   = 0
[pid  8564] close(9)                    = 0
[pid  8564] open("/home/docker/graph/511136ea3c5a64f264b78b5433614aec563103b4d4702f3ba7d4d2698e22c158/json", O_RDONLY|O_CLOEXEC) = 9
[pid  8564] read(9, "{\"id\":\"511136ea3c5a64f264b78b543"..., 512) = 512
[pid  8564] read(9, "MacAddress\":\"\",\"OnBuild\":null},\""..., 1024) = 186
[pid  8564] open("/home/docker/graph/511136ea3c5a64f264b78b5433614aec563103b4d4702f3ba7d4d2698e22c158/layersize", O_RDONLY|O_CLOEXEC) = 10
[pid  8564] fstat(10, {st_mode=S_IFREG|0600, st_size=1, ...}) = 0
[pid  8564] read(10, "0", 513)          = 1
[pid  8564] read(10, "", 512)           = 0
[pid  8564] close(10)                   = 0
[pid  8564] close(9)                    = 0
[pid  8564] mmap(NULL, 134217728, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS|MAP_NORESERVE, -1, 0) = 0x7fcac6d7e000
[pid  8564] munmap(0x7fcac6d7e000, 19406848) = 0
[pid  8564] munmap(0x7fcacc000000, 47702016) = 0
[pid  8564] mprotect(0x7fcac8000000, 135168, PROT_READ|PROT_WRITE) = 0
[pid  8564] fcntl(5, F_SETLK, {type=F_RDLCK, whence=SEEK_SET, start=1073741824, len=1}) = 0
[pid  8564] fcntl(5, F_SETLK, {type=F_RDLCK, whence=SEEK_SET, start=1073741826, len=510}) = 0
[pid  8564] fcntl(5, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=1073741824, len=1}) = 0
[pid  8564] access("/home/docker/linkgraph.db-journal", F_OK) = -1 ENOENT (No such file or directory)
[pid  8564] fstat(5, {st_mode=S_IFREG|0644, st_size=5120, ...}) = 0
[pid  8564] lseek(5, 24, SEEK_SET)      = 24
[pid  8564] read(5, "\0\0\0\5\0\0\0\5\0\0\0\0\0\0\0\0", 16) = 16
[pid  8564] fstat(5, {st_mode=S_IFREG|0644, st_size=5120, ...}) = 0
[pid  8564] access("/home/docker/linkgraph.db-wal", F_OK) = -1 ENOENT (No such file or directory)
[pid  8564] fstat(5, {st_mode=S_IFREG|0644, st_size=5120, ...}) = 0
[pid  8564] fcntl(5, F_SETLK, {type=F_WRLCK, whence=SEEK_SET, start=1073741825, len=1}) = 0
[pid  8564] fcntl(5, F_SETLK, {type=F_WRLCK, whence=SEEK_SET, start=1073741824, len=1}) = 0
[pid  8564] fcntl(5, F_SETLK, {type=F_WRLCK, whence=SEEK_SET, start=1073741826, len=510}) = 0
[pid  8564] stat("/home/docker/linkgraph.db", {st_mode=S_IFREG|0644, st_size=5120, ...}) = 0
[pid  8564] open("/home/docker/linkgraph.db-journal", O_RDWR|O_CREAT|O_CLOEXEC, 0644) = 9
[pid  8564] fstat(9, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
[pid  8564] geteuid()                   = 0
[pid  8564] fchown(9, 0, 0)             = 0
[pid  8564] fstat(9, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
[pid  8564] lseek(9, 0, SEEK_SET)       = 0
[pid  8564] write(9, "\0\0\0\0\0\0\0\0\0\0\0\0\274\367\353\350\0\0\0\5\0\0\2\0\0\0\4\0\0\0\0\0"..., 512) = 512
[pid  8564] lseek(9, 512, SEEK_SET)     = 512
[pid  8564] write(9, "\0\0\0\3", 4)     = 4
[pid  8564] lseek(9, 516, SEEK_SET)     = 516
[pid  8564] write(9, "\n\0\0\0\2\3\265\0\3\373\3\265\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1024) = 1024
[pid  8564] lseek(9, 1540, SEEK_SET)    = 1540
[pid  8564] write(9, "\274\367\353\350", 4) = 4
[pid  8564] lseek(9, 1544, SEEK_SET)    = 1544
[pid  8564] write(9, "\0\0\0\2", 4)     = 4
[pid  8564] lseek(9, 1548, SEEK_SET)    = 1548
[pid  8564] write(9, "\r\0\0\0\2\3\266\0\3\373\3\266\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1024) = 1024
[pid  8564] lseek(9, 2572, SEEK_SET)    = 2572
[pid  8564] write(9, "\274\367\353\350", 4) = 4
[pid  8564] lseek(9, 2576, SEEK_SET)    = 2576
[pid  8564] write(9, "\0\0\0\5", 4)     = 4
[pid  8564] lseek(9, 2580, SEEK_SET)    = 2580
[pid  8564] write(9, "\n\0\0\0\2\3\345\0\3\372\3\345\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1024) = 1024
[pid  8564] lseek(9, 3604, SEEK_SET)    = 3604
[pid  8564] write(9, "\274\367\353\350", 4) = 4
[pid  8564] lseek(9, 3608, SEEK_SET)    = 3608
[pid  8564] write(9, "\0\0\0\4", 4)     = 4
[pid  8564] lseek(9, 3612, SEEK_SET)    = 3612
[pid  8564] write(9, "\r\0\0\0\2\3\242\0\3\370\3\242\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1024) = 1024
[pid  8564] lseek(9, 4636, SEEK_SET)    = 4636
[pid  8564] write(9, "\274\367\353\350", 4) = 4
[pid  8564] lseek(9, 4640, SEEK_SET)    = 4640
[pid  8564] write(9, "\0\0\0\1", 4)     = 4
[pid  8564] lseek(9, 4644, SEEK_SET)    = 4644
[pid  8564] write(9, "SQLite format 3\0\4\0\1\1\0@  \0\0\0\5\0\0\0\5"..., 1024) = 1024
[pid  8564] lseek(9, 5668, SEEK_SET)    = 5668
[pid  8564] write(9, "\274\367\354\263", 4) = 4
[pid  8564] lseek(9, 6144, SEEK_SET)    = 6144
[pid  8564] read(9, "", 8)              = 0
[pid  8564] fsync(9 <unfinished ...>
[pid  8560] <... select resumed> )      = 0 (Timeout)
[pid  8560] epoll_wait(6, {}, 128, 0)   = 0
[pid  8560] select(0, NULL, NULL, NULL, {0, 20}) = 0 (Timeout)
[pid  8560] futex(0xc2080189f0, FUTEX_WAKE, 1 <unfinished ...>
[pid  8583] <... futex resumed> )       = 0
[pid  8583] epoll_wait(6, {}, 128, 0)   = 0
[pid  8583] epoll_wait(6,  <unfinished ...>
[pid  8560] <... futex resumed> )       = 1
[pid  8560] select(0, NULL, NULL, NULL, {0, 20}) = 0 (Timeout)
[pid  8560] futex(0x12a01b8, FUTEX_WAIT, 0, NULL <unfinished ...>
[pid  8564] <... fsync resumed> )       = 0
[pid  8564] open("/home/docker", O_RDONLY|O_CLOEXEC) = 10
[pid  8564] fsync(10)                   = 0
[pid  8564] close(10)                   = 0
[pid  8564] lseek(9, 0, SEEK_SET)       = 0
[pid  8564] write(9, "\331\325\5\371 \241c\327\0\0\0\5", 12) = 12
[pid  8564] fsync(9)                    = 0
[pid  8564] lseek(5, 0, SEEK_SET)       = 0
[pid  8564] write(5, "SQLite format 3\0\4\0\1\1\0@  \0\0\0\6\0\0\0\5"..., 1024) = 1024
[pid  8564] lseek(5, 1024, SEEK_SET)    = 1024
[pid  8564] write(5, "\r\0\0\0\3\3q\0\3\373\3\266\3q\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1024) = 1024
[pid  8564] lseek(5, 2048, SEEK_SET)    = 2048
[pid  8564] write(5, "\n\0\0\0\3\3o\0\3\373\3o\3\265\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1024) = 1024
[pid  8564] lseek(5, 3072, SEEK_SET)    = 3072
[pid  8564] write(5, "\r\0\0\0\3\3F\0\3\370\3\242\3F\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1024) = 1024
[pid  8564] lseek(5, 4096, SEEK_SET)    = 4096
[pid  8564] write(5, "\n\0\0\0\3\3\312\0\3\372\3\312\3\345\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1024) = 1024
[pid  8564] fsync(5)                    = 0
[pid  8564] close(9)                    = 0
[pid  8564] unlink("/home/docker/linkgraph.db-journal") = 0
[pid  8564] fcntl(5, F_SETLK, {type=F_RDLCK, whence=SEEK_SET, start=1073741826, len=510}) = 0
[pid  8564] fcntl(5, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=1073741824, len=2}) = 0
[pid  8564] fcntl(5, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0
[pid  8564] futex(0x12a01b8, FUTEX_WAKE, 1) = 1
[pid  8564] fcntl(5, F_SETLK, {type=F_RDLCK, whence=SEEK_SET, start=1073741824, len=1}) = 0
[pid  8564] fcntl(5, F_SETLK, {type=F_RDLCK, whence=SEEK_SET, start=1073741826, len=510}) = 0
[pid  8564] fcntl(5, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=1073741824, len=1}) = 0
[pid  8564] access("/home/docker/linkgraph.db-journal", F_OK) = -1 ENOENT (No such file or directory)
[pid  8564] fstat(5, {st_mode=S_IFREG|0644, st_size=5120, ...}) = 0
[pid  8564] lseek(5, 24, SEEK_SET)      = 24
[pid  8564] read(5, "\0\0\0\6\0\0\0\5\0\0\0\0\0\0\0\0", 16) = 16
[pid  8564] fstat(5, {st_mode=S_IFREG|0644, st_size=5120, ...}) = 0
[pid  8564] access("/home/docker/linkgraph.db-wal", F_OK) = -1 ENOENT (No such file or directory)
[pid  8564] fstat(5, {st_mode=S_IFREG|0644, st_size=5120, ...}) = 0
[pid  8564] fcntl(5, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0
[pid  8564] mkdir("/home/docker/containers/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d", 0700) = 0
[pid  8564] stat("/home/docker/overlay", {st_mode=S_IFDIR|0755, st_size=778, ...}) = 0
[pid  8564] mkdir("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init", 0700) = 0
[pid  8564] lstat("/home/docker/overlay/04c5d3b7b0656168630d3ba35d8889bd0e9caafcaeb3004d2bfbc47e7c5d35d2", {st_mode=S_IFDIR|0700, st_size=8, ...}) = 0
[pid  8564] lstat("/home/docker/overlay/04c5d3b7b0656168630d3ba35d8889bd0e9caafcaeb3004d2bfbc47e7c5d35d2/root", {st_mode=S_IFDIR|0755, st_size=156, ...}) = 0
[pid  8564] mkdir("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/upper", 0755) = 0
[pid  8564] mkdir("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/work", 0700) = 0
[pid  8564] mkdir("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged", 0700) = 0
[pid  8564] open("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/lower-id", O_WRONLY|O_CREAT|O_TRUNC|O_CLOEXEC, 0666) = 9
[pid  8564] write(9, "04c5d3b7b0656168630d3ba35d8889bd"..., 64) = 64
[pid  8564] close(9)                    = 0
[pid  8564] stat("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init", {st_mode=S_IFDIR|0700, st_size=46, ...}) = 0
[pid  8564] stat("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/root", 0xc20969d7a0) = -1 ENOENT (No such file or directory)
[pid  8564] open("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/lower-id", O_RDONLY|O_CLOEXEC) = 9
[pid  8564] fstat(9, {st_mode=S_IFREG|0644, st_size=64, ...}) = 0
[pid  8564] read(9, "04c5d3b7b0656168630d3ba35d8889bd"..., 576) = 64
[pid  8564] read(9, "", 512)            = 0
[pid  8564] close(9)                    = 0
[pid  8564] mount("overlay", "/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged", "overlay", 0, "lowerdir=/home/docker/overlay/04"...) = 0
[pid  8564] unlink("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/etc") = -1 EISDIR (Is a directory)
[pid  8564] unlink("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/etc/resolv.conf") = 0
[pid  8564] stat("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/etc/resolv.conf", 0xc20969d8c0) = -1 ENOENT (No such file or directory)
[pid  8564] stat("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/etc", {st_mode=S_IFDIR|0755, st_size=22, ...}) = 0
[pid  8564] open("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/etc/resolv.conf", O_RDONLY|O_CREAT|O_CLOEXEC, 0755) = 9
[pid  8564] close(9)                    = 0
[pid  8564] unlink("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/etc") = -1 EISDIR (Is a directory)
[pid  8564] unlink("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/etc/hosts") = 0
[pid  8564] stat("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/etc/hosts", 0xc20969d9e0) = -1 ENOENT (No such file or directory)
[pid  8564] stat("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/etc", {st_mode=S_IFDIR|0755, st_size=32, ...}) = 0
[pid  8564] open("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/etc/hosts", O_RDONLY|O_CREAT|O_CLOEXEC, 0755) = 9
[pid  8564] close(9)                    = 0
[pid  8564] unlink("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/etc") = -1 EISDIR (Is a directory)
[pid  8564] unlink("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/etc/hostname") = 0
[pid  8564] stat("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/etc/hostname", 0xc20969db00) = -1 ENOENT (No such file or directory)
[pid  8564] stat("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/etc", {st_mode=S_IFDIR|0755, st_size=48, ...}) = 0
[pid  8564] open("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/etc/hostname", O_RDONLY|O_CREAT|O_CLOEXEC, 0755) = 9
[pid  8564] close(9)                    = 0
[pid  8564] unlink("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/dev") = -1 EISDIR (Is a directory)
[pid  8564] unlink("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/dev/shm") = 0
[pid  8564] stat("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/dev/shm", 0xc20969dc20) = -1 ENOENT (No such file or directory)
[pid  8564] stat("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/dev", {st_mode=S_IFDIR|0755, st_size=6, ...}) = 0
[pid  8564] stat("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/dev/shm", 0xc20969dd40) = -1 ENOENT (No such file or directory)
[pid  8564] stat("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/dev", {st_mode=S_IFDIR|0755, st_size=6, ...}) = 0
[pid  8564] mkdir("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/dev/shm", 0755) = -1 EINVAL (Invalid argument)
[pid  8564] lstat("/home/docker/overlay/009c7b75064616113c5bd9a3cdc133bc78fa7b2ea250fda45d730a205491d52d-init/merged/dev/shm", 0xc20969de60) = -1 ENOENT (No such file or directory)
[pid  8564] umount("/home/docker/overlay/009c7b75064"..., 0 <unfinished ...>
[pid  8560] <... futex resumed> )       = 0
[pid  8560] select(0, NULL, NULL, NULL, {0, 20}) = 0 (Timeout)
[pid  8560] futex(0x12a1110, FUTEX_WAKE, 1) = 1
[pid  8560] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid  8558] <... futex resumed> )       = 0
[pid  8558] epoll_wait(6,  <unfinished ...>
[pid  8560] <... select resumed> )      = 0 (Timeout)
[pid  8560] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid  8558] <... epoll_wait resumed> {}, 128, 0) = 0
[pid  8558] futex(0x12a1110, FUTEX_WAIT, 0, NULL <unfinished ...>
[pid  8560] <... select resumed> )      = 0 (Timeout)
[pid  8560] futex(0x12a01b8, FUTEX_WAIT, 0, NULL <unfinished ...>
[pid  8564] <... umount resumed> )      = 0
[pid  8564] futex(0x12a01b8, FUTEX_WAKE, 1) = 1
[pid  8564] write(2, "mkdir /home/docker/overlay/009c7"..., 130) = 130
[pid  8564] write(2, "\33[34mINFO\33[0m[0169] -job create("..., 66) = 66
[pid  8564] write(2, "\33[31mERRO\33[0m[0169] Handler for "..., 203) = 203
[pid  8564] write(2, "\33[31mERRO\33[0m[0169] HTTP Error: "..., 178) = 178
[pid  8564] write(8, "HTTP/1.1 500 Internal Server Err"..., 267) = 267
[pid  8564] read(8, 0xc208193000, 4096) = -1 EAGAIN (Resource temporarily unavailable)
[pid  8564] epoll_wait(6, {}, 128, 0)   = 0
[pid  8564] futex(0xc208077770, FUTEX_WAIT, 0, NULL <unfinished ...>
[pid  8560] <... futex resumed> )       = 0
[pid  8560] select(0, NULL, NULL, NULL, {0, 20}) = 0 (Timeout)
[pid  8583] <... epoll_wait resumed> {{EPOLLIN|EPOLLOUT|EPOLLRDHUP, {u32=3746114744, u64=140509306236088}}}, 128, -1) = 1
[pid  8583] futex(0x12a01b8, FUTEX_WAKE, 1) = 0
[pid  8583] read(8, "", 4096)           = 0
[pid  8583] epoll_ctl(6, EPOLL_CTL_DEL, 8, {0, {u32=1, u64=1}}) = 0
[pid  8583] close(8)                    = 0
[pid  8583] epoll_wait(6, {}, 128, 0)   = 0
[pid  8583] epoll_wait(6,  <unfinished ...>
[pid  8560] futex(0x12a01b8, FUTEX_WAIT, 0, NULL) = -1 EAGAIN (Resource temporarily unavailable)
[pid  8560] select(0, NULL, NULL, NULL, {0, 20}) = 0 (Timeout)
[pid  8560] futex(0x12a01b8, FUTEX_WAIT, 0, NULL

bobrik · 2014-12-27T10:34:08Z

Turns out, this is somehow ubuntu-specific image issue:

root@callisto ~/of $ docker run --rm fedora date
Sat Dec 27 05:33:08 EST 2014
root@callisto ~/of $ docker run --rm debian date
Sat Dec 27 10:33:12 UTC 2014
root@callisto ~/of $ docker run --rm busybox date
Sat Dec 27 10:33:19 UTC 2014
root@callisto ~/of $ docker run --rm ubuntu date
FATA[0000] Error response from daemon: mkdir /home/docker/overlay/ceff7aed0d0565b1b6b3689795b1ba3d6ff124c113b46c405f952c12cabf335f-init/merged/dev/shm: invalid argument

ajf · 2014-12-27T22:37:19Z

I can reproduce this problem, but only with btrfs underneath the overlay driver. ext4 underneath overlay doesn't seem to have this problem.

bobrik · 2014-12-28T09:38:14Z

Yep, I'm seeing thins on btrfs too. I tried to link /var/lib/docker to partition with ext4 and problem is gone.

LK4D4 · 2014-12-28T19:28:46Z

Yeah, overlay over btrfs working pretty bad :/

jessfraz · 2014-12-28T19:38:06Z

It's a known issue with overlay over btrfs, we need support for that in the
kernel for it to work properly. Right now we only recommend using overlay
over ext4

On Sunday, December 28, 2014, Alexander Morozov notifications@github.com
wrote:

Yeah, overlay over btrfs working pretty bad :/

—
Reply to this email directly or view it on GitHub
#9820 (comment).

thaJeztah · 2014-12-28T20:45:54Z

@jfrazelle do you think it's possible to automatically output a warning if someone attempts to use overlay on top of btrfs (or other troublesome combinations), just as the "WARNING: No swap limit support"?

bobrik · 2014-12-28T20:59:44Z

+1 for @thaJeztah, warning could save a lot for time. If it's a know issue it should be disabled or at least visible.

jessfraz · 2014-12-28T21:32:42Z

Ya I'll add a warning

On Sunday, December 28, 2014, Ian Babrou notifications@github.com wrote:

+1 for @thaJeztah https://github.com/thaJeztah, warning could save a
lot for time. If it's a know issue it should be disabled or at least
visible.

—
Reply to this email directly or view it on GitHub
#9820 (comment).

SvenDowideit · 2014-12-29T07:04:40Z

@jfrazelle can we also add the underlying FS to docker info? (for all graph drivers that have them..)

xiaods · 2014-12-29T10:28:57Z

@SvenDowideit there are potential contain many more underlying filesystem, Do we need support all filesystem?

SvenDowideit · 2014-12-30T05:13:13Z

@xiaods we need to be able to get enough information from docker info to consistently diagnose most issues - so yes, detecting and printing the underlying filesystem will be important.

xiaods · 2015-01-05T16:38:26Z

@SvenDowideit ok，let me collect overall fs.

WARNING: I HAVE NO IDEA WHAT I'M DOING. Alright, maybe I know a little bit. I know that coreos uses btrfs, and that docker has officially disabled the overlay driver on btrfs: moby/moby#9820 That "fix" hasn't yet hit the stable coreos build, but on alpha, docker can't even start with this flag. In stable/beta, docker functions, but fails to start debian-based containers for some reason. If there's a particular reason that overlay is being used here, then the underlying FS needs to be ext4 (not totally sure what 'underlying' means here, but I'm going with it). But if not, we can just remove this flag and be done with it.

nicola · 2015-06-04T19:29:21Z

so, how will I fix this?

laijs · 2017-03-06T02:01:22Z

Does this problem still exist?

thaJeztah · 2017-03-06T07:08:19Z

@laijs see the PR that closed this issue; #9834. Running overlay in top of btrfs doesn't work. If you're having similar issues but don't have btrfs as a backing file system, please open a new issue instead

thaJeztah · 2017-03-06T07:10:58Z

I'm locking the conversation on this issue, because the original issue reported here was resolved

bobrik mentioned this issue Dec 27, 2014

ubuntu:14.04 and 14.10 images don't work with overlayfs storage driver docker-library/official-images#376

Closed

jessfraz mentioned this issue Dec 28, 2014

Add error when running overlay over btrfs. #9834

Merged

crosbymichael closed this as completed in #9834 Jan 6, 2015

jessfraz mentioned this issue Jan 7, 2015

Add base filesystem to docker info #9960

Closed

cldfzn mentioned this issue Jan 23, 2015

Overlay does not work with zfs backed /var/lib/docker #10313

Closed

hjfreyer mentioned this issue Feb 23, 2015

Stop using overlay driver for docker in coreos cloud-configs. kubernetes/kubernetes#4734

Closed

cpuguy83 mentioned this issue Feb 6, 2016

Why is overlayfs not supported over btrfs? #20061

Closed

moby locked and limited conversation to collaborators Mar 6, 2017

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

/dev/shm troubles in docker 1.4.1 #9820

/dev/shm troubles in docker 1.4.1 #9820

bobrik commented Dec 26, 2014

xiaods commented Dec 27, 2014

bobrik commented Dec 27, 2014

bobrik commented Dec 27, 2014

ajf commented Dec 27, 2014

bobrik commented Dec 28, 2014

LK4D4 commented Dec 28, 2014

jessfraz commented Dec 28, 2014

thaJeztah commented Dec 28, 2014

bobrik commented Dec 28, 2014

jessfraz commented Dec 28, 2014

SvenDowideit commented Dec 29, 2014

xiaods commented Dec 29, 2014

SvenDowideit commented Dec 30, 2014

xiaods commented Jan 5, 2015

nicola commented Jun 4, 2015

laijs commented Mar 6, 2017

thaJeztah commented Mar 6, 2017

thaJeztah commented Mar 6, 2017

/dev/shm troubles in docker 1.4.1 #9820

/dev/shm troubles in docker 1.4.1 #9820

Comments

bobrik commented Dec 26, 2014

xiaods commented Dec 27, 2014

bobrik commented Dec 27, 2014

bobrik commented Dec 27, 2014

ajf commented Dec 27, 2014

bobrik commented Dec 28, 2014

LK4D4 commented Dec 28, 2014

jessfraz commented Dec 28, 2014

thaJeztah commented Dec 28, 2014

bobrik commented Dec 28, 2014

jessfraz commented Dec 28, 2014

SvenDowideit commented Dec 29, 2014

xiaods commented Dec 29, 2014

SvenDowideit commented Dec 30, 2014

xiaods commented Jan 5, 2015

nicola commented Jun 4, 2015

laijs commented Mar 6, 2017

thaJeztah commented Mar 6, 2017

thaJeztah commented Mar 6, 2017