Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

unable to create zfs pool with wwwid #4589

Closed
aasraoui opened this issue May 3, 2016 · 9 comments
Closed

unable to create zfs pool with wwwid #4589

aasraoui opened this issue May 3, 2016 · 9 comments

Comments

@aasraoui
Copy link

aasraoui commented May 3, 2016 •
edited by behlendorf

#zpool create -f -o ashift=12 ost1 raidz2 /dev/mapper/35000c500835527fb /dev/mapper/35000c500835617eb /dev/mapper/35000c50083561953

strace is captured below:

execve("/usr/sbin/zpool", ["zpool", "create", "-f", "-o", "ashift=12", "ost1", "raidz2", "/dev/mapper/35000c500835527fb", "/dev/mapper/35000c500835617eb", "/dev/mapper/35000c50083561953"], [/* 21 vars */]) = 0^M
brk(0)                                  = 0x140e000^M
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4244d85000^M
access("/etc/ld.so.preload", R_OK)      = -1 ENOENT (No such file or directory)^M
open("/lib64/tls/x86_64/libnvpair.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
stat("/lib64/tls/x86_64", 0x7ffd639f30f0) = -1 ENOENT (No such file or directory)^M
open("/lib64/tls/libnvpair.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
stat("/lib64/tls", {st_mode=S_IFDIR|0555, st_size=6, ...}) = 0^M
open("/lib64/x86_64/libnvpair.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
stat("/lib64/x86_64", 0x7ffd639f30f0)   = -1 ENOENT (No such file or directory)^M
open("/lib64/libnvpair.so.1", O_RDONLY|O_CLOEXEC) = 3^M
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0pM\0\0\0\0\0\0"..., 832) = 832^M
fstat(3, {st_mode=S_IFREG|0755, st_size=87280, ...}) = 0^M
mmap(NULL, 2180128, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f4244950000^M
mprotect(0x7f4244963000, 2097152, PROT_NONE) = 0^M
mmap(0x7f4244b63000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x13000) = 0x7f4244b63000^M
close(3)                                = 0^M
open("/lib64/tls/libuutil.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
open("/lib64/libuutil.so.1", O_RDONLY|O_CLOEXEC) = 3^M
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\260W\0\0\0\0\0\0"..., 832) = 832^M
fstat(3, {st_mode=S_IFREG|0755, st_size=77040, ...}) = 0^M


mmap(NULL, 2173272, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f424473d000^M
mprotect(0x7f424474e000, 2093056, PROT_NONE) = 0^M
mmap(0x7f424494d000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x10000) = 0x7f424494d000^M
mmap(0x7f424494f000, 2392, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f424494f000^M
close(3)                                = 0^M
open("/lib64/tls/libzpool.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
open("/lib64/libzpool.so.2", O_RDONLY|O_CLOEXEC) = 3^M
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\360|\2\0\0\0\0\0"..., 832) = 832^M
fstat(3, {st_mode=S_IFREG|0755, st_size=1294832, ...}) = 0^M
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4244d84000^M
mmap(NULL, 4835032, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f42442a0000^M
mprotect(0x7f42443d1000, 2093056, PROT_NONE) = 0^M
mmap(0x7f42445d0000, 32768, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x130000) = 0x7f42445d0000^M
mmap(0x7f42445d8000, 1459928, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f42445d8000^M
close(3)                                = 0^M
open("/lib64/tls/libzfs.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
open("/lib64/libzfs.so.2", O_RDONLY|O_CLOEXEC) = 3^M
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200\247\0\0\0\0\0\0"..., 832) = 832^M
fstat(3, {st_mode=S_IFREG|0755, st_size=276488, ...}) = 0^M
mmap(NULL, 2367048, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f424405e000^M
mprotect(0x7f424409f000, 2093056, PROT_NONE) = 0^M
mmap(0x7f424429e000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x40000) = 0x7f424429e000^M
close(3)                                = 0^M
open("/lib64/tls/libzfs_core.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
open("/lib64/libzfs_core.so.1", O_RDONLY|O_CLOEXEC) = 3^M
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0 \22\0\0\0\0\0\0"..., 832) = 832^M
fstat(3, {st_mode=S_IFREG|0755, st_size=15560, ...}) = 0^M
mmap(NULL, 2109840, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f4243e5a000^M
mprotect(0x7f4243e5d000, 2093056, PROT_NONE) = 0^M
mmap(0x7f424405c000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f424405c000^M
close(3)                                = 0^M
open("/lib64/tls/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
open("/lib64/libm.so.6", O_RDONLY|O_CLOEXEC) = 3^M
read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\260T\0\0\0\0\0\0"..., 832) = 832^M
fstat(3, {st_mode=S_IFREG|0755, st_size=1141560, ...}) = 0^M
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4244d83000^M
mmap(NULL, 3150168, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f4243b58000^M
mprotect(0x7f4243c59000, 2093056, PROT_NONE) = 0^M
mmap(0x7f4243e58000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x100000) = 0x7f4243e58

close(3)                                = 0^M
open("/lib64/tls/libdl.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
open("/lib64/libdl.so.2", O_RDONLY|O_CLOEXEC) = 3^M
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\320\16\0\0\0\0\0\0"..., 832) = 832^M
fstat(3, {st_mode=S_IFREG|0755, st_size=19520, ...}) = 0^M
mmap(NULL, 2109744, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f4243954000^M
mprotect(0x7f4243957000, 2093056, PROT_NONE) = 0^M
mmap(0x7f4243b56000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f4243b56000^M
close(3)                                = 0^M
open("/lib64/tls/librt.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
open("/lib64/librt.so.1", O_RDONLY|O_CLOEXEC) = 3^M
read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\300\"\0\0\0\0\0\0"..., 832) = 832^M
fstat(3, {st_mode=S_IFREG|0755, st_size=44096, ...}) = 0^M
mmap(NULL, 2128952, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f424374c000^M
mprotect(0x7f4243753000, 2093056, PROT_NONE) = 0^M
mmap(0x7f4243952000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f4243952000^M
close(3)                                = 0^M
open("/lib64/tls/libuuid.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
open("/lib64/libuuid.so.1", O_RDONLY|O_CLOEXEC) = 3^M
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\20\25\0\0\0\0\0\0"..., 832) = 832^M
fstat(3, {st_mode=S_IFREG|0755, st_size=20032, ...}) = 0^M
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4244d82000^M
mmap(NULL, 2113920, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f4243547000^M
mprotect(0x7f424354b000, 2093056, PROT_NONE) = 0^M
mmap(0x7f424374a000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x3000) = 0x7f424374a000^M
close(3)                                = 0^M
open("/lib64/tls/libz.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
open("/lib64/libz.so.1", O_RDONLY|O_CLOEXEC) = 3^M
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0p!\0\0\0\0\0\0"..., 832) = 832^M
fstat(3, {st_mode=S_IFREG|0755, st_size=90632, ...}) = 0^M
mmap(NULL, 2183688, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f4243331000^M
mprotect(0x7f4243346000, 2093056, PROT_NONE) = 0^M
mmap(0x7f4243545000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x14000) = 0x7f4243545000^M
close(3)                                = 0^M
open("/lib64/tls/libpthread.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
open("/lib64/libpthread.so.0", O_RDONLY|O_CLOEXEC) = 3^M
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\240l\0\0\0\0\0\0"..., 832) = 832^M
fstat(3, {st_mode=S_IFREG|0755, st_size=142304, ...}) = 0^M
mmap(NULL, 2208864, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f4243115000^M
mprotect(0x7f424312b000, 2097152, PROT_NONE) = 0^M
mmap(0x7f424332b000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16000) = 0x7f424332b000^M

mmap(0x7f424332d000, 13408, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f424332d000^M
close(3)                                = 0^M
open("/lib64/tls/libc.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
open("/lib64/libc.so.6", O_RDONLY|O_CLOEXEC) = 3^M
read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0 \34\2\0\0\0\0\0"..., 832) = 832^M
fstat(3, {st_mode=S_IFREG|0755, st_size=2107816, ...}) = 0^M
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4244d81000^M
mmap(NULL, 3932736, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f4242d54000^M
mprotect(0x7f4242f0a000, 2097152, PROT_NONE) = 0^M
mmap(0x7f424310a000, 24576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1b6000) = 0x7f424310a000^M
mmap(0x7f4243110000, 16960, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f4243110000^M
close(3)                                = 0^M
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4244d80000^M
mmap(NULL, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4244d7d000^M
arch_prctl(ARCH_SET_FS, 0x7f4244d7e780) = 0^M
mprotect(0x7f424310a000, 16384, PROT_READ) = 0^M
mprotect(0x7f424332b000, 4096, PROT_READ) = 0^M
mprotect(0x7f4243545000, 4096, PROT_READ) = 0^M
mprotect(0x7f424374a000, 4096, PROT_READ) = 0^M
mprotect(0x7f4243952000, 4096, PROT_READ) = 0^M
mprotect(0x7f4243b56000, 4096, PROT_READ) = 0^M
mprotect(0x7f4243e58000, 4096, PROT_READ) = 0^M
mprotect(0x7f424494d000, 4096, PROT_READ) = 0^M
mprotect(0x7f4244b63000, 4096, PROT_READ) = 0^M
mprotect(0x7f424405c000, 4096, PROT_READ) = 0^M
mprotect(0x7f42445d0000, 8192, PROT_READ) = 0^M
mprotect(0x7f424429e000, 4096, PROT_READ) = 0^M
mprotect(0x61b000, 4096, PROT_READ)     = 0^M
mprotect(0x7f4244d86000, 4096, PROT_READ) = 0^M
set_tid_address(0x7f4244d7ea50)         = 8633^M
set_robust_list(0x7f4244d7ea60, 24)     = 0^M
rt_sigaction(SIGRTMIN, {0x7f424311b780, [], SA_RESTORER|SA_SIGINFO, 0x7f4243124100}, NULL, 8) = 0^M
rt_sigaction(SIGRT_1, {0x7f424311b810, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x7f4243124100}, NULL, 8) = 0^M
rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0^M
getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM64_INFINITY}) = 0^M
brk(0)                                  = 0x140e000^M
brk(0x142f000)                          = 0x142f000^M
open("/usr/lib/locale/locale-archive", O_RDONLY|O_CLOEXEC) = 3^M
fstat(3, {st_mode=S_IFREG|0644, st_size=106065056, ...}) = 0^M
mmap(NULL, 106065056, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f423c82d000^

mmap(0x7f424332d000, 13408, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f424332d000^M
close(3)                                = 0^M
open("/lib64/tls/libc.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
open("/lib64/libc.so.6", O_RDONLY|O_CLOEXEC) = 3^M
read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0 \34\2\0\0\0\0\0"..., 832) = 832^M
fstat(3, {st_mode=S_IFREG|0755, st_size=2107816, ...}) = 0^M
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4244d81000^M
mmap(NULL, 3932736, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f4242d54000^M
mprotect(0x7f4242f0a000, 2097152, PROT_NONE) = 0^M
mmap(0x7f424310a000, 24576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1b6000) = 0x7f424310a000^M
mmap(0x7f4243110000, 16960, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f4243110000^M
close(3)                                = 0^M
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4244d80000^M
mmap(NULL, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4244d7d000^M
arch_prctl(ARCH_SET_FS, 0x7f4244d7e780) = 0^M
mprotect(0x7f424310a000, 16384, PROT_READ) = 0^M
mprotect(0x7f424332b000, 4096, PROT_READ) = 0^M
mprotect(0x7f4243545000, 4096, PROT_READ) = 0^M
mprotect(0x7f424374a000, 4096, PROT_READ) = 0^M
mprotect(0x7f4243952000, 4096, PROT_READ) = 0^M
mprotect(0x7f4243b56000, 4096, PROT_READ) = 0^M
mprotect(0x7f4243e58000, 4096, PROT_READ) = 0^M
mprotect(0x7f424494d000, 4096, PROT_READ) = 0^M
mprotect(0x7f4244b63000, 4096, PROT_READ) = 0^M
mprotect(0x7f424405c000, 4096, PROT_READ) = 0^M
mprotect(0x7f42445d0000, 8192, PROT_READ) = 0^M
mprotect(0x7f424429e000, 4096, PROT_READ) = 0^M
mprotect(0x61b000, 4096, PROT_READ)     = 0^M
mprotect(0x7f4244d86000, 4096, PROT_READ) = 0^M
set_tid_address(0x7f4244d7ea50)         = 8633^M
set_robust_list(0x7f4244d7ea60, 24)     = 0^M
rt_sigaction(SIGRTMIN, {0x7f424311b780, [], SA_RESTORER|SA_SIGINFO, 0x7f4243124100}, NULL, 8) = 0^M
rt_sigaction(SIGRT_1, {0x7f424311b810, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x7f4243124100}, NULL, 8) = 0^M
rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0^M
getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM64_INFINITY}) = 0^M
brk(0)                                  = 0x140e000^M
brk(0x142f000)                          = 0x142f000^M
open("/usr/lib/locale/locale-archive", O_RDONLY|O_CLOEXEC) = 3^M
fstat(3, {st_mode=S_IFREG|0644, st_size=106065056, ...}) = 0^M
mmap(NULL, 106065056, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f423c82d000^

close(3)                                = 0^M
access("/sys/module/zfs", F_OK)         = 0^M
access("/sys/module/zfs", F_OK)         = 0^M
open("/dev/zfs", O_RDWR)                = 3^M
close(3)                                = 0^M
open("/dev/zfs", O_RDWR)                = 3^M
open("/etc/mtab", O_RDONLY)             = 4^M
open("/etc/dfs/sharetab", O_RDONLY)     = -1 ENOENT (No such file or directory)^M
open("/dev/zfs", O_RDWR)                = 5^M
lstat("/dev", {st_mode=S_IFDIR|0755, st_size=35860, ...}) = 0^M
lstat("/dev/mapper", {st_mode=S_IFDIR|0755, st_size=5120, ...}) = 0^M
lstat("/dev/mapper/35000c500835527fb", {st_mode=S_IFLNK|0777, st_size=8, ...}) = 0^M
readlink("/dev/mapper/35000c500835527fb", "../dm-38", 4095) = 8^M
lstat("/dev/dm-38", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 38), ...}) = 0^M
open("/dev/dm-38", O_RDONLY|O_DIRECT)   = 6^M
ioctl(6, BLKSSZGET, 4096)               = 0^M
ioctl(6, BLKGETSIZE64, 4000787030016)   = 0^M
lstat("/proc", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0^M
lstat("/proc/self", {st_mode=S_IFLNK|0777, st_size=0, ...}) = 0^M
readlink("/proc/self", "8633", 4095)    = 4^M
lstat("/proc/8633", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0^M
lstat("/proc/8633/fd", {st_mode=S_IFDIR|0500, st_size=0, ...}) = 0^M
lstat("/proc/8633/fd/6", {st_mode=S_IFLNK|0500, st_size=64, ...}) = 0^M
readlink("/proc/8633/fd/6", "/dev/dm-38", 4095) = 10^M
lstat("/dev", {st_mode=S_IFDIR|0755, st_size=35860, ...}) = 0^M
lstat("/dev/dm-38", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 38), ...}) = 0^M
close(6)                                = 0^M
stat("/dev/dm-38", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 38), ...}) = 0^M
lstat("/dev", {st_mode=S_IFDIR|0755, st_size=35860, ...}) = 0^M
lstat("/dev/mapper", {st_mode=S_IFDIR|0755, st_size=5120, ...}) = 0^M
lstat("/dev/mapper/35000c500835617eb", {st_mode=S_IFLNK|0777, st_size=8, ...}) = 0^M
readlink("/dev/mapper/35000c500835617eb", "../dm-53", 4095) = 8^M
lstat("/dev/dm-53", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 53), ...}) = 0^M
open("/dev/dm-53", O_RDONLY|O_DIRECT)   = 6^M
ioctl(6, BLKSSZGET, 4096)               = 0^M
ioctl(6, BLKGETSIZE64, 4000787030016)   = 0^M
lstat("/proc", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0^M
lstat("/proc/self", {st_mode=S_IFLNK|0777, st_size=0, ...}) = 0^M
readlink("/proc/self", "8633", 4095)    = 4^M
lstat("/proc/8633", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0^M
lstat("/proc/8633/fd", {st_mode=S_IFDIR|0500, st_size=0, ...}) = 0^M

lstat("/proc/8633/fd/6", {st_mode=S_IFLNK|0500, st_size=64, ...}) = 0^M
readlink("/proc/8633/fd/6", "/dev/dm-53", 4095) = 10^M
lstat("/dev", {st_mode=S_IFDIR|0755, st_size=35860, ...}) = 0^M
lstat("/dev/dm-53", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 53), ...}) = 0^M
close(6)                                = 0^M
stat("/dev/dm-53", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 53), ...}) = 0^M
lstat("/dev", {st_mode=S_IFDIR|0755, st_size=35860, ...}) = 0^M
lstat("/dev/mapper", {st_mode=S_IFDIR|0755, st_size=5120, ...}) = 0^M
lstat("/dev/mapper/35000c50083561953", {st_mode=S_IFLNK|0777, st_size=9, ...}) = 0^M
readlink("/dev/mapper/35000c50083561953", "../dm-120", 4095) = 9^M
lstat("/dev/dm-120", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 120), ...}) = 0^M
open("/dev/dm-120", O_RDONLY|O_DIRECT)  = 6^M
ioctl(6, BLKSSZGET, 4096)               = 0^M
ioctl(6, BLKGETSIZE64, 4000787030016)   = 0^M
lstat("/proc", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0^M
lstat("/proc/self", {st_mode=S_IFLNK|0777, st_size=0, ...}) = 0^M
readlink("/proc/self", "8633", 4095)    = 4^M
lstat("/proc/8633", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0^M
lstat("/proc/8633/fd", {st_mode=S_IFDIR|0500, st_size=0, ...}) = 0^M
lstat("/proc/8633/fd/6", {st_mode=S_IFLNK|0500, st_size=64, ...}) = 0^M
readlink("/proc/8633/fd/6", "/dev/dm-120", 4095) = 11^M
lstat("/dev", {st_mode=S_IFDIR|0755, st_size=35860, ...}) = 0^M
lstat("/dev/dm-120", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 120), ...}) = 0^M
close(6)                                = 0^M
stat("/dev/dm-120", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 120), ...}) = 0^M
open("/dev/mapper/35000c500835527fb", O_RDONLY) = 6^M
fstat(6, {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 38), ...}) = 0^M
ioctl(6, BLKGETSIZE64, 4000787030016)   = 0^M
mmap(NULL, 266240, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4244d3c000^M
pread(6, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 262144, 0) = 262144^M
pread(6, "\0\00046\t\0\0\0\0\0D^\7\0\0\0\0\0d\321\1\0\0\0\0\0$\16\t\0\0\0"..., 262144, 262144) = 262144^M
pread(6, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 262144, 4000786415616) = 262144^M
pread(6, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 262144, 4000786677760) = 262144^M
munmap(0x7f4244d3c000, 266240)          = 0^M
ioctl(3, 0x5a05, 0x7ffd639e4ea0)        = -1 ENOENT (No such file or directory)^M
open("/usr/share/locale/locale.alias", O_RDONLY|O_CLOEXEC) = 7^M
fstat(7, {st_mode=S_IFREG|0644, st_size=2502, ...}) = 0^M
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4244d7c000^M
read(7, "# Locale name alias data base.\n#"..., 4096) = 2502^M
read(7, "", 4096)                       = 0^M
close(7)                                = 0^M
munmap(0x7f4244d7c000, 4096)            = 0^M
open("/usr/share/locale/en_US.UTF-8/LC_MESSAGES/zfs-linux-user.mo", O_RDONLY) = -1 ENOENT (No such file or directory)^M
open("/usr/share/locale/en_US.utf8/LC_MESSAGES/zfs-linux-user.mo", O_RDONLY) = -1 ENOENT (No such file or directory)^M
open("/usr/share/locale/en_US/LC_MESSAGES/zfs-linux-user.mo", O_RDONLY) = -1 ENOENT (No such file or directory)^M
open("/usr/share/locale/en.UTF-8/LC_MESSAGES/zfs-linux-user.mo", O_RDONLY) = -1 ENOENT (No such file or directory)^M
open("/usr/share/locale/en.utf8/LC_MESSAGES/zfs-linux-user.mo", O_RDONLY) = -1 ENOENT (No such file or directory)^M
open("/usr/share/locale/en/LC_MESSAGES/zfs-linux-user.mo", O_RDONLY) = -1 ENOENT (No such file or directory)^M
close(6)                                = 0^M
open("/dev/mapper/35000c500835617eb", O_RDONLY) = 6^M
fstat(6, {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 53), ...}) = 0^M
ioctl(6, BLKGETSIZE64, 4000787030016)   = 0^M
brk(0)                                  = 0x142f000^M
brk(0x1472000)                          = 0x1472000^M
pread(6, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 262144, 0) = 262144^M
pread(6, "\0\0$$\t\0\0\0\0\0\204\261\4\0\0\0\0\0004P\4\0\0\0\0\0tf\7\0\0\0"..., 262144, 262144) = 262144^M
pread(6, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 262144, 4000786415616) = 262144^M
pread(6, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 262144, 4000786677760) = 262144^M
ioctl(3, 0x5a05, 0x7ffd639e4ea0)        = -1 ENOENT (No such file or directory)^M
close(6)                                = 0^M
open("/dev/mapper/35000c50083561953", O_RDONLY) = 6^M
fstat(6, {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 120), ...}) = 0^M
ioctl(6, BLKGETSIZE64, 4000787030016)   = 0^M
pread(6, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 262144, 0) = 262144^M
pread(6, "\0\0\4\0\0\0\0\0\0\0\324Y\7\0\0\0\0\0\204P\0\0\0\0\0\0004\364\6\0\0\0"..., 262144, 262144) = 262144^M
pread(6, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 262144, 4000786415616) = 262144^M
pread(6, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 262144, 4000786677760) = 262144^M
close(6)                                = 0^M
open("/dev/mapper/35000c500835527fb", O_WRONLY|O_EXCL) = -1 EBUSY (Device or resource busy)^M
open("/usr/share/locale/en_US.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)^M
open("/usr/share/locale/en_US.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)^M
open("/usr/share/locale/en_US/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)^M
open("/usr/share/locale/en.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)^M
open("/usr/share/locale/en.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)^M
open("/usr/share/locale/en/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)^M
write(2, "cannot open '/dev/mapper/35000c5"..., 69cannot open '/dev/mapper/35000c500835527fb': Device or resource busy^M
) = 69^M
open("/dev/mapper/35000c500835617eb", O_WRONLY|O_EXCL) = 6^M
write(6, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4096^M
fdatasync(6)                            = 0^M
close(6)                                = 0^M
open("/dev/mapper/35000c50083561953", O_WRONLY|O_EXCL) = -1 EBUSY (Device or resource busy)^M

write(2, "cannot open '/dev/mapper/35000c5"..., 69cannot open '/dev/mapper/35000c50083561953': Device or resource busy^M
) = 69^M
openat(AT_FDCWD, "/ost1", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = -1 ENOENT (No such file or directory)^M
ioctl(3, 0x5a00, 0x7ffd639eae40)        = -1 ENXIO (No such device or address)^M
write(2, "cannot create 'ost1': one or mor"..., 67cannot create 'ost1': one or more devices is currently unavailable^M
) = 67^M
close(3)                                = 0^M
close(4)                                = 0^M
close(5)                                = 0^M
exit_group(1)                           = ?^M
+++ exited with 1 +++^M

 multipath -ll | more
May 03 02:10:45 | /etc/multipath.conf line 32, invalid keyword: udev_dir
May 03 02:10:45 | /etc/multipath.conf line 36, invalid keyword: getuid_callout
35000c500835730db dm-100 SEAGATE ,ST4000NM0014
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:266:0 sdfn 130:144 active ready  running
  |- 2:0:266:0 sdel 128:208 active ready  running
  |- 1:0:359:0 sdml 69:464  active ready  running
  `- 2:0:359:0 sdkx 67:336  active ready  running
35000c500835527fb dm-46 SEAGATE ,ST4000NM0014
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:234:0 sddc 70:160  active ready  running
  |- 2:0:234:0 sdbv 68:144  active ready  running
  |- 1:0:327:0 sdkq 66:480  active ready  running
  `- 2:0:327:0 sdig 135:0   active ready  running
35000c500835617eb dm-73 SEAGATE ,ST4000NM0014
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:250:0 sdem 128:224 active ready  running
  |- 2:0:250:0 sddk 71:32   active ready  running
  |- 1:0:343:0 sdlv 68:464  active ready  running
  `- 2:0:343:0 sdjf 8:400   active ready  running
35000c50083561953 dm-145 SEAGATE ,ST4000NM0014

Is this a known problem ?

Thanks!
@behlendorf
Copy link
Contributor

@aasraoui what version of ZFS were you able to reproduce this with? Several related fixes were merged to master could you verify the issue is reproducible there.

@aasraoui
Copy link
Author

aasraoui commented May 6, 2016

this is on version 6.5.3, which version are you suggesting to use ?

@behlendorf
Copy link
Contributor

@aasraoui the latest version from git would be needed in order to verify that the fixes which are being backported to 0.6.5.7 will resolve your issue.

@aasraoui
Copy link
Author

aasraoui commented May 6, 2016

how do we pull the latest version an install it ?

thanks..

@aasraoui
Copy link
Author

aasraoui commented May 9, 2016

went through the install procedure listed here:https://github.com/zfsonlinux/zfs/wiki/RHEL-%26-CentOS
yum install zfs is failing:
sudo yum install zfs
Loaded plugins: fastestmirror
base | 3.6 kB 00:00:00
http://mirror.rackspace.com/CentOS/7.2.1511/extras/x86_64/repodata/repomd.xml: [Errno 14] curl#6 - "Could not resolve host: mirror.rackspace.com; Unknown error"

thanks..

@aasraoui
Copy link
Author

we pulled the master zip file and the build version of zfs shows 6.5.1 is this the expected version
from the master branch. Or did something go wrong with the build ?

thanks..

@utopiabound
Copy link
Contributor

@behlendorf Do you have an ETA for 0.6.5.7?

@behlendorf
Copy link
Contributor

@utopiabound should be tagged this week.

@aasraoui
Copy link
Author

This have been resolved in 0.6.5.7 release..
Thanks..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@behlendorf @aasraoui @utopiabound