1.3.1 RC2 panic

[jollyjinx]

It's the first time I have problems on 10.10 with o3x. The machine paniced twice when emptying the trash.

Stack trace:

(lldb) kdp-remote 192.168.0.2
Version: Darwin Kernel Version 14.0.0: Fri Sep 19 00:26:44 PDT 2014; root:xnu-2782.1.97~2/RELEASE_X86_64; UUID=89E10306-BC78-3A3B-955C-7C4922577E61; stext=0xffffff8006600000
Kernel UUID: 89E10306-BC78-3A3B-955C-7C4922577E61
Load Address: 0xffffff8006600000
Kernel slid 0x6400000 in memory.
Loaded kernel file /Library/Developer/KDKs/KDK_10.10_14B25.kdk/System/Library/Kernels/kernel
Loading 117 kext modules ............................................................................................warning: Can't find binary/dSYM for net.lundman.spl (A27E361A-A4A9-3DF3-B7BC-3E6D2F2E9808)
.warning: Can't find binary/dSYM for net.lundman.zfs (B8F2FDC7-123E-3AB5-B4FE-A58C01BD8BDB)
........................ done.
Target arch: x86_64
Instantiating threads completely from saved state in memory.
Process 1 stopped

• thread Panic on zpool create #2 #2: tid = 0x2424, 0xffffff7f86f2dbd1, name = '0xffffff802a1fea80', queue = '0x0', stop reason = signal SIGSTOP
  frame #0: 0xffffff7f86f2dbd1
  -> 0xffffff7f86f2dbd1: movq (%rax), %rax
  0xffffff7f86f2dbd4: movq -0x50(%rbp), %rcx
  0xffffff7f86f2dbd8: movq %rax, (%rcx)
  0xffffff7f86f2dbdb: movslq -0x6c(%rbp), %rax
  (lldb) bt
• thread Panic on zpool create #2 #2: tid = 0x2424, 0xffffff7f86f2dbd1, name = '0xffffff802a1fea80', queue = '0x0', stop reason = signal SIGSTOP
  • frame #0: 0xffffff7f86f2dbd1
    frame Panic creating pool #1: 0xffffff7f86f2a52b
    frame Panic on zpool create #2 #2: 0xffffff7f86f2e4b7
    frame zio_wait() hangs in multiple cases. #3: 0xffffff7f86fa234b
    frame Large file IO will hang. #4: 0xffffff7f86fad3d1
    frame Foreign pool import is peculiar #5: 0xffffff8006973d4e kernelVNOP_REMOVE(dvp=0xffffff802a7190f0, vp=0xdb871df3d015009f, cnp=0xffffff81ef60bee8, flags=<unavailable>, ctx=0xffffff802a01f5f0) + 94 at kpi_vfs.c:3583 frame #6: 0xffffff800695f077 kernelunlink1at(ctx=, ndp=, unlink_flags=, fd=) + 823 at kpi_vfs.c:5033
    frame Linking of kext fails on snow Leopard / MacPorts 2.1.3 / gcc 4.21. with superfluous linking of libz from MacPorts #7: 0xffffff800695455e kerneldelete [inlined] unlink1(ctx=<unavailable>, ndp=0x00007fb1e3506040, unlink_flags=<unavailable>) + 8 at vfs_syscalls.c:4657 frame #8: 0xffffff8006954556 kerneldelete(p=, uap=0xffffff802a01f4c0, retval=) + 198 at vfs_syscalls.c:4706
    frame Files appear as Directories in new SA code #9: 0xffffff8006c4dcb2 kernelunix_syscall64(state=0xffffff802a1d0ae0) + 610 at systemcalls.c:366 frame #10: 0xffffff800683ac46 kernelhndl_unix_scall64 + 22

paniclog:

(lldb) paniclog -v
panic(cpu 0 caller 0xffffff800681e80a): Kernel trap at 0xffffff7f86f2dbd1, type 14=page fault, registers:
CR0: 0x000000008001003b, CR2: 0x0000000000000000, CR3: 0x0000000396e610a5, CR4: 0x00000000001626e0
RAX: 0x0000000000000000, RBX: 0xdb871df3d015009f, RCX: 0xffffff8212388b60, RDX: 0xffffff8212388b60
RSP: 0xffffff81ef60b710, RBP: 0xffffff81ef60b810, RSI: 0x0000000000000000, RDI: 0x0000007dcbb90010
R8: 0x00000000fffffff8, R9: 0xffffff81ef60b7a4, R10: 0xffffff81ef60b794, R11: 0xffffff81ef60b77c
R12: 0xffffff802a01f5f0, R13: 0xffffff81ef60bee8, R14: 0xffffff81ef60bd98, R15: 0xffffff802a7190f0
RFL: 0x0000000000010286, RIP: 0xffffff7f86f2dbd1, CS: 0x0000000000000008, SS: 0x0000000000000010
Fault CR2: 0x0000000000000000, Error code: 0x0000000000000000, Fault CPU: 0x0
Backtrace (CPU 0), Frame : Return Address
0xffffff81ef60b3c0 : 0xffffff800673a811 mach_kernel : _panic + 0xd1
0xffffff81ef60b440 : 0xffffff800681e80a mach_kernel : _kernel_trap + 0x84a
0xffffff81ef60b600 : 0xffffff800683a443 mach_kernel : _return_from_trap + 0xe3
0xffffff81ef60b620 : 0xffffff7f86f2dbd1 net.lundman.zfs : _sa_build_layouts + 0x701
0xffffff81ef60b810 : 0xffffff7f86f2a52b net.lundman.zfs : _sa_modify_attrs + 0x65b
0xffffff81ef60b8e0 : 0xffffff7f86f2e4b7 net.lundman.zfs : _sa_remove + 0x67
0xffffff81ef60b930 : 0xffffff7f86fa234b net.lundman.zfs : _zfs_remove + 0x95b
0xffffff81ef60ba60 : 0xffffff7f86fad3d1 net.lundman.zfs : _zfs_vnop_remove + 0x71
0xffffff81ef60ba90 : 0xffffff8006973d4e mach_kernel : _VNOP_REMOVE + 0x5e
0xffffff81ef60bb10 : 0xffffff800695f077 mach_kernel : _vfs_purge + 0x3e97
0xffffff81ef60bd80 : 0xffffff800695455e mach_kernel : _delete + 0xce
0xffffff81ef60bf50 : 0xffffff8006c4dcb2 mach_kernel : _unix_syscall64 + 0x262
0xffffff81ef60bfb0 : 0xffffff800683ac46 mach_kernel : _hndl_unix_scall64 + 0x16
Kernel Extensions in backtrace:
net.lundman.zfs(1.3.1)[B8F2FDC7-123E-3AB5-B4FE-A58C01BD8BDB]@0xffffff7f86eb9000->0xffffff7f8710afff
dependency: com.apple.iokit.IOStorageFamily(2.0)[8C420771-7171-3369-891C-6E24F60E569E]@0xffffff7f86e47000
dependency: net.lundman.spl(1.3.1)[A27E361A-A4A9-3DF3-B7BC-3E6D2F2E9808]@0xffffff7f86e76000
BSD process name corresponding to current thread: DesktopServicesH
Boot args: debug=0x144 -v keepsyms=y kext-dev-mode=1
Mac OS version:
14B25
Kernel version:
Darwin Kernel Version 14.0.0: Fri Sep 19 00:26:44 PDT 2014; root:xnu-2782.1.97~2/RELEASE_X86_64
Kernel UUID: 89E10306-BC78-3A3B-955C-7C4922577E61
Kernel slide: 0x0000000006400000
Kernel text base: 0xffffff8006600000
__HIB text base: 0xffffff8006500000
System model name: Macmini6,2 (Mac-F65AE981FFA204ED)
System uptime in nanoseconds: 286732368604
last loaded kext at 8078642870: >!A!BHIDKeyboard 175.5 (addr 0xffffff7f88d8f000, size 16384)
last unloaded kext at 134544084205: >AirPort.Brcm4331 800.20.24 (addr 0xffffff7f8845a000, size 2043904)
loaded kexts:
net.lundman.zfs 1.3.1
net.lundman.spl 1.3.1

AudioAUUC 1.70
@filesystems.autofs 3.0
AGPM 100.14.37
!APlatformEnabler 2.1.0d1
X86PlatformShim 1.0.0
|IO!BSerialManager 4.3.1f2
!AOSXWatchdog 1
!AMikeyHIDDriver 124
!AHDA 267.0
!AUpstreamUserClient 3.6.1
!AMCCSControl 1.2.10
!AMikeyDriver 267.0
|IOUserEthernet 1.0.1
@Dont_Steal_Mac_OS_X 7.0.0
!A!IHD4000Graphics 10.0.0
!AHWAccess 1
!ASMCPDRC 1.0.0
|Broadcom!BHost!CUSBTransport 4.3.1f2
!AHV 1
!ALPC 1.7.3
!A!IFramebufferCapri 10.0.0
!AThunderboltIP 2.0.2
|SCSITaskUserClient 3.7.0
!ARAID 4.0.6
@!AFSCompression.!AFSCompressionTypeDataless 1.0.0d1
@!AFSCompression.!AFSCompressionTypeZlib 1.0.0d1
@BootCache 35
!AIR!C 327.5
XsanFilter 404
|IOAHCIBlock!S 2.6.5
!UHub 705.4.1
!ASDXC 1.6.5
!AFWOHCI 5.5.2
|!ABCM5701Ethernet 10.1.2b3
AirPort.Brcm4360 901.19.10
!AAHCIPort 3.0.7
!UEHCI 705.4.14
!UXHCI 705.4.14
!AACPIButtons 3.1
!ARTC 2.0
!AHPET 1.8
!ASMBIOS 2.1
!AACPIEC 3.1
!AAPIC 1.7
!A!ICPUPowerManagementClient 218.0.0
@nke.applicationfirewall 161
$quarantine 3
$TMSafetyNet 8
!A!ICPUPowerManagement 218.0.0
!A!BHIDKeyboard 175.5
!AHIDKeyboard 175.5
!A!BHIDMouse 185.3
!AHIDMouse 185.3
IO!BHIDDriver 4.3.1f2
@kext.triggers 1.0
|IOSerial!F 11
DspFuncLib 267.0
@kext.OSvKernDSPLib 1.15
|IOAudio!F 200.6
@vecLib.kext 1.2.0
|IOSurface 97
!ASMBus!C 1.0.13d1
|IO!BHost!CUSBTransport 4.3.1f2
|IO!B!F 4.3.1f2
!AHDA!C 267.0
|IOHDA!F 267.0
|IOAccelerator!F2 156.4
@!AGraphicsDeviceControl 3.7.21
|IOUSBUserClient 705.4.0
|IONDRVSupport 2.4.1
|IOGraphics!F 2.4.1
!ASMBusPCI 1.0.12d1
|IOFireWireIP 2.2.6
X86PlatformPlugin 1.0.0
IOPlatformPlugin!F 5.8.0d49
!ASMC 3.1.9
|IOUSBMass!SClass 3.7.0
|IOSCSIBlockCommandsDevice 3.7.0
|IOFireWireSerialBusProtocolTransport 2.5.1
|IOSCSIArchitectureModel!F 3.7.0
|IOFireWireSBP2 4.2.5
!UMergeNub 705.4.0
|IOUSBHIDDriver 705.4.0
!UComposite 705.4.9
!AThunderboltDPInAdapter 4.0.6
!AThunderboltDPAdapter!F 4.0.6
!AThunderboltPCIDownAdapter 2.0.2
!AThunderboltNHI 3.1.7
|IOThunderbolt!F 4.2.1
|IOFireWire!F 4.5.6
|IOEthernetAVB!C 1.0.3b3
|IO80211!F 700.52
mDNSOffloadUserClient 1.0.1b8
|IONetworking!F 3.2
|IOAHCI!F 2.7.0
|IOUSB!F 705.4.14
!AEFINVRAM 2.0
!AEFIRuntime 2.0
|IOHID!F 2.0.0
|IOSMBus!F 1.1
$sandbox 300.0
@kext.!AMatch 1.0.0d1
!AKeyStore 2
!AMobileFileIntegrity 1.0.5
!ACredentialManager 1.0
DiskImages 389.1
|IO!S!F 2.0
|IOReport!F 31
!AFDEKeyStore 28.30
!AACPIPlatform 3.1
|IOPCI!F 2.9
|IOACPI!F 1.4
@kec.Libm 1
@kec.corecrypto 1.0
@kec.pthread 1
Attempting connection to panic server configured at IP 192.168.0.3, port 1069
Resolved 192.168.0.3's (or proxy's) link level address
Transmitting packets to link level address: a8:20:66:01:03:42
Kernel map size is 11712040960
Sending write request for core-xnu-2782.1.97-192.168.0.2-d2dc7d4e

[jollyjinx]

After reboot I removed o3x and reinstalled 1.3.1RC2 to see if it would change things.
It paniced at while emptying the trash again.
I reverted to 1.3.1RC1 and it has the same problem emptying the trash.
The version from 20141127 also panics.

Back on 1.3.1RC2 again:
I've tried mounting the filesystem with option no xattr and no acls and that did not work (panic).
I've tried removing the files via the commandline with rm -r , also fails (panic).

[lundman]

Dec  3 08:31:47 mediamac kernel[0]: ZFS: NULL SA: SA_COPY_DATA(0, 0, 0xffffff82198ea888, 16) i=12

Which appeared to have allowed the unlink to complete successfully.
37ed94b

[jollyjinx]

Well it worked will with the first dataset, but now it did not when I used a:

rsync -av --remove-source-files  sourceOnOldZEVOdataset/ destinationOnNewDataset/

I got two kernel panics directly when starting the rsync.
https://dl.dropboxusercontent.com/u/2757913/2014.12.04.121500.kernelpanic.txt
https://dl.dropboxusercontent.com/u/2757913/2014.12.04.122000.kernelpanic.txt

[ilovezfs]

Rc2 doesn't have the 257 fix:
https://openzfsonosx.org/forum/viewtopic.php?f=24&t=2114#p4562

[jollyjinx]

Version 8bf68a8 had the flaw when using rsync .
Version 37ed94b seems to have fixed it.

[ilovezfs]

Very good.