New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

grub-probe fails with Unknown Filesystem #804

Closed
arizonafox opened this Issue Jul 4, 2012 · 26 comments

Comments

Projects
None yet
10 participants
@arizonafox

Installed and was using zfs. On last update, grub failed to boot complaining that the the kernel needed to be loaded. Began install per Djahorn on second drive, then instead of using debootstrap, copied the failed system onto new setup. When reaching chroot stage have been troubleshooting grub-probe issue (ie it will not properly do grub install because of it). Below are the results of the apt-get commands that he suggests for grub troubleshooting. How can I get grub-probe working so I can fix this system?

root@ubuntu:/# apt-get install --reinstall zfs-grub
Reading package lists... Done
Building dependency tree
Reading state information... Done
Note, selecting 'grub-common' instead of 'zfs-grub'
0 upgraded, 0 newly installed, 1 reinstalled, 0 to remove and 0 not upgraded.
Need to get 0 B/2,356 kB of archives.
After this operation, 0 B of additional disk space will be used.
Can not write log, openpty() failed (/dev/pts not mounted?)
(Reading database ... 232194 files and directories currently installed.)
Preparing to replace grub-common 1.99-21ubuntu3+zfs1 (using .../grub-common_1.99-21ubuntu3+zfs1_amd64.deb) ...
Unpacking replacement grub-common ...
Processing triggers for ureadahead ...
Processing triggers for man-db ...
Can not write log, openpty() failed (/dev/pts not mounted?)
Setting up grub-common (1.99-21ubuntu3+zfs1) ...
root@ubuntu:/# apt-cache search zfs-grub
grub-common - GRand Unified Bootloader (common files)
root@ubuntu:/# apt-cache show zfs-grub
N: Can't select versions from package 'zfs-grub' as it is purely virtual
N: No packages found
root@ubuntu:/# apt-cache policy grub-common zfs-grub
grub-common:
Installed: 1.99-21ubuntu3+zfs1
Candidate: 1.99-21ubuntu3+zfs1
Version table:
1.99-21ubuntu3.1 0
500 http://archive.ubuntu.com/ubuntu/ precise-updates/main amd64 Packages
*** 1.99-21ubuntu3+zfs1 0
900 http://ppa.launchpad.net/zfs-native/grub/ubuntu/ precise/main amd64 Packages
100 /var/lib/dpkg/status
1.99-21ubuntu3 0
500 http://archive.ubuntu.com/ubuntu/ precise/main amd64 Packages
zfs-grub:
Installed: (none)
Candidate: (none)
Version table:

@ryao

This comment has been minimized.

Show comment
Hide comment
@ryao

ryao Jul 4, 2012

Member

I believe that this is @dajhorn's area.

Member

ryao commented Jul 4, 2012

I believe that this is @dajhorn's area.

@dajhorn

This comment has been minimized.

Show comment
Hide comment
@dajhorn

dajhorn Jul 4, 2012

Member

Did this happen during the 3.2.0-26-generic upgrade?

Please post the output of grub-probe -vvv / from both inside and outside the chroot.

Also double-check the mount --bind commands.

Member

dajhorn commented Jul 4, 2012

Did this happen during the 3.2.0-26-generic upgrade?

Please post the output of grub-probe -vvv / from both inside and outside the chroot.

Also double-check the mount --bind commands.

@arizonafox

This comment has been minimized.

Show comment
Hide comment
@arizonafox

arizonafox Jul 4, 2012

Yes it was during the 3.2.0-26-generaic upgrade.

[inside chroot] grub-probe -vvv /
grub-probe: info: cannot open /boot/grub/device.map'. util/deviceiter.c:396: Already seen /dev/disk/by-id/scsi-SATA_ST3320418AS_9VM41RA3 (/dev/sda) util/deviceiter.c:396: Already seen /dev/disk/by-id/wwn-0x5000c50019577776 (/dev/sda) util/deviceiter.c:396: Already seen /dev/disk/by-id/scsi-SATA_ST31000528AS_9VPA57PE (/dev/sdb) util/deviceiter.c:396: Already seen /dev/disk/by-id/wwn-0x5000c5002d0a492e (/dev/sdb) util/deviceiter.c:396: Already seen /dev/disk/by-id/scsi-SATA_WDC_WD10EARX-00_WD-WMC0T0425472 (/dev/sdc) util/deviceiter.c:396: Already seen /dev/disk/by-id/wwn-0x50014ee2b160fe6a (/dev/sdc) util/deviceiter.c:396: Already seen /dev/disk/by-id/scsi-SATA_ST3320418AS_9VM3ZBJ7 (/dev/sdd) util/deviceiter.c:396: Already seen /dev/disk/by-id/wwn-0x5000c5001959abbe (/dev/sdd) util/deviceiter.c:396: Already seen /dev/sda (/dev/sda) util/deviceiter.c:396: Already seen /dev/sdb (/dev/sdb) util/deviceiter.c:396: Already seen /dev/sdc (/dev/sdc) util/deviceiter.c:396: Already seen /dev/sdd (/dev/sdd) util/deviceiter.c:883: No DM devices found grub-core/disk/raid.c:740: Scanning for dmraid_nv RAID devices on disk hd0 grub-probe: info: Scanning for dmraid_nv RAID devices on disk hd0. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda' in open_device() grub-core/kern/disk.c:338: Closinghd0'.
grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 625142448. grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for dmraid_nv RAID devices on disk hd1
grub-probe: info: Scanning for dmraid_nv RAID devices on disk hd1.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 1953525168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdb' in open_device()
grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 1953525168.
grub-core/kern/disk.c:338: Closing hd1'. grub-core/disk/raid.c:740: Scanning for dmraid_nv RAID devices on disk hd2 grub-probe: info: Scanning for dmraid_nv RAID devices on disk hd2. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 1953525168.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-core/kern/disk.c:338: Closinghd2'.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 1953525168. grub-core/kern/disk.c:338: Closinghd2'.
grub-core/disk/raid.c:740: Scanning for dmraid_nv RAID devices on disk hd3
grub-probe: info: Scanning for dmraid_nv RAID devices on disk hd3.
grub-core/kern/disk.c:245: Opening hd3'... grub-probe: info: the size of hd3 is 625142448. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device()
grub-core/kern/disk.c:338: Closing hd3'. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/kern/disk.c:338: Closing hd3'. grub-probe: info: scanning hd0 for LVM. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda' in open_device() grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closinghd0'.
grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 625142448. grub-core/kern/disk.c:338: Closinghd0'.
grub-probe: info: scanning hd1 for LVM.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 1953525168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdb' in open_device()
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 1953525168.
grub-core/kern/disk.c:338: Closing hd1'. grub-probe: info: scanning hd2 for LVM. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 1953525168.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closinghd2'.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 1953525168. grub-core/kern/disk.c:338: Closinghd2'.
grub-probe: info: scanning hd3 for LVM.
grub-core/kern/disk.c:245: Opening hd3'... grub-probe: info: the size of hd3 is 625142448. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device()
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd3'. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/kern/disk.c:338: Closing hd3'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda' in open_device() grub-core/kern/disk.c:338: Closinghd0'.
grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 625142448. grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd1
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd1.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 1953525168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdb' in open_device()
grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 1953525168.
grub-core/kern/disk.c:338: Closing hd1'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd2 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd2. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 1953525168.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-core/kern/disk.c:338: Closinghd2'.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 1953525168. grub-core/kern/disk.c:338: Closinghd2'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd3
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd3.
grub-core/kern/disk.c:245: Opening hd3'... grub-probe: info: the size of hd3 is 625142448. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device()
grub-core/kern/disk.c:338: Closing hd3'. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/kern/disk.c:338: Closing hd3'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda' in open_device() grub-core/kern/disk.c:338: Closinghd0'.
grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 625142448. grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd1
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd1.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 1953525168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdb' in open_device()
grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 1953525168.
grub-core/kern/disk.c:338: Closing hd1'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd2 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd2. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 1953525168.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-core/kern/disk.c:338: Closinghd2'.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 1953525168. grub-core/kern/disk.c:338: Closinghd2'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd3
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd3.
grub-core/kern/disk.c:245: Opening hd3'... grub-probe: info: the size of hd3 is 625142448. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device()
grub-core/kern/disk.c:338: Closing hd3'. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/kern/disk.c:338: Closing hd3'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda1' in open_device() grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda' in open_device()
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda2' in open_device() grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda4' in open_device()
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd0'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0,msdos4 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0,msdos4. grub-core/kern/disk.c:245: Openinghd0,msdos4'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/kern/disk.c:338: Closing hd0'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0,msdos2 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0,msdos2. grub-core/kern/disk.c:245: Openinghd0,msdos2'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda2' in open_device() grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0,msdos1
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0,msdos1.
grub-core/kern/disk.c:245: Opening hd0,msdos1'... grub-probe: info: the size of hd0 is 625142448. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda1' in open_device()
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda1' grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd1
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd1.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 1953525168. grub-core/kern/disk.c:338: Closinghd1'.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 1953525168. grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/kern/disk.c:338: Closinghd1'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd2
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd2.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 1953525168. grub-core/kern/disk.c:338: Closinghd2'.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 1953525168. grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/kern/disk.c:338: Closinghd2'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd3
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd3.
grub-core/kern/disk.c:245: Opening hd3'... grub-probe: info: the size of hd3 is 625142448. grub-core/kern/disk.c:338: Closinghd3'.
grub-core/kern/disk.c:245: Opening hd3'... grub-probe: info: the size of hd3 is 625142448. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd1' in open_device()
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdd' in open_device() grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd2' in open_device()
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd3'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd3,msdos2 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd3,msdos2. grub-core/kern/disk.c:245: Openinghd3,msdos2'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdd2' in open_device() grub-core/kern/disk.c:338: Closinghd3'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd3,msdos1
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd3,msdos1.
grub-core/kern/disk.c:245: Opening hd3,msdos1'... grub-probe: info: the size of hd3 is 625142448. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd1' in open_device()
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdd1' grub-core/kern/disk.c:338: Closinghd3'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0.
grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 625142448. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda' in open_device()
grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd0'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0,msdos4 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0,msdos4. grub-core/kern/disk.c:245: Openinghd0,msdos4'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda4' in open_device() grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0,msdos2
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0,msdos2.
grub-core/kern/disk.c:245: Opening hd0,msdos2'... grub-probe: info: the size of hd0 is 625142448. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda2' in open_device()
grub-core/kern/disk.c:338: Closing hd0'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0,msdos1 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0,msdos1. grub-core/kern/disk.c:245: Openinghd0,msdos1'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda1' in open_device() grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd1
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd1.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 1953525168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdb' in open_device()
grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 1953525168.
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd1'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd2 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd2. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 1953525168.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-core/kern/disk.c:338: Closinghd2'.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 1953525168. grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/kern/disk.c:338: Closinghd2'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd3
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd3.
grub-core/kern/disk.c:245: Opening hd3'... grub-probe: info: the size of hd3 is 625142448. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device()
grub-core/kern/disk.c:338: Closing hd3'. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd3'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd3,msdos2 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd3,msdos2. grub-core/kern/disk.c:245: Openinghd3,msdos2'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdd2' in open_device() grub-core/kern/disk.c:338: Closinghd3'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd3,msdos1
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd3,msdos1.
grub-core/kern/disk.c:245: Opening hd3,msdos1'... grub-probe: info: the size of hd3 is 625142448. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd1' in open_device()
grub-core/kern/disk.c:338: Closing hd3'. grub-probe: info: scanning hd0 for LVM. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd0,msdos4 for LVM. grub-core/kern/disk.c:245: Openinghd0,msdos4'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd0,msdos2 for LVM. grub-core/kern/disk.c:245: Openinghd0,msdos2'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd0,msdos1 for LVM. grub-core/kern/disk.c:245: Openinghd0,msdos1'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd1 for LVM. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 1953525168.
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 1953525168.
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd1'. grub-probe: info: scanning hd2 for LVM. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 1953525168.
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd2'. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 1953525168.
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd2'. grub-probe: info: scanning hd3 for LVM. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd3'. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd3'. grub-probe: info: scanning hd3,msdos2 for LVM. grub-core/kern/disk.c:245: Openinghd3,msdos2'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd3'. grub-probe: info: scanning hd3,msdos1 for LVM. grub-core/kern/disk.c:245: Openinghd3,msdos1'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd3'. grub-probe: info: /dev/sdd2 starts from 16065. grub-probe: info: opening the device hd3. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-probe: info: Partition 0 starts from 63.
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-probe: info: Partition 1 starts from 16065.
grub-probe: info: opening hd3,msdos2.
grub-core/kern/disk.c:245: Opening hd3,msdos2'... grub-probe: info: the size of hd3 is 625142448. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef grub-core/kern/fs.c:54: Detecting zfs... grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd2' in open_device()
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdd2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdd2'
grub-core/fs/zfs/zfs.c:784: label ok 0
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdd2' grub-core/fs/zfs/zfs.c:627: check 2 passed grub-core/fs/zfs/zfs.c:638: check 3 passed grub-core/fs/zfs/zfs.c:645: check 4 passed grub-core/fs/zfs/zfs.c:655: check 6 passed grub-core/fs/zfs/zfs.c:663: check 7 passed grub-core/fs/zfs/zfs.c:674: check 8 passed grub-core/fs/zfs/zfs.c:684: check 9 passed grub-core/fs/zfs/zfs.c:706: check 11 passed grub-core/fs/zfs/zfs.c:729: check 10 passed grub-core/fs/zfs/zfs.c:1429: endian = -1 grub-core/fs/zfs/zfs.c:449: dva=1, b3 grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdd2'
grub-core/fs/zfs/zfs.c:300: checksum fletcher4 verification failed
grub-core/fs/zfs/zfs.c:305: actual checksum 00000020ff00754b 0000082d4476356e 00016517916530e5 002e34cc667886f2
grub-core/fs/zfs/zfs.c:310: expected checksum 00000010b8273455 000005ddd41614a7 000110b7c73760b9 002228facca9c9bc
grub-core/kern/fs.c:60: zfs detection failed.
grub-core/kern/fs.c:54: Detecting xfs...
grub-core/kern/fs.c:60: xfs detection failed.
grub-core/kern/fs.c:54: Detecting ufs2...
grub-core/kern/fs.c:60: ufs2 detection failed.
grub-core/kern/fs.c:54: Detecting ufs1...
grub-core/kern/fs.c:60: ufs1 detection failed.
grub-core/kern/fs.c:54: Detecting udf...
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdd2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdd2'
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdd2' grub-core/kern/fs.c:60: udf detection failed. grub-core/kern/fs.c:54: Detecting tarfs... grub-core/kern/fs.c:60: tarfs detection failed. grub-core/kern/fs.c:54: Detecting squash4... grub-core/kern/fs.c:60: squash4 detection failed. grub-core/kern/fs.c:54: Detecting sfs... grub-core/kern/fs.c:60: sfs detection failed. grub-core/kern/fs.c:54: Detecting reiserfs... grub-core/kern/fs.c:60: reiserfs detection failed. grub-core/kern/fs.c:54: Detecting ntfs... grub-core/kern/fs.c:60: ntfs detection failed. grub-core/kern/fs.c:54: Detecting nilfs2... grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdd2'
grub-core/kern/fs.c:60: nilfs2 detection failed.
grub-core/kern/fs.c:54: Detecting minix2...
grub-core/kern/fs.c:60: minix2 detection failed.
grub-core/kern/fs.c:54: Detecting minix...
grub-core/kern/fs.c:60: minix detection failed.
grub-core/kern/fs.c:54: Detecting jfs...
grub-core/kern/fs.c:60: jfs detection failed.
grub-core/kern/fs.c:54: Detecting iso9660...
grub-core/kern/fs.c:60: iso9660 detection failed.
grub-core/kern/fs.c:54: Detecting hfsplus...
grub-core/kern/fs.c:60: hfsplus detection failed.
grub-core/kern/fs.c:54: Detecting xfs...
grub-core/kern/fs.c:60: xfs detection failed.
grub-core/kern/fs.c:54: Detecting ufs2...
grub-core/kern/fs.c:60: ufs2 detection failed.
grub-core/kern/fs.c:54: Detecting ufs1...
grub-core/kern/fs.c:60: ufs1 detection failed.
grub-core/kern/fs.c:54: Detecting udf...
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdd2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdd2'
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdd2' grub-core/kern/fs.c:60: udf detection failed. grub-core/kern/fs.c:54: Detecting tarfs... grub-core/kern/fs.c:60: tarfs detection failed. grub-core/kern/fs.c:54: Detecting squash4... grub-core/kern/fs.c:60: squash4 detection failed. grub-core/kern/fs.c:54: Detecting sfs... grub-core/kern/fs.c:60: sfs detection failed. grub-core/kern/fs.c:54: Detecting reiserfs... grub-core/kern/fs.c:60: reiserfs detection failed. grub-core/kern/fs.c:54: Detecting ntfs... grub-core/kern/fs.c:60: ntfs detection failed. grub-core/kern/fs.c:54: Detecting nilfs2... grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdd2'
grub-core/kern/fs.c:60: nilfs2 detection failed.
grub-core/kern/fs.c:54: Detecting minix2...
grub-core/kern/fs.c:60: minix2 detection failed.
grub-core/kern/fs.c:54: Detecting minix...
grub-core/kern/fs.c:60: minix detection failed.
grub-core/kern/fs.c:54: Detecting jfs...
grub-core/kern/fs.c:60: jfs detection failed.
grub-core/kern/fs.c:54: Detecting iso9660...
grub-core/kern/fs.c:60: iso9660 detection failed.
grub-core/kern/fs.c:54: Detecting hfsplus...
grub-core/kern/fs.c:60: hfsplus detection failed.
grub-core/kern/fs.c:54: Detecting hfs...
grub-core/kern/fs.c:60: hfs detection failed.
grub-core/kern/fs.c:54: Detecting fat...
grub-core/kern/fs.c:60: fat detection failed.
grub-core/kern/fs.c:54: Detecting ext2...
grub-core/kern/fs.c:60: ext2 detection failed.
grub-core/kern/fs.c:54: Detecting cpiofs...
grub-core/kern/fs.c:60: cpiofs detection failed.
grub-core/kern/fs.c:54: Detecting btrfs...
grub-core/kern/fs.c:60: btrfs detection failed.
grub-core/kern/fs.c:54: Detecting befs_be...
grub-core/kern/fs.c:60: befs_be detection failed.
grub-core/kern/fs.c:54: Detecting befs...
grub-core/kern/fs.c:60: befs detection failed.
grub-core/kern/fs.c:54: Detecting afs_be...
grub-core/kern/fs.c:60: afs_be detection failed.
grub-core/kern/fs.c:54: Detecting afs...
grub-core/kern/fs.c:60: afs detection failed.
grub-core/kern/fs.c:54: Detecting affs...
grub-core/kern/fs.c:60: affs detection failed.
grub-probe: error: unknown filesystem.

[outside chroot on live cd] grub-probe -vvv /
grub-probe: info: cannot open `/boot/grub/device.map'.
grub-probe: info: changing current directory to /dev.
grub-probe: info: changing current directory to snd.
grub-probe: info: changing current directory to by-path.
grub-probe: info: changing current directory to cpu.
grub-probe: info: changing current directory to usb.
grub-probe: info: changing current directory to disk.
grub-probe: info: changing current directory to by-uuid.
grub-probe: info: changing current directory to by-label.
grub-probe: info: changing current directory to by-path.
grub-probe: info: changing current directory to by-id.
grub-probe: info: changing current directory to dri.
grub-probe: info: changing current directory to char.
grub-probe: info: changing current directory to block.
grub-probe: info: changing current directory to pts.
grub-probe: info: changing current directory to bsg.
grub-probe: info: changing current directory to mapper.
grub-probe: info: changing current directory to input.
grub-probe: info: changing current directory to by-path.
grub-probe: info: changing current directory to by-id.
grub-probe: info: changing current directory to bus.
grub-probe: info: changing current directory to usb.
grub-probe: info: changing current directory to 008.
grub-probe: info: changing current directory to 007.
grub-probe: info: changing current directory to 006.
grub-probe: info: changing current directory to 005.
grub-probe: info: changing current directory to 004.
grub-probe: info: changing current directory to 003.
grub-probe: info: changing current directory to 002.
grub-probe: info: changing current directory to 001.
grub-probe: info: changing current directory to net.
grub-probe: error: cannot find a device for / (is /dev mounted?).

[inside chroot] mount
cargohold/ROOT/ubuntu-1 on / type zfs (rw,relatime,xattr)
cargohold on /cargohold type zfs (rw,relatime,xattr)
cargohold/ROOT on /cargohold/ROOT type zfs (rw,relatime,xattr)
/dev/sdd1 on /boot/grub type ext3 (rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered)
udev on /dev type devtmpfs (rw,relatime,size=6139872k,nr_inodes=1534968,mode=755)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)

[outside chroot on live cd] mount -l
/cow on / type overlayfs (rw)
proc on /proc type proc (rw,noexec,nosuid,nodev)
sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
udev on /dev type devtmpfs (rw,mode=0755)
devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=0620)
tmpfs on /run type tmpfs (rw,noexec,nosuid,size=10%,mode=0755)
/dev/sr0 on /cdrom type iso9660 (ro,noatime) [Ubuntu 12.04 LTS amd64]
/dev/loop0 on /rofs type squashfs (ro,noatime)
none on /sys/fs/fuse/connections type fusectl (rw)
none on /sys/kernel/debug type debugfs (rw)
none on /sys/kernel/security type securityfs (rw)
tmpfs on /tmp type tmpfs (rw,nosuid,nodev)
none on /run/lock type tmpfs (rw,noexec,nosuid,nodev,size=5242880)
none on /run/shm type tmpfs (rw,nosuid,nodev)
gvfs-fuse-daemon on /home/ubuntu/.gvfs type fuse.gvfs-fuse-daemon (rw,nosuid,nodev,user=ubuntu)
cargohold/ROOT/ubuntu-1 on /mnt type zfs (rw,xattr)
cargohold on /mnt/cargohold type zfs (rw,xattr)
cargohold/ROOT on /mnt/cargohold/ROOT type zfs (rw,xattr)
/dev/sdd1 on /mnt/boot/grub type ext3 (rw)
keel/ROOT/ubuntu-1 on /oldone type zfs (rw,xattr)
keel on /oldone/keel type zfs (rw,xattr)
keel/ROOT on /oldone/keel/ROOT type zfs (rw,xattr)
/dev on /mnt/dev type none (rw,bind)
/proc on /mnt/proc type none (rw,bind)
/sys on /mnt/sys type none (rw,bind)

Thank you for looking into it.

Yes it was during the 3.2.0-26-generaic upgrade.

[inside chroot] grub-probe -vvv /
grub-probe: info: cannot open /boot/grub/device.map'. util/deviceiter.c:396: Already seen /dev/disk/by-id/scsi-SATA_ST3320418AS_9VM41RA3 (/dev/sda) util/deviceiter.c:396: Already seen /dev/disk/by-id/wwn-0x5000c50019577776 (/dev/sda) util/deviceiter.c:396: Already seen /dev/disk/by-id/scsi-SATA_ST31000528AS_9VPA57PE (/dev/sdb) util/deviceiter.c:396: Already seen /dev/disk/by-id/wwn-0x5000c5002d0a492e (/dev/sdb) util/deviceiter.c:396: Already seen /dev/disk/by-id/scsi-SATA_WDC_WD10EARX-00_WD-WMC0T0425472 (/dev/sdc) util/deviceiter.c:396: Already seen /dev/disk/by-id/wwn-0x50014ee2b160fe6a (/dev/sdc) util/deviceiter.c:396: Already seen /dev/disk/by-id/scsi-SATA_ST3320418AS_9VM3ZBJ7 (/dev/sdd) util/deviceiter.c:396: Already seen /dev/disk/by-id/wwn-0x5000c5001959abbe (/dev/sdd) util/deviceiter.c:396: Already seen /dev/sda (/dev/sda) util/deviceiter.c:396: Already seen /dev/sdb (/dev/sdb) util/deviceiter.c:396: Already seen /dev/sdc (/dev/sdc) util/deviceiter.c:396: Already seen /dev/sdd (/dev/sdd) util/deviceiter.c:883: No DM devices found grub-core/disk/raid.c:740: Scanning for dmraid_nv RAID devices on disk hd0 grub-probe: info: Scanning for dmraid_nv RAID devices on disk hd0. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda' in open_device() grub-core/kern/disk.c:338: Closinghd0'.
grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 625142448. grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for dmraid_nv RAID devices on disk hd1
grub-probe: info: Scanning for dmraid_nv RAID devices on disk hd1.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 1953525168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdb' in open_device()
grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 1953525168.
grub-core/kern/disk.c:338: Closing hd1'. grub-core/disk/raid.c:740: Scanning for dmraid_nv RAID devices on disk hd2 grub-probe: info: Scanning for dmraid_nv RAID devices on disk hd2. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 1953525168.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-core/kern/disk.c:338: Closinghd2'.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 1953525168. grub-core/kern/disk.c:338: Closinghd2'.
grub-core/disk/raid.c:740: Scanning for dmraid_nv RAID devices on disk hd3
grub-probe: info: Scanning for dmraid_nv RAID devices on disk hd3.
grub-core/kern/disk.c:245: Opening hd3'... grub-probe: info: the size of hd3 is 625142448. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device()
grub-core/kern/disk.c:338: Closing hd3'. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/kern/disk.c:338: Closing hd3'. grub-probe: info: scanning hd0 for LVM. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda' in open_device() grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closinghd0'.
grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 625142448. grub-core/kern/disk.c:338: Closinghd0'.
grub-probe: info: scanning hd1 for LVM.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 1953525168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdb' in open_device()
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 1953525168.
grub-core/kern/disk.c:338: Closing hd1'. grub-probe: info: scanning hd2 for LVM. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 1953525168.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closinghd2'.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 1953525168. grub-core/kern/disk.c:338: Closinghd2'.
grub-probe: info: scanning hd3 for LVM.
grub-core/kern/disk.c:245: Opening hd3'... grub-probe: info: the size of hd3 is 625142448. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device()
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd3'. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/kern/disk.c:338: Closing hd3'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda' in open_device() grub-core/kern/disk.c:338: Closinghd0'.
grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 625142448. grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd1
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd1.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 1953525168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdb' in open_device()
grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 1953525168.
grub-core/kern/disk.c:338: Closing hd1'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd2 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd2. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 1953525168.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-core/kern/disk.c:338: Closinghd2'.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 1953525168. grub-core/kern/disk.c:338: Closinghd2'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd3
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd3.
grub-core/kern/disk.c:245: Opening hd3'... grub-probe: info: the size of hd3 is 625142448. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device()
grub-core/kern/disk.c:338: Closing hd3'. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/kern/disk.c:338: Closing hd3'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda' in open_device() grub-core/kern/disk.c:338: Closinghd0'.
grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 625142448. grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd1
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd1.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 1953525168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdb' in open_device()
grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 1953525168.
grub-core/kern/disk.c:338: Closing hd1'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd2 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd2. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 1953525168.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-core/kern/disk.c:338: Closinghd2'.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 1953525168. grub-core/kern/disk.c:338: Closinghd2'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd3
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd3.
grub-core/kern/disk.c:245: Opening hd3'... grub-probe: info: the size of hd3 is 625142448. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device()
grub-core/kern/disk.c:338: Closing hd3'. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/kern/disk.c:338: Closing hd3'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda1' in open_device() grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda' in open_device()
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda2' in open_device() grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda4' in open_device()
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd0'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0,msdos4 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0,msdos4. grub-core/kern/disk.c:245: Openinghd0,msdos4'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/kern/disk.c:338: Closing hd0'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0,msdos2 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0,msdos2. grub-core/kern/disk.c:245: Openinghd0,msdos2'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda2' in open_device() grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0,msdos1
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0,msdos1.
grub-core/kern/disk.c:245: Opening hd0,msdos1'... grub-probe: info: the size of hd0 is 625142448. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda1' in open_device()
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda1' grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd1
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd1.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 1953525168. grub-core/kern/disk.c:338: Closinghd1'.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 1953525168. grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/kern/disk.c:338: Closinghd1'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd2
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd2.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 1953525168. grub-core/kern/disk.c:338: Closinghd2'.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 1953525168. grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/kern/disk.c:338: Closinghd2'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd3
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd3.
grub-core/kern/disk.c:245: Opening hd3'... grub-probe: info: the size of hd3 is 625142448. grub-core/kern/disk.c:338: Closinghd3'.
grub-core/kern/disk.c:245: Opening hd3'... grub-probe: info: the size of hd3 is 625142448. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd1' in open_device()
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdd' in open_device() grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd2' in open_device()
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd3'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd3,msdos2 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd3,msdos2. grub-core/kern/disk.c:245: Openinghd3,msdos2'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdd2' in open_device() grub-core/kern/disk.c:338: Closinghd3'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd3,msdos1
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd3,msdos1.
grub-core/kern/disk.c:245: Opening hd3,msdos1'... grub-probe: info: the size of hd3 is 625142448. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd1' in open_device()
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdd1' grub-core/kern/disk.c:338: Closinghd3'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0.
grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 625142448. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda' in open_device()
grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd0'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0,msdos4 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0,msdos4. grub-core/kern/disk.c:245: Openinghd0,msdos4'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda4' in open_device() grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0,msdos2
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0,msdos2.
grub-core/kern/disk.c:245: Opening hd0,msdos2'... grub-probe: info: the size of hd0 is 625142448. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda2' in open_device()
grub-core/kern/disk.c:338: Closing hd0'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0,msdos1 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0,msdos1. grub-core/kern/disk.c:245: Openinghd0,msdos1'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda1' in open_device() grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd1
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd1.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 1953525168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdb' in open_device()
grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 1953525168.
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd1'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd2 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd2. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 1953525168.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-core/kern/disk.c:338: Closinghd2'.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 1953525168. grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/kern/disk.c:338: Closinghd2'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd3
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd3.
grub-core/kern/disk.c:245: Opening hd3'... grub-probe: info: the size of hd3 is 625142448. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device()
grub-core/kern/disk.c:338: Closing hd3'. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd3'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd3,msdos2 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd3,msdos2. grub-core/kern/disk.c:245: Openinghd3,msdos2'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdd2' in open_device() grub-core/kern/disk.c:338: Closinghd3'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd3,msdos1
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd3,msdos1.
grub-core/kern/disk.c:245: Opening hd3,msdos1'... grub-probe: info: the size of hd3 is 625142448. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd1' in open_device()
grub-core/kern/disk.c:338: Closing hd3'. grub-probe: info: scanning hd0 for LVM. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd0,msdos4 for LVM. grub-core/kern/disk.c:245: Openinghd0,msdos4'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x82, start 0x25429800, len 0x52b0
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd0,msdos2 for LVM. grub-core/kern/disk.c:245: Openinghd0,msdos2'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542593f
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd0,msdos1 for LVM. grub-core/kern/disk.c:245: Openinghd0,msdos1'...
grub-probe: info: the size of hd0 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd1 for LVM. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 1953525168.
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 1953525168.
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd1'. grub-probe: info: scanning hd2 for LVM. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 1953525168.
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd2'. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 1953525168.
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd2'. grub-probe: info: scanning hd3 for LVM. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd3'. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd3'. grub-probe: info: scanning hd3,msdos2 for LVM. grub-core/kern/disk.c:245: Openinghd3,msdos2'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd3'. grub-probe: info: scanning hd3,msdos1 for LVM. grub-core/kern/disk.c:245: Openinghd3,msdos1'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd3'. grub-probe: info: /dev/sdd2 starts from 16065. grub-probe: info: opening the device hd3. grub-core/kern/disk.c:245: Openinghd3'...
grub-probe: info: the size of hd3 is 625142448.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82
grub-probe: info: Partition 0 starts from 63.
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef
grub-probe: info: Partition 1 starts from 16065.
grub-probe: info: opening hd3,msdos2.
grub-core/kern/disk.c:245: Opening hd3,msdos2'... grub-probe: info: the size of hd3 is 625142448. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x3e82 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x3ec1, len 0x2542abef grub-core/kern/fs.c:54: Detecting zfs... grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd2' in open_device()
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdd2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdd2'
grub-core/fs/zfs/zfs.c:784: label ok 0
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdd2' grub-core/fs/zfs/zfs.c:627: check 2 passed grub-core/fs/zfs/zfs.c:638: check 3 passed grub-core/fs/zfs/zfs.c:645: check 4 passed grub-core/fs/zfs/zfs.c:655: check 6 passed grub-core/fs/zfs/zfs.c:663: check 7 passed grub-core/fs/zfs/zfs.c:674: check 8 passed grub-core/fs/zfs/zfs.c:684: check 9 passed grub-core/fs/zfs/zfs.c:706: check 11 passed grub-core/fs/zfs/zfs.c:729: check 10 passed grub-core/fs/zfs/zfs.c:1429: endian = -1 grub-core/fs/zfs/zfs.c:449: dva=1, b3 grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdd2'
grub-core/fs/zfs/zfs.c:300: checksum fletcher4 verification failed
grub-core/fs/zfs/zfs.c:305: actual checksum 00000020ff00754b 0000082d4476356e 00016517916530e5 002e34cc667886f2
grub-core/fs/zfs/zfs.c:310: expected checksum 00000010b8273455 000005ddd41614a7 000110b7c73760b9 002228facca9c9bc
grub-core/kern/fs.c:60: zfs detection failed.
grub-core/kern/fs.c:54: Detecting xfs...
grub-core/kern/fs.c:60: xfs detection failed.
grub-core/kern/fs.c:54: Detecting ufs2...
grub-core/kern/fs.c:60: ufs2 detection failed.
grub-core/kern/fs.c:54: Detecting ufs1...
grub-core/kern/fs.c:60: ufs1 detection failed.
grub-core/kern/fs.c:54: Detecting udf...
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdd2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdd2'
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdd2' grub-core/kern/fs.c:60: udf detection failed. grub-core/kern/fs.c:54: Detecting tarfs... grub-core/kern/fs.c:60: tarfs detection failed. grub-core/kern/fs.c:54: Detecting squash4... grub-core/kern/fs.c:60: squash4 detection failed. grub-core/kern/fs.c:54: Detecting sfs... grub-core/kern/fs.c:60: sfs detection failed. grub-core/kern/fs.c:54: Detecting reiserfs... grub-core/kern/fs.c:60: reiserfs detection failed. grub-core/kern/fs.c:54: Detecting ntfs... grub-core/kern/fs.c:60: ntfs detection failed. grub-core/kern/fs.c:54: Detecting nilfs2... grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdd2'
grub-core/kern/fs.c:60: nilfs2 detection failed.
grub-core/kern/fs.c:54: Detecting minix2...
grub-core/kern/fs.c:60: minix2 detection failed.
grub-core/kern/fs.c:54: Detecting minix...
grub-core/kern/fs.c:60: minix detection failed.
grub-core/kern/fs.c:54: Detecting jfs...
grub-core/kern/fs.c:60: jfs detection failed.
grub-core/kern/fs.c:54: Detecting iso9660...
grub-core/kern/fs.c:60: iso9660 detection failed.
grub-core/kern/fs.c:54: Detecting hfsplus...
grub-core/kern/fs.c:60: hfsplus detection failed.
grub-core/kern/fs.c:54: Detecting xfs...
grub-core/kern/fs.c:60: xfs detection failed.
grub-core/kern/fs.c:54: Detecting ufs2...
grub-core/kern/fs.c:60: ufs2 detection failed.
grub-core/kern/fs.c:54: Detecting ufs1...
grub-core/kern/fs.c:60: ufs1 detection failed.
grub-core/kern/fs.c:54: Detecting udf...
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdd2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdd2'
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdd2' grub-core/kern/fs.c:60: udf detection failed. grub-core/kern/fs.c:54: Detecting tarfs... grub-core/kern/fs.c:60: tarfs detection failed. grub-core/kern/fs.c:54: Detecting squash4... grub-core/kern/fs.c:60: squash4 detection failed. grub-core/kern/fs.c:54: Detecting sfs... grub-core/kern/fs.c:60: sfs detection failed. grub-core/kern/fs.c:54: Detecting reiserfs... grub-core/kern/fs.c:60: reiserfs detection failed. grub-core/kern/fs.c:54: Detecting ntfs... grub-core/kern/fs.c:60: ntfs detection failed. grub-core/kern/fs.c:54: Detecting nilfs2... grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdd2'
grub-core/kern/fs.c:60: nilfs2 detection failed.
grub-core/kern/fs.c:54: Detecting minix2...
grub-core/kern/fs.c:60: minix2 detection failed.
grub-core/kern/fs.c:54: Detecting minix...
grub-core/kern/fs.c:60: minix detection failed.
grub-core/kern/fs.c:54: Detecting jfs...
grub-core/kern/fs.c:60: jfs detection failed.
grub-core/kern/fs.c:54: Detecting iso9660...
grub-core/kern/fs.c:60: iso9660 detection failed.
grub-core/kern/fs.c:54: Detecting hfsplus...
grub-core/kern/fs.c:60: hfsplus detection failed.
grub-core/kern/fs.c:54: Detecting hfs...
grub-core/kern/fs.c:60: hfs detection failed.
grub-core/kern/fs.c:54: Detecting fat...
grub-core/kern/fs.c:60: fat detection failed.
grub-core/kern/fs.c:54: Detecting ext2...
grub-core/kern/fs.c:60: ext2 detection failed.
grub-core/kern/fs.c:54: Detecting cpiofs...
grub-core/kern/fs.c:60: cpiofs detection failed.
grub-core/kern/fs.c:54: Detecting btrfs...
grub-core/kern/fs.c:60: btrfs detection failed.
grub-core/kern/fs.c:54: Detecting befs_be...
grub-core/kern/fs.c:60: befs_be detection failed.
grub-core/kern/fs.c:54: Detecting befs...
grub-core/kern/fs.c:60: befs detection failed.
grub-core/kern/fs.c:54: Detecting afs_be...
grub-core/kern/fs.c:60: afs_be detection failed.
grub-core/kern/fs.c:54: Detecting afs...
grub-core/kern/fs.c:60: afs detection failed.
grub-core/kern/fs.c:54: Detecting affs...
grub-core/kern/fs.c:60: affs detection failed.
grub-probe: error: unknown filesystem.

[outside chroot on live cd] grub-probe -vvv /
grub-probe: info: cannot open `/boot/grub/device.map'.
grub-probe: info: changing current directory to /dev.
grub-probe: info: changing current directory to snd.
grub-probe: info: changing current directory to by-path.
grub-probe: info: changing current directory to cpu.
grub-probe: info: changing current directory to usb.
grub-probe: info: changing current directory to disk.
grub-probe: info: changing current directory to by-uuid.
grub-probe: info: changing current directory to by-label.
grub-probe: info: changing current directory to by-path.
grub-probe: info: changing current directory to by-id.
grub-probe: info: changing current directory to dri.
grub-probe: info: changing current directory to char.
grub-probe: info: changing current directory to block.
grub-probe: info: changing current directory to pts.
grub-probe: info: changing current directory to bsg.
grub-probe: info: changing current directory to mapper.
grub-probe: info: changing current directory to input.
grub-probe: info: changing current directory to by-path.
grub-probe: info: changing current directory to by-id.
grub-probe: info: changing current directory to bus.
grub-probe: info: changing current directory to usb.
grub-probe: info: changing current directory to 008.
grub-probe: info: changing current directory to 007.
grub-probe: info: changing current directory to 006.
grub-probe: info: changing current directory to 005.
grub-probe: info: changing current directory to 004.
grub-probe: info: changing current directory to 003.
grub-probe: info: changing current directory to 002.
grub-probe: info: changing current directory to 001.
grub-probe: info: changing current directory to net.
grub-probe: error: cannot find a device for / (is /dev mounted?).

[inside chroot] mount
cargohold/ROOT/ubuntu-1 on / type zfs (rw,relatime,xattr)
cargohold on /cargohold type zfs (rw,relatime,xattr)
cargohold/ROOT on /cargohold/ROOT type zfs (rw,relatime,xattr)
/dev/sdd1 on /boot/grub type ext3 (rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered)
udev on /dev type devtmpfs (rw,relatime,size=6139872k,nr_inodes=1534968,mode=755)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)

[outside chroot on live cd] mount -l
/cow on / type overlayfs (rw)
proc on /proc type proc (rw,noexec,nosuid,nodev)
sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
udev on /dev type devtmpfs (rw,mode=0755)
devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=0620)
tmpfs on /run type tmpfs (rw,noexec,nosuid,size=10%,mode=0755)
/dev/sr0 on /cdrom type iso9660 (ro,noatime) [Ubuntu 12.04 LTS amd64]
/dev/loop0 on /rofs type squashfs (ro,noatime)
none on /sys/fs/fuse/connections type fusectl (rw)
none on /sys/kernel/debug type debugfs (rw)
none on /sys/kernel/security type securityfs (rw)
tmpfs on /tmp type tmpfs (rw,nosuid,nodev)
none on /run/lock type tmpfs (rw,noexec,nosuid,nodev,size=5242880)
none on /run/shm type tmpfs (rw,nosuid,nodev)
gvfs-fuse-daemon on /home/ubuntu/.gvfs type fuse.gvfs-fuse-daemon (rw,nosuid,nodev,user=ubuntu)
cargohold/ROOT/ubuntu-1 on /mnt type zfs (rw,xattr)
cargohold on /mnt/cargohold type zfs (rw,xattr)
cargohold/ROOT on /mnt/cargohold/ROOT type zfs (rw,xattr)
/dev/sdd1 on /mnt/boot/grub type ext3 (rw)
keel/ROOT/ubuntu-1 on /oldone type zfs (rw,xattr)
keel on /oldone/keel type zfs (rw,xattr)
keel/ROOT on /oldone/keel/ROOT type zfs (rw,xattr)
/dev on /mnt/dev type none (rw,bind)
/proc on /mnt/proc type none (rw,bind)
/sys on /mnt/sys type none (rw,bind)

Thank you for looking into it.

@dajhorn

This comment has been minimized.

Show comment
Hide comment
@dajhorn

dajhorn Jul 6, 2012

Member

This error must be resolved:

grub-core/fs/zfs/zfs.c:300: checksum fletcher4 verification failed
grub-core/fs/zfs/zfs.c:305: actual checksum 00000020ff00754b 0000082d4476356e 00016517916530e5 002e34cc667886f2
grub-core/fs/zfs/zfs.c:310: expected checksum 00000010b8273455 000005ddd41614a7 000110b7c73760b9 002228facca9c9bc
grub-core/kern/fs.c:60: zfs detection failed.

Running an offline scrub might fix it. In a rescue environment, do zpool import -N and zpool scrub. You must wait for it to finish without touching the filesystem.

Unfortunately, this is a defect in many grub releases. In this circumstance, a bad checksum is a not reason to fail.

If a scrub does not resolve the checksum mismatch, then your alternatives are:

  • Move /boot onto a USB device and start the system with it.
  • Install the recent grub-2.00 release locally and try your luck.
  • Rebuild the pool.

Older pools are more likely to glitch like this than new pools. Grub lacks complete coverage for all valid pools.

Member

dajhorn commented Jul 6, 2012

This error must be resolved:

grub-core/fs/zfs/zfs.c:300: checksum fletcher4 verification failed
grub-core/fs/zfs/zfs.c:305: actual checksum 00000020ff00754b 0000082d4476356e 00016517916530e5 002e34cc667886f2
grub-core/fs/zfs/zfs.c:310: expected checksum 00000010b8273455 000005ddd41614a7 000110b7c73760b9 002228facca9c9bc
grub-core/kern/fs.c:60: zfs detection failed.

Running an offline scrub might fix it. In a rescue environment, do zpool import -N and zpool scrub. You must wait for it to finish without touching the filesystem.

Unfortunately, this is a defect in many grub releases. In this circumstance, a bad checksum is a not reason to fail.

If a scrub does not resolve the checksum mismatch, then your alternatives are:

  • Move /boot onto a USB device and start the system with it.
  • Install the recent grub-2.00 release locally and try your luck.
  • Rebuild the pool.

Older pools are more likely to glitch like this than new pools. Grub lacks complete coverage for all valid pools.

@arizonafox

This comment has been minimized.

Show comment
Hide comment
@arizonafox

arizonafox Jul 8, 2012

Running an offline scrub DID fix it as in grub-probe now correctly reports a zfs file system. I am now able to finish your installation instructions for grub installation (step6:) and cleanly exiting the chroot environment and rebooting (step:7).

The system however does NOT successfully reboot at this point. I verified that mountpoint and bootfs are set correctly. The messages are different, depending on which kernel I try in the grub menus. kernels 3.2.0.26.28 is the latest, then 3.2.0.25, 3.2.0.24, and 3.2.0.23. I will try and collect the messages so I can be specific. I am running on the live-cd right now so I need to write them down or something to get them right.

Running an offline scrub DID fix it as in grub-probe now correctly reports a zfs file system. I am now able to finish your installation instructions for grub installation (step6:) and cleanly exiting the chroot environment and rebooting (step:7).

The system however does NOT successfully reboot at this point. I verified that mountpoint and bootfs are set correctly. The messages are different, depending on which kernel I try in the grub menus. kernels 3.2.0.26.28 is the latest, then 3.2.0.25, 3.2.0.24, and 3.2.0.23. I will try and collect the messages so I can be specific. I am running on the live-cd right now so I need to write them down or something to get them right.

@dajhorn

This comment has been minimized.

Show comment
Hide comment
@dajhorn

dajhorn Jul 9, 2012

Member

Okay, this is a known grub problem. You've run into a corner case where grub is brittle. If this happens once, then grub is much more likely to choke on this pool in the future.

Once this happens to a pool, there is no currently known fix, short of using a different configuration or boot loader.

Ubuntu deprecated grub and it could be removed from future releases. I need to do some research and determine whether it is worthwhile to publish a grub-2.0.0 package for ZoL or bring a solution from Illumos/FreeBSD/Solaris onto Linux.

Unfortunately, anybody that gets this grub failure is stuck until that work is finished.

Member

dajhorn commented Jul 9, 2012

Okay, this is a known grub problem. You've run into a corner case where grub is brittle. If this happens once, then grub is much more likely to choke on this pool in the future.

Once this happens to a pool, there is no currently known fix, short of using a different configuration or boot loader.

Ubuntu deprecated grub and it could be removed from future releases. I need to do some research and determine whether it is worthwhile to publish a grub-2.0.0 package for ZoL or bring a solution from Illumos/FreeBSD/Solaris onto Linux.

Unfortunately, anybody that gets this grub failure is stuck until that work is finished.

@ryao

This comment has been minimized.

Show comment
Hide comment
@ryao

ryao Jul 9, 2012

Member

@dajhorn I have already done research on bringing a solution from Illumos/FreeBSD/Solaris to Linux.

Solaris/Illumos has a patched version of GRUB 0.97. It requires patches to build on Linux, but it fails to function at boot when built with a Linux GCC toolchain (on both Gentoo and Ubuntu). In addition, Sun never patched grub-install to work with ZFS. Instead, they wrote their own installation program called install-grub. I made an attempt to port this, but I have largely abandoned that effort.

On the topic of FreeBSD, I am slowly working toward a port of FreeBSD's bootloader to Linux. I find this to be more promising than porting Sun's GRUB because it supports raidz and it is better written.

Also, @arizonafox's issue has not been observed on Gentoo. Would you elaborate on it?

Member

ryao commented Jul 9, 2012

@dajhorn I have already done research on bringing a solution from Illumos/FreeBSD/Solaris to Linux.

Solaris/Illumos has a patched version of GRUB 0.97. It requires patches to build on Linux, but it fails to function at boot when built with a Linux GCC toolchain (on both Gentoo and Ubuntu). In addition, Sun never patched grub-install to work with ZFS. Instead, they wrote their own installation program called install-grub. I made an attempt to port this, but I have largely abandoned that effort.

On the topic of FreeBSD, I am slowly working toward a port of FreeBSD's bootloader to Linux. I find this to be more promising than porting Sun's GRUB because it supports raidz and it is better written.

Also, @arizonafox's issue has not been observed on Gentoo. Would you elaborate on it?

@elventear

This comment has been minimized.

Show comment
Hide comment
@elventear

elventear Jul 10, 2012

I have a similar issue, where I can't boot a pool that had previously been working for a long time. The first time this issue manifested, I was able to get the system by scrubbing.

But this issue manifested again and I haven't had any success to get the system back to boot. When I boot with a recovery disc and chroot into my system, I have seen grub probe had the same errors as here, but other times it doesn't show any error.

Scrubbing makes the checksum error disappear but after I reboot, the system won't boot.

Would an alternative be to have /boot on another partition with ext4?

I have a similar issue, where I can't boot a pool that had previously been working for a long time. The first time this issue manifested, I was able to get the system by scrubbing.

But this issue manifested again and I haven't had any success to get the system back to boot. When I boot with a recovery disc and chroot into my system, I have seen grub probe had the same errors as here, but other times it doesn't show any error.

Scrubbing makes the checksum error disappear but after I reboot, the system won't boot.

Would an alternative be to have /boot on another partition with ext4?

@dajhorn

This comment has been minimized.

Show comment
Hide comment
@dajhorn

dajhorn Jul 10, 2012

Member

@elventear: Yes, putting /boot into a non-ZFS filesystem that grub recognizes will reliably solve the problem.

@ryao: I can cause the problem by filling an old pool. It doesn't happen if you artificially fill a new pool. Maybe the allocation strategy can confuse grub. It also seems to affect pools that have replaced vdevs. Unclean shutdowns can cause it too.

On a busy ZFS system, something on-disk changes that breaks grub but is kosher according to all ZFS implementations. I don't have a reproducer that works in a virtual machine.

Member

dajhorn commented Jul 10, 2012

@elventear: Yes, putting /boot into a non-ZFS filesystem that grub recognizes will reliably solve the problem.

@ryao: I can cause the problem by filling an old pool. It doesn't happen if you artificially fill a new pool. Maybe the allocation strategy can confuse grub. It also seems to affect pools that have replaced vdevs. Unclean shutdowns can cause it too.

On a busy ZFS system, something on-disk changes that breaks grub but is kosher according to all ZFS implementations. I don't have a reproducer that works in a virtual machine.

@elventear

This comment has been minimized.

Show comment
Hide comment
@elventear

elventear Jul 10, 2012

Now every single time grub-probe says that my rpool has an invalid checksum. Even after doing a scrub. If I do an on-line scrub, grub-probe will work, but as soon as export the pool and reimport, the issue comes back again.

@dajhorn So what would be proper way to rebuild the pool?

Now every single time grub-probe says that my rpool has an invalid checksum. Even after doing a scrub. If I do an on-line scrub, grub-probe will work, but as soon as export the pool and reimport, the issue comes back again.

@dajhorn So what would be proper way to rebuild the pool?

@dajhorn

This comment has been minimized.

Show comment
Hide comment
@dajhorn

dajhorn Jul 10, 2012

Member

A quick fix is to put /boot on a USB drive and use it as the primary boot device.

Past that, if you're not turned off grub and want to rebuild the pool, then you need to make a full backup, clear the disks, and restore.

Member

dajhorn commented Jul 10, 2012

A quick fix is to put /boot on a USB drive and use it as the primary boot device.

Past that, if you're not turned off grub and want to rebuild the pool, then you need to make a full backup, clear the disks, and restore.

@elventear

This comment has been minimized.

Show comment
Hide comment
@elventear

elventear Jul 11, 2012

So, I went for the different route of moving /boot into a separate partition. I reinstalled zfs-grub, rebuilt the dkms and initramfs, update-grub and reinstalled grub.

Yet, when I boot it takes me directly to the initramfs prompt. I can import the zpools but when I exit I get a kernel panic.

Do I need to pass something else to update grub now that /boot is not inside a zfs?

So, I went for the different route of moving /boot into a separate partition. I reinstalled zfs-grub, rebuilt the dkms and initramfs, update-grub and reinstalled grub.

Yet, when I boot it takes me directly to the initramfs prompt. I can import the zpools but when I exit I get a kernel panic.

Do I need to pass something else to update grub now that /boot is not inside a zfs?

@dajhorn

This comment has been minimized.

Show comment
Hide comment
@dajhorn

dajhorn Jul 12, 2012

Member

Force the root pool name in the /etc/default/grub file like this:

GRUB_CMDLINE_LINUX="rpool=tank bootfs=tank/foo/bar"

This is unwholesome, but the detection logic in the PPA is limited to the capabilities of grub as shipped by Ubuntu.

The recent grub-2.0 release should have several ZFS fixes that might enable boot-by-label or boot-by-uuid, but it is not yet imported to the Debian or Ubuntu source repositories. A merge in time for Quantal is unlikely.

Member

dajhorn commented Jul 12, 2012

Force the root pool name in the /etc/default/grub file like this:

GRUB_CMDLINE_LINUX="rpool=tank bootfs=tank/foo/bar"

This is unwholesome, but the detection logic in the PPA is limited to the capabilities of grub as shipped by Ubuntu.

The recent grub-2.0 release should have several ZFS fixes that might enable boot-by-label or boot-by-uuid, but it is not yet imported to the Debian or Ubuntu source repositories. A merge in time for Quantal is unlikely.

@elventear

This comment has been minimized.

Show comment
Hide comment
@elventear

elventear Jul 12, 2012

Still can't boot. With the settings suggested when I boot into initramfs the rpool is already imported, whereas before it wasn't. But I still can't boot. Any other suggestions on what to try?

Still can't boot. With the settings suggested when I boot into initramfs the rpool is already imported, whereas before it wasn't. But I still can't boot. Any other suggestions on what to try?

@arizonafox

This comment has been minimized.

Show comment
Hide comment
@arizonafox

arizonafox Jul 13, 2012

Ok, I didn't get those messages. I did try however to reinstall the whole system, from scratch on a separate drive and document the original failure. Following Dajhorn's instructions:

https://github.com/dajhorn/pkg-zfs/wiki/HOWTO-install-Ubuntu-to-a-Native-ZFS-Root-Filesystem

with the following modifications:

  • instead of /boot/grub, I created a linux partition to hold /boot (made it 100mb, should have made it 400mb)

I changed the grub.cfg to force the root pool as Dajhorn suggested above. The system boots using image 3.2.0-23 and displays and error on the way up:

Error: Couldn't find a valid label
Press any key to continue

The boot proceeds whether a key is pressed or not.

  • I installed ubuntu-desktop

I continued to reboot the system with each change and no change in boot occurred.

  • I enabled all the software sources in the software center and updated everything except the kernel

Boots as before.

  • I installed a proprietary video driver

Boots as before.

  • I used the update manager to install the 3.2.0-26 kernel.

Error messages indicated a problem with spl-headers not being found. system will not boot with 3.2.0-26 kernel. After restart am able to select 3.2.0-23 kernel in grub menu and boot system. Try reinstall of spl and spl-dkms and run out of room on /boot. Remove 3.2.0-26 kernel and system boots with 3.2.0-23 kernel. No notice a window pops up indicating an error with installing zfs-dkms and wanting to send in an error report (which it can't since it is in a ppa). Tried reinstall of zfs-dkms and error report still pops up. This error shows up in kern.log

Jul 13 03:20:14 ubuntu kernel: [ 4.305128] SPLError: 663:0:(spl-err.c:67:vcmn_err()) W
ARNING: ZFS replay transaction error 5, dataset cargohold/ROOT/ubuntu-1, seq 0xe862, txty
pe 9

So boys and girls, the moral of the story is, 3.2.0-26 seems to break the system, or installing it using the update manager does. Can't answer that yet. Hmm, I should have taken a zfs snapshot before installing the 3.2.0-26 kernel. That would make this easier.

Ok, I didn't get those messages. I did try however to reinstall the whole system, from scratch on a separate drive and document the original failure. Following Dajhorn's instructions:

https://github.com/dajhorn/pkg-zfs/wiki/HOWTO-install-Ubuntu-to-a-Native-ZFS-Root-Filesystem

with the following modifications:

  • instead of /boot/grub, I created a linux partition to hold /boot (made it 100mb, should have made it 400mb)

I changed the grub.cfg to force the root pool as Dajhorn suggested above. The system boots using image 3.2.0-23 and displays and error on the way up:

Error: Couldn't find a valid label
Press any key to continue

The boot proceeds whether a key is pressed or not.

  • I installed ubuntu-desktop

I continued to reboot the system with each change and no change in boot occurred.

  • I enabled all the software sources in the software center and updated everything except the kernel

Boots as before.

  • I installed a proprietary video driver

Boots as before.

  • I used the update manager to install the 3.2.0-26 kernel.

Error messages indicated a problem with spl-headers not being found. system will not boot with 3.2.0-26 kernel. After restart am able to select 3.2.0-23 kernel in grub menu and boot system. Try reinstall of spl and spl-dkms and run out of room on /boot. Remove 3.2.0-26 kernel and system boots with 3.2.0-23 kernel. No notice a window pops up indicating an error with installing zfs-dkms and wanting to send in an error report (which it can't since it is in a ppa). Tried reinstall of zfs-dkms and error report still pops up. This error shows up in kern.log

Jul 13 03:20:14 ubuntu kernel: [ 4.305128] SPLError: 663:0:(spl-err.c:67:vcmn_err()) W
ARNING: ZFS replay transaction error 5, dataset cargohold/ROOT/ubuntu-1, seq 0xe862, txty
pe 9

So boys and girls, the moral of the story is, 3.2.0-26 seems to break the system, or installing it using the update manager does. Can't answer that yet. Hmm, I should have taken a zfs snapshot before installing the 3.2.0-26 kernel. That would make this easier.

@arizonafox

This comment has been minimized.

Show comment
Hide comment
@arizonafox

arizonafox Jul 13, 2012

Here is what I found in the /var/log/apt/term.log

Log started: 2012-07-13 02:43:18
Selecting previously unselected package linux-image-3.2.0-26-generic.
(Reading database ... ^M(Reading database ... 5%^M(Reading database ... 10%^M(Reading dat
abase ... 15%^M(Reading database ... 20%^M(Reading database ... 25%^M(Reading database ..
. 30%^M(Reading database ... 35%^M(Reading database ... 40%^M(Reading database ... 45%^M(
Reading database ... 50%^M(Reading database ... 55%^M(Reading database ... 60%^M(Reading
database ... 65%^M(Reading database ... 70%^M(Reading database ... 75%^M(Reading database
... 80%^M(Reading database ... 85%^M(Reading database ... 90%^M(Reading database ... 95%
^M(Reading database ... 100%^M(Reading database ... 138600 files and directories currentl
y installed.)
Unpacking linux-image-3.2.0-26-generic (from .../linux-image-3.2.0-26-generic_3.2.0-26.41
_amd64.deb) ...
locale: Cannot set LC_CTYPE to default locale: No such file or directory
locale: Cannot set LC_MESSAGES to default locale: No such file or directory
locale: Cannot set LC_ALL to default locale: No such file or directory
Done.
Selecting previously unselected package linux-headers-3.2.0-26.
Unpacking linux-headers-3.2.0-26 (from .../linux-headers-3.2.0-26_3.2.0-26.41_all.deb) ..
.
Selecting previously unselected package linux-headers-3.2.0-26-generic.
Unpacking linux-headers-3.2.0-26-generic (from .../linux-headers-3.2.0-26-generic_3.2.0-2
6.41_amd64.deb) ...
Preparing to replace linux-headers-generic 3.2.0.23.25 (using .../linux-headers-generic_3
.2.0.26.28_amd64.deb) ...
Unpacking replacement linux-headers-generic ...
Preparing to replace linux-image 3.2.0.23.25 (using .../linux-image_3.2.0.26.28_amd64.deb
) ...
Unpacking replacement linux-image ...
Preparing to replace linux-image-generic 3.2.0.23.25 (using .../linux-image-generic_3.2.0
.26.28_amd64.deb) ...
Unpacking replacement linux-image-generic ...
Setting up linux-image-3.2.0-26-generic (3.2.0-26.41) ...
Running depmod.
update-initramfs: deferring update (hook will be called later)
Examining /etc/kernel/postinst.d.
run-parts: executing /etc/kernel/postinst.d/dkms 3.2.0-26-generic /boot/vmlinuz-3.2.0-26-
generic
configure: error:
*** Cannot determine the version of the spl source.
*** ZFS depends on the SPL kernel module, which is not yet ready.
*** DKMS should retry zfs-dkms momentarily after building spl-dkms.
*** If this error message persists, or if you are running DKMS manually,
*** then run 'apt-get install --reinstall spl-dkms' and try again.
Error! Bad return status for module build on kernel: 3.2.0-26-generic (x86_64)
Consult /var/lib/dkms/zfs/0.6.0.66/build/make.log for more information.
run-parts: executing /etc/kernel/postinst.d/initramfs-tools 3.2.0-26-generic /boot/vmlinuz-3.2.0-26-generic
update-initramfs: Generating /boot/initrd.img-3.2.0-26-generic
run-parts: executing /etc/kernel/postinst.d/pm-utils 3.2.0-26-generic /boot/vmlinuz-3.2.0-26-generic
run-parts: executing /etc/kernel/postinst.d/update-notifier 3.2.0-26-generic /boot/vmlinuz-3.2.0-26-generic
run-parts: executing /etc/kernel/postinst.d/zz-update-grub 3.2.0-26-generic /boot/vmlinuz-3.2.0-26-generic
Generating grub.cfg ...
Found linux image: /boot/vmlinuz-3.2.0-26-generic
Found initrd image: /boot/initrd.img-3.2.0-26-generic
Found linux image: /boot/vmlinuz-3.2.0-23-generic
Found initrd image: /boot/initrd.img-3.2.0-23-generic
done
Setting up linux-headers-3.2.0-26 (3.2.0-26.41) ...
Setting up linux-headers-3.2.0-26-generic (3.2.0-26.41) ...
Examining /etc/kernel/header_postinst.d.
run-parts: executing /etc/kernel/header_postinst.d/dkms 3.2.0-26-generic /boot/vmlinuz-3.2.0-26-generic
Setting up linux-headers-generic (3.2.0.26.28) ...
Setting up linux-image-generic (3.2.0.26.28) ...
Setting up linux-image (3.2.0.26.28) ...
Processing triggers for initramfs-tools ...
update-initramfs: Generating /boot/initrd.img-3.2.0-26-generic
Log ended: 2012-07-13 02:47:02

Hope that helps.

Here is what I found in the /var/log/apt/term.log

Log started: 2012-07-13 02:43:18
Selecting previously unselected package linux-image-3.2.0-26-generic.
(Reading database ... ^M(Reading database ... 5%^M(Reading database ... 10%^M(Reading dat
abase ... 15%^M(Reading database ... 20%^M(Reading database ... 25%^M(Reading database ..
. 30%^M(Reading database ... 35%^M(Reading database ... 40%^M(Reading database ... 45%^M(
Reading database ... 50%^M(Reading database ... 55%^M(Reading database ... 60%^M(Reading
database ... 65%^M(Reading database ... 70%^M(Reading database ... 75%^M(Reading database
... 80%^M(Reading database ... 85%^M(Reading database ... 90%^M(Reading database ... 95%
^M(Reading database ... 100%^M(Reading database ... 138600 files and directories currentl
y installed.)
Unpacking linux-image-3.2.0-26-generic (from .../linux-image-3.2.0-26-generic_3.2.0-26.41
_amd64.deb) ...
locale: Cannot set LC_CTYPE to default locale: No such file or directory
locale: Cannot set LC_MESSAGES to default locale: No such file or directory
locale: Cannot set LC_ALL to default locale: No such file or directory
Done.
Selecting previously unselected package linux-headers-3.2.0-26.
Unpacking linux-headers-3.2.0-26 (from .../linux-headers-3.2.0-26_3.2.0-26.41_all.deb) ..
.
Selecting previously unselected package linux-headers-3.2.0-26-generic.
Unpacking linux-headers-3.2.0-26-generic (from .../linux-headers-3.2.0-26-generic_3.2.0-2
6.41_amd64.deb) ...
Preparing to replace linux-headers-generic 3.2.0.23.25 (using .../linux-headers-generic_3
.2.0.26.28_amd64.deb) ...
Unpacking replacement linux-headers-generic ...
Preparing to replace linux-image 3.2.0.23.25 (using .../linux-image_3.2.0.26.28_amd64.deb
) ...
Unpacking replacement linux-image ...
Preparing to replace linux-image-generic 3.2.0.23.25 (using .../linux-image-generic_3.2.0
.26.28_amd64.deb) ...
Unpacking replacement linux-image-generic ...
Setting up linux-image-3.2.0-26-generic (3.2.0-26.41) ...
Running depmod.
update-initramfs: deferring update (hook will be called later)
Examining /etc/kernel/postinst.d.
run-parts: executing /etc/kernel/postinst.d/dkms 3.2.0-26-generic /boot/vmlinuz-3.2.0-26-
generic
configure: error:
*** Cannot determine the version of the spl source.
*** ZFS depends on the SPL kernel module, which is not yet ready.
*** DKMS should retry zfs-dkms momentarily after building spl-dkms.
*** If this error message persists, or if you are running DKMS manually,
*** then run 'apt-get install --reinstall spl-dkms' and try again.
Error! Bad return status for module build on kernel: 3.2.0-26-generic (x86_64)
Consult /var/lib/dkms/zfs/0.6.0.66/build/make.log for more information.
run-parts: executing /etc/kernel/postinst.d/initramfs-tools 3.2.0-26-generic /boot/vmlinuz-3.2.0-26-generic
update-initramfs: Generating /boot/initrd.img-3.2.0-26-generic
run-parts: executing /etc/kernel/postinst.d/pm-utils 3.2.0-26-generic /boot/vmlinuz-3.2.0-26-generic
run-parts: executing /etc/kernel/postinst.d/update-notifier 3.2.0-26-generic /boot/vmlinuz-3.2.0-26-generic
run-parts: executing /etc/kernel/postinst.d/zz-update-grub 3.2.0-26-generic /boot/vmlinuz-3.2.0-26-generic
Generating grub.cfg ...
Found linux image: /boot/vmlinuz-3.2.0-26-generic
Found initrd image: /boot/initrd.img-3.2.0-26-generic
Found linux image: /boot/vmlinuz-3.2.0-23-generic
Found initrd image: /boot/initrd.img-3.2.0-23-generic
done
Setting up linux-headers-3.2.0-26 (3.2.0-26.41) ...
Setting up linux-headers-3.2.0-26-generic (3.2.0-26.41) ...
Examining /etc/kernel/header_postinst.d.
run-parts: executing /etc/kernel/header_postinst.d/dkms 3.2.0-26-generic /boot/vmlinuz-3.2.0-26-generic
Setting up linux-headers-generic (3.2.0.26.28) ...
Setting up linux-image-generic (3.2.0.26.28) ...
Setting up linux-image (3.2.0.26.28) ...
Processing triggers for initramfs-tools ...
update-initramfs: Generating /boot/initrd.img-3.2.0-26-generic
Log ended: 2012-07-13 02:47:02

Hope that helps.

@dajhorn

This comment has been minimized.

Show comment
Hide comment
@dajhorn

dajhorn Jul 15, 2012

Member

If the 3.2.0-26 kernel is a dud, then you're probably not going to get a fix before the next kernel update is published. That kind of bug needs a developer to look at it on a work bench.

The Error: Couldn't find a valid label message is spurious in this configuration, so ignore it if the boot pool is forced.

The Cannot determine the version of the spl source. message is also spurious.

The locale warnings indicate that the base system is incompletely configured. Running locale-gen fixes it.

A full /boot area is usually fatal. If an out-of-space error happens here, then manually clear the old img files and run update-initramfs for the current kernel. Also run update-grub to ensure that the grub.cfg file is kosher.

Member

dajhorn commented Jul 15, 2012

If the 3.2.0-26 kernel is a dud, then you're probably not going to get a fix before the next kernel update is published. That kind of bug needs a developer to look at it on a work bench.

The Error: Couldn't find a valid label message is spurious in this configuration, so ignore it if the boot pool is forced.

The Cannot determine the version of the spl source. message is also spurious.

The locale warnings indicate that the base system is incompletely configured. Running locale-gen fixes it.

A full /boot area is usually fatal. If an out-of-space error happens here, then manually clear the old img files and run update-initramfs for the current kernel. Also run update-grub to ensure that the grub.cfg file is kosher.

@behlendorf

This comment has been minimized.

Show comment
Hide comment
@behlendorf

behlendorf Sep 17, 2012

Member

Closing issue. For now this appear to largely be a matter of documentation.

Member

behlendorf commented Sep 17, 2012

Closing issue. For now this appear to largely be a matter of documentation.

@behlendorf behlendorf closed this Sep 17, 2012

@Flink

This comment has been minimized.

Show comment
Hide comment
@Flink

Flink Oct 2, 2012

Hi, I’ve just upgraded to Quantal and grub-probe won’t recognize my zfs filesystem :/
I don’t get the same error than described here but I have this instead:

grub-core/kern/fs.c:55: Detecting zfs...
grub-core/kern/emu/hostdisk.c:909: opening the device `/dev/sda' in open_device()
grub-core/fs/zfs/zfs.c:951: label ok 0
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/fs/zfs/zfs.c:791: check 2 passed
grub-core/fs/zfs/zfs.c:3072: incorrect nvlist header
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/fs/zfs/zfs.c:951: label ok 1
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/fs/zfs/zfs.c:791: check 2 passed
grub-core/fs/zfs/zfs.c:3072: incorrect nvlist header
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/fs/zfs/zfs.c:951: label ok 2
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/fs/zfs/zfs.c:791: check 2 passed
grub-core/fs/zfs/zfs.c:3072: incorrect nvlist header
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/fs/zfs/zfs.c:951: label ok 3
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/fs/zfs/zfs.c:791: check 2 passed
grub-core/fs/zfs/zfs.c:3072: incorrect nvlist header
grub-core/kern/fs.c:77: zfs detection failed.

Any idea?

Flink commented Oct 2, 2012

Hi, I’ve just upgraded to Quantal and grub-probe won’t recognize my zfs filesystem :/
I don’t get the same error than described here but I have this instead:

grub-core/kern/fs.c:55: Detecting zfs...
grub-core/kern/emu/hostdisk.c:909: opening the device `/dev/sda' in open_device()
grub-core/fs/zfs/zfs.c:951: label ok 0
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/fs/zfs/zfs.c:791: check 2 passed
grub-core/fs/zfs/zfs.c:3072: incorrect nvlist header
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/fs/zfs/zfs.c:951: label ok 1
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/fs/zfs/zfs.c:791: check 2 passed
grub-core/fs/zfs/zfs.c:3072: incorrect nvlist header
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/fs/zfs/zfs.c:951: label ok 2
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/fs/zfs/zfs.c:791: check 2 passed
grub-core/fs/zfs/zfs.c:3072: incorrect nvlist header
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/fs/zfs/zfs.c:951: label ok 3
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/kern/emu/hostdisk.c:886: reusing open device `/dev/sda'
grub-core/fs/zfs/zfs.c:791: check 2 passed
grub-core/fs/zfs/zfs.c:3072: incorrect nvlist header
grub-core/kern/fs.c:77: zfs detection failed.

Any idea?

@dajhorn

This comment has been minimized.

Show comment
Hide comment
@dajhorn

dajhorn Oct 2, 2012

Member

@Flink: A grub package for Quantal that has been patched for ZoL has not yet been published. You can use the package from the Precise PPA instead.

Member

dajhorn commented Oct 2, 2012

@Flink: A grub package for Quantal that has been patched for ZoL has not yet been published. You can use the package from the Precise PPA instead.

@Flink

This comment has been minimized.

Show comment
Hide comment
@Flink

Flink Oct 3, 2012

@dajhorn Seems to work. I didn’t reboot yet though ;) Thank you!

Flink commented Oct 3, 2012

@dajhorn Seems to work. I didn’t reboot yet though ;) Thank you!

@mk01

This comment has been minimized.

Show comment
Hide comment
@mk01

mk01 Jan 22, 2013

Contributor

@Flink: it seems runs ok when running from booted system, unfortunately blocks boot with "no label" error, waiting for key press.

@dajhorn: I can't find any info related to mountall and root on zfs. zfs.ko is loaded from initramfs, root is mounted, system will boot properly, but no other fs are mounted (ext4, nfs from /etc/fstab), not even /boot (what is ext2 on usb stick). from terminal zfs mount -a is with no errors. there are solutions, so it's not important, ... but I'm interested.

rootfs is just migrated ext4 from state which mounts properly, just reinstalled zfs-initramfs and zfs-grub.

Contributor

mk01 commented Jan 22, 2013

@Flink: it seems runs ok when running from booted system, unfortunately blocks boot with "no label" error, waiting for key press.

@dajhorn: I can't find any info related to mountall and root on zfs. zfs.ko is loaded from initramfs, root is mounted, system will boot properly, but no other fs are mounted (ext4, nfs from /etc/fstab), not even /boot (what is ext2 on usb stick). from terminal zfs mount -a is with no errors. there are solutions, so it's not important, ... but I'm interested.

rootfs is just migrated ext4 from state which mounts properly, just reinstalled zfs-initramfs and zfs-grub.

@mk01

This comment has been minimized.

Show comment
Hide comment
@mk01

mk01 Jan 23, 2013

Contributor

insmod part_gpt in grub.cfg will solve the grub loading error message.

Contributor

mk01 commented Jan 23, 2013

insmod part_gpt in grub.cfg will solve the grub loading error message.

@wrouesnel

This comment has been minimized.

Show comment
Hide comment
@wrouesnel

wrouesnel Jan 25, 2014

Contributor

It seems like Ubuntu Trusty's package or grub2 now supports feature-flags, but you need to rebuild the source with --enable-libzfs (by editing the rules files).

Sadly I've run headlong into the bad fletcher4 problem with this approach.

Contributor

wrouesnel commented Jan 25, 2014

It seems like Ubuntu Trusty's package or grub2 now supports feature-flags, but you need to rebuild the source with --enable-libzfs (by editing the rules files).

Sadly I've run headlong into the bad fletcher4 problem with this approach.

@gcs-github

This comment has been minimized.

Show comment
Hide comment
@gcs-github

gcs-github Feb 6, 2014

I just ran into the bad fletcher4 problem on Gentoo: 'grub2-probe /' fails, even after an online scrub.

This is a production server, so doing an offline scrub is tricky since it would require me to move the running services on an alternate server for the sake of the test, which is doable, but somewhat costly.

Note that the pool is about a month old, and has always been in version 5000. With 20GB used out of 1.8TB and a 2-disk mirror configuration, I'm quite unsure of how I got here.

Relevant info:

  • Running kernel: 3.12.6-hardened-r3
  • Grub version: 2.02_beta2 (also tested with a live build today from grub's master, yielding the same results)

grub2-probe -vvv / partial output:

grub-core/kern/fs.c:56: Detecting zfs...
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sdb1' in open_device()
grub-core/fs/zfs/zfs.c:1187: label ok 0
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdb1'
grub-core/fs/zfs/zfs.c:1003: check 2 passed
grub-core/fs/zfs/zfs.c:1014: check 3 passed
grub-core/fs/zfs/zfs.c:1021: check 4 passed
grub-core/fs/zfs/zfs.c:1031: check 6 passed
grub-core/fs/zfs/zfs.c:1039: check 7 passed
grub-core/fs/zfs/zfs.c:1050: check 8 passed
grub-core/fs/zfs/zfs.c:1060: check 9 passed
grub-core/fs/zfs/zfs.c:1082: check 11 passed
grub-core/fs/zfs/zfs.c:1107: check 10 passed
grub-core/fs/zfs/zfs.c:1132: check 12 passed (feature flags)
grub-core/fs/zfs/zfs.c:1846: endian = -1
grub-core/fs/zfs/zfs.c:591: dva=1, 8002536
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdb1'
grub-core/fs/zfs/zfs.c:438: checksum fletcher4 verification failed
grub-core/fs/zfs/zfs.c:443: actual checksum 000000249d1ea17b 0000092cb02b2feb 00018adea124b007 0031f40be6d8b696
grub-core/fs/zfs/zfs.c:448: expected checksum 0000000cef0eb3a9 000005035a4a38fc 0000fd944dde6e2f 00221031bd6876af
grub-core/fs/zfs/zfs.c:1860: incorrect checksum
grub-core/kern/fs.c:78: zfs detection failed.

I just ran into the bad fletcher4 problem on Gentoo: 'grub2-probe /' fails, even after an online scrub.

This is a production server, so doing an offline scrub is tricky since it would require me to move the running services on an alternate server for the sake of the test, which is doable, but somewhat costly.

Note that the pool is about a month old, and has always been in version 5000. With 20GB used out of 1.8TB and a 2-disk mirror configuration, I'm quite unsure of how I got here.

Relevant info:

  • Running kernel: 3.12.6-hardened-r3
  • Grub version: 2.02_beta2 (also tested with a live build today from grub's master, yielding the same results)

grub2-probe -vvv / partial output:

grub-core/kern/fs.c:56: Detecting zfs...
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sdb1' in open_device()
grub-core/fs/zfs/zfs.c:1187: label ok 0
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdb1'
grub-core/fs/zfs/zfs.c:1003: check 2 passed
grub-core/fs/zfs/zfs.c:1014: check 3 passed
grub-core/fs/zfs/zfs.c:1021: check 4 passed
grub-core/fs/zfs/zfs.c:1031: check 6 passed
grub-core/fs/zfs/zfs.c:1039: check 7 passed
grub-core/fs/zfs/zfs.c:1050: check 8 passed
grub-core/fs/zfs/zfs.c:1060: check 9 passed
grub-core/fs/zfs/zfs.c:1082: check 11 passed
grub-core/fs/zfs/zfs.c:1107: check 10 passed
grub-core/fs/zfs/zfs.c:1132: check 12 passed (feature flags)
grub-core/fs/zfs/zfs.c:1846: endian = -1
grub-core/fs/zfs/zfs.c:591: dva=1, 8002536
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdb1'
grub-core/fs/zfs/zfs.c:438: checksum fletcher4 verification failed
grub-core/fs/zfs/zfs.c:443: actual checksum 000000249d1ea17b 0000092cb02b2feb 00018adea124b007 0031f40be6d8b696
grub-core/fs/zfs/zfs.c:448: expected checksum 0000000cef0eb3a9 000005035a4a38fc 0000fd944dde6e2f 00221031bd6876af
grub-core/fs/zfs/zfs.c:1860: incorrect checksum
grub-core/kern/fs.c:78: zfs detection failed.
@rstarkey

This comment has been minimized.

Show comment
Hide comment
@rstarkey

rstarkey Oct 20, 2016

Hi, sorry to bring up a long closed issue but ... I followed https://github.com/zfsonlinux/zfs/wiki/Ubuntu%2016.04%20Root%20on%20ZFS
and I'm running into this bug with grub failing zfs checksums and I can reproduce it on a regular basis. In my case though, a simple reboot clears the issue for a short amount of time and then the checksum issue reappears.

I don't think is a documentation issue. :)

How can I support getting this fixed?

rstarkey commented Oct 20, 2016

Hi, sorry to bring up a long closed issue but ... I followed https://github.com/zfsonlinux/zfs/wiki/Ubuntu%2016.04%20Root%20on%20ZFS
and I'm running into this bug with grub failing zfs checksums and I can reproduce it on a regular basis. In my case though, a simple reboot clears the issue for a short amount of time and then the checksum issue reappears.

I don't think is a documentation issue. :)

How can I support getting this fixed?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment