Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.
Sign upProblems starting AppVMs (timeing out on xenbus_probe_frontend) #847
Comments
marmarek
added this to the Release 2 milestone
Mar 8, 2015
marmarek
added
bug
C: kernel
P: critical
labels
Mar 8, 2015
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
Show comment
Hide comment
marmarek
Mar 8, 2015
Member
Comment by joanna on 7 May 2014 08:43 UTC
FWIW, in most cases stopping and then starting the same VM again works.
|
Comment by joanna on 7 May 2014 08:43 UTC |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
Show comment
Hide comment
marmarek
Mar 8, 2015
Member
Comment by marmarek on 7 May 2014 11:28 UTC
In most cases such error have nothing to do with VM itself (neither kernel, or scripts), but some backend initialization in dom0. Check /var/log/xen/xen-hotplug.log. Also xenstore dump would be useful:
xenstore-ls -fp /local/domain/`xl domid VMNAME`/device/vbd \
/local/domain/0/backend/vbd/`xl domid VMNAME`
|
Comment by marmarek on 7 May 2014 11:28 UTC |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
Show comment
Hide comment
marmarek
Mar 8, 2015
Member
Comment by joanna on 7 May 2014 15:20 UTC
FWIW it seems the problem vanishes when I switched to 3.12.14-4 kernel for VMs.
|
Comment by joanna on 7 May 2014 15:20 UTC |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
Show comment
Hide comment
marmarek
Mar 8, 2015
Member
Comment by marmarek on 7 May 2014 15:41 UTC
Still - I think it is totally unrelated to VM kernel. Do you have anything interesting in xen-hotplug.log from previous failed startups?
|
Comment by marmarek on 7 May 2014 15:41 UTC |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
Show comment
Hide comment
marmarek
Mar 8, 2015
Member
Comment by joanna on 15 May 2014 12:25 UTC
For some reason I cannot seem to reproduce it. Current config:
[~](joanna@dom0)$ uname -a
Linux dom0 3.12.18-1.pvops.qubes.x86_64 #1 SMP Mon Apr 28 21:40:24 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
[~](joanna@dom0)$ qubes-prefs
clockvm : firewallvm
default-fw-netvm : firewallvm
default-kernel : 3.12.18-1
default-netvm : firewallvm
default-template : fedora-20-x64
updatevm : firewallvm
[~](joanna@dom0)$ rpm -qa 'xen*'
xen-hvm-4.1.6.1gui2.1.13-12.fc20.x86_64
xen-libs-4.1.6.1-12.fc20.x86_64
xen-runtime-4.1.6.1-12.fc20.x86_64
xen-hypervisor-4.1.6.1-12.fc20.x86_64
xen-licenses-4.1.6.1-12.fc20.x86_64
xen-4.1.6.1-12.fc20.x86_64
I admit I have rebooted my system after experiencing the above mentioned errors, and this might have loaded new Xen/dom0 kernel :/
|
Comment by joanna on 15 May 2014 12:25 UTC I admit I have rebooted my system after experiencing the above mentioned errors, and this might have loaded new Xen/dom0 kernel :/ |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
Show comment
Hide comment
|
Modified by joanna on 15 May 2014 12:25 UTC |
marmarek
added
P: major
and removed
P: critical
labels
Mar 8, 2015
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
Show comment
Hide comment
marmarek
Mar 8, 2015
Member
Comment by joanna on 26 May 2014 10:37 UTC
The problem re-appeared after I rebooted my system (the domain having problems starting is 51):
/local/domain/51/device/vbd/51712 = "" (n51,r0)
/local/domain/51/device/vbd/51712/backend = "/local/domain/0/backend/vbd/51/51712" (n51,r0)
/local/domain/51/device/vbd/51712/backend-id = "0" (n51,r0)
/local/domain/51/device/vbd/51712/state = "4" (n51,r0)
/local/domain/51/device/vbd/51712/virtual-device = "51712" (n51,r0)
/local/domain/51/device/vbd/51712/device-type = "disk" (n51,r0)
/local/domain/51/device/vbd/51712/ring-ref = "9" (n51,r0)
/local/domain/51/device/vbd/51712/event-channel = "32" (n51,r0)
/local/domain/51/device/vbd/51712/protocol = "x86_64-abi" (n51,r0)
/local/domain/51/device/vbd/51712/feature-persistent = "1" (n51,r0)
/local/domain/51/device/vbd/51728 = "" (n51,r0)
/local/domain/51/device/vbd/51728/backend = "/local/domain/0/backend/vbd/51/51728" (n51,r0)
/local/domain/51/device/vbd/51728/backend-id = "0" (n51,r0)
/local/domain/51/device/vbd/51728/state = "4" (n51,r0)
/local/domain/51/device/vbd/51728/virtual-device = "51728" (n51,r0)
/local/domain/51/device/vbd/51728/device-type = "disk" (n51,r0)
/local/domain/51/device/vbd/51728/ring-ref = "10" (n51,r0)
/local/domain/51/device/vbd/51728/event-channel = "33" (n51,r0)
/local/domain/51/device/vbd/51728/protocol = "x86_64-abi" (n51,r0)
/local/domain/51/device/vbd/51728/feature-persistent = "1" (n51,r0)
/local/domain/51/device/vbd/51744 = "" (n51,r0)
/local/domain/51/device/vbd/51744/backend = "/local/domain/0/backend/vbd/51/51744" (n51,r0)
/local/domain/51/device/vbd/51744/backend-id = "0" (n51,r0)
/local/domain/51/device/vbd/51744/state = "4" (n51,r0)
/local/domain/51/device/vbd/51744/virtual-device = "51744" (n51,r0)
/local/domain/51/device/vbd/51744/device-type = "disk" (n51,r0)
/local/domain/51/device/vbd/51744/ring-ref = "11" (n51,r0)
/local/domain/51/device/vbd/51744/event-channel = "34" (n51,r0)
/local/domain/51/device/vbd/51744/protocol = "x86_64-abi" (n51,r0)
/local/domain/51/device/vbd/51744/feature-persistent = "1" (n51,r0)
/local/domain/51/device/vbd/51760 = "" (n51,r0)
/local/domain/51/device/vbd/51760/backend = "/local/domain/0/backend/vbd/51/51760" (n51,r0)
/local/domain/51/device/vbd/51760/backend-id = "0" (n51,r0)
/local/domain/51/device/vbd/51760/state = "3" (n51,r0)
/local/domain/51/device/vbd/51760/virtual-device = "51760" (n51,r0)
/local/domain/51/device/vbd/51760/device-type = "disk" (n51,r0)
/local/domain/51/device/vbd/51760/ring-ref = "12" (n51,r0)
/local/domain/51/device/vbd/51760/event-channel = "35" (n51,r0)
/local/domain/51/device/vbd/51760/protocol = "x86_64-abi" (n51,r0)
/local/domain/51/device/vbd/51760/feature-persistent = "1" (n51,r0)
/local/domain/0/backend/vbd/51/51712 = "" (n0,r51)
/local/domain/0/backend/vbd/51/51712/frontend = "/local/domain/51/device/vbd/51712" (n0,r51)
/local/domain/0/backend/vbd/51/51712/params = "/var/lib/qubes/vm-templates/fedora-20-x64/root.img:/var/lib/qubes/vm-templates/fedora-20-x64/root-cow.img" (n0,r51)
/local/domain/0/backend/vbd/51/51712/scripted = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51712/frontend-id = "51" (n0,r51)
/local/domain/0/backend/vbd/51/51712/online = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51712/removable = "0" (n0,r51)
/local/domain/0/backend/vbd/51/51712/bootable = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51712/state = "4" (n0,r51)
/local/domain/0/backend/vbd/51/51712/dev = "xvda" (n0,r51)
/local/domain/0/backend/vbd/51/51712/type = "snapshot" (n0,r51)
/local/domain/0/backend/vbd/51/51712/mode = "r" (n0,r51)
/local/domain/0/backend/vbd/51/51712/node = "/dev/mapper/snapshot-fd02:7606897-fd02:7602222" (n0,r51)
/local/domain/0/backend/vbd/51/51712/physical-device = "fd:4" (n0,r51)
/local/domain/0/backend/vbd/51/51712/hotplug-status = "connected" (n0,r51)
/local/domain/0/backend/vbd/51/51712/feature-flush-cache = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51712/feature-discard = "0" (n0,r51)
/local/domain/0/backend/vbd/51/51712/feature-barrier = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51712/feature-persistent = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51712/feature-max-indirect-segments = "256" (n0,r51)
/local/domain/0/backend/vbd/51/51712/sectors = "20971520" (n0,r51)
/local/domain/0/backend/vbd/51/51712/info = "4" (n0,r51)
/local/domain/0/backend/vbd/51/51712/sector-size = "512" (n0,r51)
/local/domain/0/backend/vbd/51/51712/physical-sector-size = "512" (n0,r51)
/local/domain/0/backend/vbd/51/51728 = "" (n0,r51)
/local/domain/0/backend/vbd/51/51728/frontend = "/local/domain/51/device/vbd/51728" (n0,r51)
/local/domain/0/backend/vbd/51/51728/params = "/var/lib/qubes/appvms/vault/private.img" (n0,r51)
/local/domain/0/backend/vbd/51/51728/scripted = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51728/frontend-id = "51" (n0,r51)
/local/domain/0/backend/vbd/51/51728/online = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51728/removable = "0" (n0,r51)
/local/domain/0/backend/vbd/51/51728/bootable = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51728/state = "4" (n0,r51)
/local/domain/0/backend/vbd/51/51728/dev = "xvdb" (n0,r51)
/local/domain/0/backend/vbd/51/51728/type = "file" (n0,r51)
/local/domain/0/backend/vbd/51/51728/mode = "w" (n0,r51)
/local/domain/0/backend/vbd/51/51728/node = "/dev/loop23" (n0,r51)
/local/domain/0/backend/vbd/51/51728/physical-device = "7:17" (n0,r51)
/local/domain/0/backend/vbd/51/51728/hotplug-status = "connected" (n0,r51)
/local/domain/0/backend/vbd/51/51728/feature-flush-cache = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51728/discard-granularity = "4096" (n0,r51)
/local/domain/0/backend/vbd/51/51728/discard-alignment = "0" (n0,r51)
/local/domain/0/backend/vbd/51/51728/discard-secure = "0" (n0,r51)
/local/domain/0/backend/vbd/51/51728/feature-discard = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51728/feature-barrier = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51728/feature-persistent = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51728/feature-max-indirect-segments = "256" (n0,r51)
/local/domain/0/backend/vbd/51/51728/sectors = "4194304" (n0,r51)
/local/domain/0/backend/vbd/51/51728/info = "0" (n0,r51)
/local/domain/0/backend/vbd/51/51728/sector-size = "512" (n0,r51)
/local/domain/0/backend/vbd/51/51728/physical-sector-size = "512" (n0,r51)
/local/domain/0/backend/vbd/51/51744 = "" (n0,r51)
/local/domain/0/backend/vbd/51/51744/frontend = "/local/domain/51/device/vbd/51744" (n0,r51)
/local/domain/0/backend/vbd/51/51744/params = "/var/lib/qubes/appvms/vault/volatile.img" (n0,r51)
/local/domain/0/backend/vbd/51/51744/scripted = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51744/frontend-id = "51" (n0,r51)
/local/domain/0/backend/vbd/51/51744/online = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51744/removable = "0" (n0,r51)
/local/domain/0/backend/vbd/51/51744/bootable = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51744/state = "4" (n0,r51)
/local/domain/0/backend/vbd/51/51744/dev = "xvdc" (n0,r51)
/local/domain/0/backend/vbd/51/51744/type = "file" (n0,r51)
/local/domain/0/backend/vbd/51/51744/mode = "w" (n0,r51)
/local/domain/0/backend/vbd/51/51744/node = "/dev/loop24" (n0,r51)
/local/domain/0/backend/vbd/51/51744/physical-device = "7:18" (n0,r51)
/local/domain/0/backend/vbd/51/51744/hotplug-status = "connected" (n0,r51)
/local/domain/0/backend/vbd/51/51744/feature-flush-cache = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51744/discard-granularity = "4096" (n0,r51)
/local/domain/0/backend/vbd/51/51744/discard-alignment = "0" (n0,r51)
/local/domain/0/backend/vbd/51/51744/discard-secure = "0" (n0,r51)
/local/domain/0/backend/vbd/51/51744/feature-discard = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51744/feature-barrier = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51744/feature-persistent = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51744/feature-max-indirect-segments = "256" (n0,r51)
/local/domain/0/backend/vbd/51/51744/sectors = "23068672" (n0,r51)
/local/domain/0/backend/vbd/51/51744/info = "0" (n0,r51)
/local/domain/0/backend/vbd/51/51744/sector-size = "512" (n0,r51)
/local/domain/0/backend/vbd/51/51744/physical-sector-size = "512" (n0,r51)
/local/domain/0/backend/vbd/51/51760 = "" (n0,r51)
/local/domain/0/backend/vbd/51/51760/frontend = "/local/domain/51/device/vbd/51760" (n0,r51)
/local/domain/0/backend/vbd/51/51760/params = "/var/lib/qubes/vm-kernels/3.12.18-1/modules.img" (n0,r51)
/local/domain/0/backend/vbd/51/51760/scripted = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51760/frontend-id = "51" (n0,r51)
/local/domain/0/backend/vbd/51/51760/online = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51760/removable = "0" (n0,r51)
/local/domain/0/backend/vbd/51/51760/bootable = "1" (n0,r51)
/local/domain/0/backend/vbd/51/51760/state = "2" (n0,r51)
/local/domain/0/backend/vbd/51/51760/dev = "xvdd" (n0,r51)
/local/domain/0/backend/vbd/51/51760/type = "file" (n0,r51)
/local/domain/0/backend/vbd/51/51760/mode = "r" (n0,r51)
/local/domain/0/backend/vbd/51/51760/hotplug-error = "Path closed or removed during hotplug add: backend/vbd/51/51760 state: 1" (n0,r51)
/local/domain/0/backend/vbd/51/51760/hotplug-status = "error" (n0,r51)
|
Comment by joanna on 26 May 2014 10:37 UTC |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
Show comment
Hide comment
marmarek
Mar 8, 2015
Member
Comment by joanna on 26 May 2014 10:41 UTC
And the guest log:
[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Initializing cgroup subsys cpuacct
[ 0.000000] Linux version 3.12.18-1.pvops.qubes.x86_64 (user@qubes) (gcc version 4.8.2 20131212 (Red Hat 4.8.2-7) (GCC) ) #1 SMP Mon Apr 28 21:40:24 UTC 2014
[ 0.000000] Command line: root=/dev/mapper/dmroot ro nomodeset console=hvc0 rd_NO_PLYMOUTH nopat
[ 0.000000] Disabled fast string operations
[ 0.000000] ACPI in unprivileged domain disabled
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] Xen: [0x0000000000000000-0x000000000009ffff](mem) usable
[ 0.000000] Xen: [0x00000000000a0000-0x00000000000fffff](mem) reserved
[ 0.000000] Xen: [0x0000000000100000-0x00000000fccfffff](mem) usable
[ 0.000000] PAT support disabled.
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] DMI not present or invalid.
[ 0.000000] No AGP bridge found
[ 0.000000] e820: last_pfn = 0xfcd00 max_arch_pfn = 0x400000000
[ 0.000000] init_memory_mapping: [0x00000000-0x000fffff](mem)
[ 0.000000] init_memory_mapping: [0x18e00000-0x18ffffff](mem)
[ 0.000000] init_memory_mapping: [0x18000000-0x18dfffff](mem)
[ 0.000000] init_memory_mapping: [0x00100000-0x17ffffff](mem)
[ 0.000000] init_memory_mapping: [0x19000000-0xfccfffff](mem)
[ 0.000000] RAMDISK: [0x020a0000-0x04812fff](mem)
[ 0.000000] Zone ranges:
[ 0.000000] DMA [0x00001000-0x00ffffff](mem)
[ 0.000000] DMA32 [0x01000000-0xffffffff](mem)
[ 0.000000] Normal empty
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [0x00001000-0x0009ffff](mem)
[ 0.000000] node 0: [0x00100000-0xfccfffff](mem)
[ 0.000000] SFI: Simple Firmware Interface v0.81 http://simplefirmware.org
[ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
[ 0.000000] e820: [0xfcd00000-0xffffffff](mem) available for PCI devices
[ 0.000000] Booting paravirtualized kernel on Xen
[ 0.000000] Xen version: 4.1.6.1 (preserve-AD)
[ 0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:4 nr_node_ids:1
[ 0.000000] PERCPU: Embedded 28 pages/cpu @ffff880018400000 s85312 r8192 d21184 u524288
[ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 1021244
[ 0.000000] Kernel command line: root=/dev/mapper/dmroot ro nomodeset console=hvc0 rd_NO_PLYMOUTH nopat
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
[ 0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
[ 0.000000] Checking aperture...
[ 0.000000] No AGP bridge found
[ 0.000000] Memory: 282664K/4141692K available (5047K kernel code, 576K rwdata, 2344K rodata, 948K init, 992K bss, 3859028K reserved)
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] RCU dyntick-idle grace-period acceleration is enabled.
[ 0.000000] RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=4.
[ 0.000000] Offload RCU callbacks from all CPUs
[ 0.000000] Offload RCU callbacks from CPUs: 0-511.
[ 0.000000] NR_IRQS:33024 nr_irqs:304 16
[ 0.000000] Console: colour dummy device 80x25
[ 0.000000] console [enabled
[ 0.000000](tty0]) console [enabled
[ 0.000000](hvc0]) installing Xen timer for CPU 0
[ 0.000000] tsc: Detected 2591.632 MHz processor
[ 0.004000] Calibrating delay loop (skipped), value calculated using timer frequency.. 5183.26 BogoMIPS (lpj=10366528)
[ 0.004000] pid_max: default: 32768 minimum: 301
[ 0.004000] Mount-cache hash table entries: 256
[ 0.004000] Initializing cgroup subsys devices
[ 0.004000] Initializing cgroup subsys freezer
[ 0.004000] Initializing cgroup subsys net_cls
[ 0.004000] Initializing cgroup subsys blkio
[ 0.004000] Disabled fast string operations
[ 0.004000] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[ 0.004000] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[ 0.004000] CPU: Physical Processor ID: 0
[ 0.004000] CPU: Processor Core ID: 1
[ 0.004000] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[ 0.004000] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[ 0.004000] tlb_flushall_shift: 5
[ 0.022497] cpu 0 spinlock event irq 17
[ 0.022539] Performance Events: unsupported p6 CPU model 42 no PMU driver, software events only.
[ 0.023213] installing Xen timer for CPU 1
[ 0.023234] cpu 1 spinlock event irq 24
[ 0.023260] SMP alternatives: switching to SMP code
[ 0.023107] Disabled fast string operations
[ 0.043788] installing Xen timer for CPU 2
[ 0.043808] cpu 2 spinlock event irq 31
[ 0.043700] Disabled fast string operations
[ 0.044055] installing Xen timer for CPU 3
[ 0.044069] cpu 3 spinlock event irq 38
[ 0.044000] Disabled fast string operations
[ 0.044203] Brought up 4 CPUs
[ 0.044283] devtmpfs: initialized
[ 0.046541] xen:grant_table: Grant tables using version 2 layout
[ 0.046541] Grant table initialized
[ 0.046541] regulator-dummy: no parameters
[ 0.066907] RTC time: 165:165:165, date: 165/165/65
[ 0.067148] NET: Registered protocol family 16
[ 0.068474] PCI: setting up Xen PCI frontend stub
[ 0.070102] bio: create slab <bio-0> at 0
[ 0.072244] ACPI: Interpreter disabled.
[ 0.072261] xen:balloon: Initialising balloon driver
[ 0.084039] xen_balloon: Initialising balloon driver
[ 0.084060] vgaarb: loaded
[ 0.084115] PCI: System does not support PCI
[ 0.084115] PCI: System does not support PCI
[ 0.088067] Switched to clocksource xen
[ 0.089898] pnp: PnP ACPI: disabled
[ 0.092465] NET: Registered protocol family 2
[ 0.092717] TCP established hash table entries: 32768 (order: 7, 524288 bytes)
[ 0.092800] TCP bind hash table entries: 32768 (order: 7, 524288 bytes)
[ 0.092873] TCP: Hash tables configured (established 32768 bind 32768)
[ 0.092894] TCP: reno registered
[ 0.092898] UDP hash table entries: 2048 (order: 4, 65536 bytes)
[ 0.092909] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes)
[ 0.093023] NET: Registered protocol family 1
[ 0.093082] Unpacking initramfs...
[ 0.135859] Freeing initrd memory: 40396K (ffff8800020a0000 - ffff880004813000)
[ 0.135999] platform rtc_cmos: registered platform RTC device (no PNP device found)
[ 0.136554] microcode: CPU0 sig=0x206a7, pf=0x10, revision=0x25
[ 0.136578] microcode: CPU1 sig=0x206a7, pf=0x10, revision=0x25
[ 0.136594] microcode: CPU2 sig=0x206a7, pf=0x10, revision=0x25
[ 0.136623] microcode: CPU3 sig=0x206a7, pf=0x10, revision=0x25
[ 0.136677] microcode: Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[ 0.136914] audit: initializing netlink socket (disabled)
[ 0.136934] type=2000 audit(1401100222.841:1): initialized
[ 0.165770] bounce pool size: 64 pages
[ 0.166227] VFS: Disk quotas dquot_6.5.2
[ 0.166261] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.166418] msgmni has been set to 630
[ 0.166749] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
[ 0.166769] io scheduler noop registered
[ 0.166775] io scheduler deadline registered
[ 0.166882] io scheduler cfq registered (default)
[ 0.166998] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[ 0.167035] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[ 0.179295] xen:xen_evtchn: Event-channel device installed
[ 0.180018] Non-volatile memory driver v1.3
[ 0.180727] loop: module loaded
[ 0.180766] libphy: Fixed MDIO Bus: probed
[ 0.180790] i8042: PNP: No PS/2 controller found. Probing ports directly.
[ 1.193861] i8042: No controller found
[ 1.194051] mousedev: PS/2 mouse device common for all mice
[ 1.254231] rtc_cmos rtc_cmos: rtc core: registered rtc_cmos as rtc0
[ 1.254448] rtc_cmos: probe of rtc_cmos failed with error -38
[ 1.254552] device-mapper: uevent: version 1.0.3
[ 1.254918] device-mapper: ioctl: 4.26.0-ioctl (2013-08-15) initialised: dm-devel@redhat.com
[ 1.255179] TCP: cubic registered
[ 1.255584] NET: Registered protocol family 10
[ 1.255993] Key type dns_resolver registered
[ 1.256475] registered taskstats version 1
[ 1.426080] pcifront pci-0: Installing PCI frontend
[ 1.426102] xen:swiotlb_xen: Warning: only able to allocate 4 MB for software IO TLB
[ 1.428395] software IO TLB [0x03c00000-0x04000000](mem) (4MB) mapped at [ 1.428697](ffff880003c00000-ffff880003ffffff]
[) pcifront pci-0: Creating PCI Frontend Bus 0000:00
[ 1.428752] pcifront pci-0: PCI host bridge to bus 0000:00
[ 1.428759] pci_bus 0000:00: root bus resource [ 0x0000-0xffff](io)
[ 1.428764] pci_bus 0000:00: root bus resource [0x00000000-0xfffffffff](mem)
[ 1.428769] pci_bus 0000:00: root bus resource [00-ff](bus)
[ 1.456179] xenbus_probe_frontend: Device with no driver: device/vbd/51712
[ 1.456194] xenbus_probe_frontend: Device with no driver: device/vbd/51728
[ 1.456198] xenbus_probe_frontend: Device with no driver: device/vbd/51744
[ 1.456202] xenbus_probe_frontend: Device with no driver: device/vbd/51760
[ 1.456208] regulator-dummy: incomplete constraints, leaving on
[ 1.456647] Magic number: 1:252:3141
[ 1.456687] /home/user/rpmbuild/BUILD/kernel-3.12.18/linux-3.12.18/drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
[ 1.457478] Freeing unused kernel memory: 948K (ffffffff81a92000 - ffffffff81b7f000)
[ 1.457488] Write protecting the kernel read-only data: 10240k
[ 1.467610] Freeing unused kernel memory: 1084K (ffff8800014f1000 - ffff880001600000)
[ 1.470208] Freeing unused kernel memory: 1752K (ffff88000184a000 - ffff880001a00000)
[ 1.484536] systemd[systemd 208 running in system mode. (+PAM +LIBWRAP +AUDIT +SELINUX +IMA +SYSVINIT +LIBCRYPTSETUP +GCRYPT +ACL +XZ)
[ 1.484700](1]:) systemd[Detected virtualization 'xen'.
[ 1.484725](1]:) systemd[Running in initial RAM disk.
Welcome to .[0;34mFedora 20 (Heisenbug) dracut-037-11.git20140402.fc20 (Initramfs).[0m!
[ 1.487227](1]:) systemd[Inserted module 'autofs4'
[ 1.487516](1]:) systemd[No hostname configured.
[ 1.487550](1]:) systemd[Set hostname to <localhost>.
[ 1.487698](1]:) systemd[Initializing machine ID from random generator.
[ 1.599852](1]:) systemd[Expecting device dev-mapper-dmroot.device...
Expecting device dev-mapper-dmroot.device...
[ 1.599926](1]:) systemd[Starting -.slice.
[.[32m OK .[0m](1]:) Created slice -.slice.
[ 1.600174] systemd[Created slice -.slice.
[ 1.600194](1]:) systemd[Starting System Slice.
[.[32m OK .[0m](1]:) Created slice System Slice.
[ 1.600289] systemd[Created slice System Slice.
[ 1.600302](1]:) systemd[Starting Slices.
[.[32m OK .[0m](1]:) Reached target Slices.
[ 1.600332] systemd[Reached target Slices.
[ 1.600343](1]:) systemd[Starting Timers.
[.[32m OK .[0m](1]:) Reached target Timers.
[ 1.600371] systemd[Reached target Timers.
[ 1.600389](1]:) systemd[Starting udev Kernel Socket.
[.[32m OK .[0m](1]:) Listening on udev Kernel Socket.
[ 1.600447] systemd[Listening on udev Kernel Socket.
[ 1.600465](1]:) systemd[Starting udev Control Socket.
[.[32m OK .[0m](1]:) Listening on udev Control Socket.
[ 1.600526] systemd[Listening on udev Control Socket.
[ 1.600538](1]:) systemd[Starting Encrypted Volumes.
[.[32m OK .[0m](1]:) Reached target Encrypted Volumes.
[ 1.600564] systemd[Reached target Encrypted Volumes.
[ 1.600580](1]:) systemd[Starting Dispatch Password Requests to Console Directory Watch.
[ 1.600644](1]:) systemd[Started Dispatch Password Requests to Console Directory Watch.
[ 1.600657](1]:) systemd[Starting Paths.
[.[32m OK .[0m](1]:) Reached target Paths.
[ 1.600687] systemd[Reached target Paths.
[ 1.600700](1]:) systemd[Starting Journal Socket.
[.[32m OK .[0m](1]:) Listening on Journal Socket.
[ 1.600799] systemd[Listening on Journal Socket.
[ 1.600934](1]:) systemd[Starting dracut cmdline hook...
Starting dracut cmdline hook...
[ 1.601686](1]:) systemd[Starting Create list of required static device nodes for the current kernel...
Starting Create list of required static device nodes...rrent kernel...
[ 1.602458](1]:) systemd[Starting Sockets.
[.[32m OK .[0m](1]:) Reached target Sockets.
[ 1.602517] systemd[Reached target Sockets.
[ 1.602545](1]:) systemd[Starting Journal Service...
Starting Journal Service...
[.[32m OK .[0m](1]:) Started Journal Service.
[ 1.628167] systemd[Started Journal Service.
Starting Apply Kernel Variables...
[.[32m OK .[0m](1]:) Reached target Swap.
[ OK .[0m](.[32m) Reached target Local File Systems.
[ OK .[0m](.[32m) Started Create list of required static device nodes ...current kernel.
Starting Create static device nodes in /dev...
[ OK .[0m](.[32m) Started Apply Kernel Variables.
[ OK .[0m](.[32m) Started Create static device nodes in /dev.
[ OK .[0m](.[32m) Started dracut cmdline hook.
Starting dracut pre-udev hook...
[ 2.154591] blkfront: xvda: flush diskcache: enabled; persistent grants: enabled; indirect descriptors: enabled;
[ 2.203696] xvda: unknown partition table
[ 2.288493] blkfront: xvdb: flush diskcache: enabled; persistent grants: enabled; indirect descriptors: enabled;
[ 2.294957] xvdb: unknown partition table
[ 2.323439] blkfront: xvdc: flush diskcache: enabled; persistent grants: enabled; indirect descriptors: enabled;
[ 2.324803] xvdc: xvdc1 xvdc2
[ 7.332162] xenbus_probe_frontend: Waiting for devices to initialise: 25s...20s...15s...10s...5s...0s...
[ 37.332204] 235s...230s...225s...220s...215s...210s...205s...200s...195s...190s...185s...180s...175s...170s...165s...160s...155s...150s...145s...140s...135s...130s...125s...120s...115s...110s...105s...100s...95s...90s...85s...80s...75s...70s...65s...60s...55s...50s...45s...40s...35s...30s...25s...20s...15s...10s...5s...0s...
[ 272.332231]
[ 272.332732] xenbus_probe_frontend: Timeout connecting to device: device/vbd/51760 (local state 3, remote state 2)
[ 272.371665] bio: create slab <bio-1> at 1
[ OK .[0m](.[32m) Started dracut pre-udev hook.
Starting udev Kernel Device Manager...
[ 272.533570] systemd-udevd[starting version 208
[.[32m OK .[0m](211]:) Started udev Kernel Device Manager.
Starting dracut pre-trigger hook...
[ OK .[0m](.[32m) Found device /dev/mapper/dmroot.
[ OK .[0m](.[32m) Started dracut pre-trigger hook.
Starting udev Coldplug all Devices...
[ OK .[0m](.[32m) Started udev Coldplug all Devices.
Starting dracut initqueue hook...
[ OK .[0m](.[32m) Reached target System Initialization.
[ OK .[0m](.[32m) Reached target Basic System.
[ OK .[0m](.[32m) Started dracut initqueue hook.
Starting dracut pre-mount hook...
[ OK .[0m](.[32m) Started dracut pre-mount hook.
Mounting /sysroot...
[ 273.041889] EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null)
[ OK .[0m](.[32m) Mounted /sysroot.
[ OK .[0m](.[32m) Reached target Initrd Root File System.
Starting Reload Configuration from the Real Root...
[ OK .[0m](.[32m) Started Reload Configuration from the Real Root.
[ OK .[0m](.[32m) Reached target Initrd File Systems.
[ OK .[0m](.[32m) Reached target Initrd Default Target.
|
Comment by joanna on 26 May 2014 10:41 UTC |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
Show comment
Hide comment
marmarek
Mar 8, 2015
Member
Comment by marmarek on 26 May 2014 13:40 UTC
Guest log is irrelevant here, important xenstore entry:
/local/domain/0/backend/vbd/51/51760/hotplug-error = "Path closed or removed during hotplug add: backend/vbd/51/51760 state: 1" (n0,r51)
Looks like some race condition between libxl and hotplug script in dom0. At least I know what to look for.
|
Comment by marmarek on 26 May 2014 13:40 UTC Looks like some race condition between libxl and hotplug script in dom0. At least I know what to look for. |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
Show comment
Hide comment
marmarek
Mar 8, 2015
Member
Comment by marmarek on 26 May 2014 15:47 UTC
Actually it was a race between kernel (backend driver) and hotplug script. Kernel first send an event to udevd (to call hotplug script), and then set state=2 in xenstore. Because of driver architecture it is rather hard to fix, so added a workaround in hotplug script.
|
Comment by marmarek on 26 May 2014 15:47 UTC |
marmarek
self-assigned this
Mar 8, 2015
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
Show comment
Hide comment
|
Modified by woju on 27 May 2014 15:21 UTC |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
Show comment
Hide comment
marmarek
Mar 8, 2015
Member
Comment by marmarek on 28 Jun 2014 15:04 UTC
That race is fixed here:
http://git.qubes-os.org/?p=marmarek/vmm-xen.git;a=commit;h=cfc8e9fc354a0065578f812bda6ff2d823e5aea0
(and a regression introduced by this patch fixed here: http://git.qubes-os.org/?p=marmarek/core-admin.git;a=commit;h=5443826fff9a1d32b38302986b3c0088b7c55be4)
Does that dom0 oops is still happening?
|
Comment by marmarek on 28 Jun 2014 15:04 UTC Does that dom0 oops is still happening? |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
Show comment
Hide comment
marmarek
Mar 8, 2015
Member
Comment by joanna on 30 Jun 2014 11:35 UTC
Shall we close it? Things seem to be working correct now for me...
xen 4.1.6.1-14
kernel 3.12.23-1
core-admin 2.1.55
|
Comment by joanna on 30 Jun 2014 11:35 UTC xen 4.1.6.1-14 |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
Show comment
Hide comment
|
Modified by joanna on 1 Jul 2014 18:51 UTC |
marmarek
closed this
Mar 8, 2015
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
marmarek commentedMar 8, 2015
Reported by joanna on 7 May 2014 08:42 UTC
Recently I started seeing this pretty often -- perhaps this is caused by the new (3.12) VM kernel?
Migrated-From: https://wiki.qubes-os.org/ticket/847