New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

qvm-pci attach to running VM failed - fix or improve error message - Got empty response from qubesd. See journalctl in dom0 for details #3263

Closed
adrelanos opened this Issue Oct 30, 2017 · 8 comments

Comments

Projects
None yet
4 participants
@adrelanos
Member

adrelanos commented Oct 30, 2017

Qubes OS version:

R4

Affected TemplateVMs:

dom0


Steps to reproduce the behavior:

Start sys-usb without any PCI devices attached.

Actual behavior:

When trying to attach a USB controller while sys-usb is already running.

qvm-pci attach --persistent sys-usb dom0:00_1a.0
Got empty response from qubesd. See journalctl in dom0 for details

Neither that message or journalctl output can be understood by the user.

Expected behavior:

PCI attachment functional or user-useful error message.

General notes:

Oct 30 13:10:29 dom0 libvirtd[2314]: 2017-10-30 12:10:29.332+0000: 2346: error : libxlDomainAttachHostPCIDevice:3250 : internal error: libxenlight failed to attach pci device 0000:00:1a.0
Oct 30 13:10:29 dom0 qubesd[10630]: unhandled exception while calling src=b'dom0' meth=b'admin.vm.device.pci.Attach' dest=b'sys-usb' arg=b'dom0+00_1a.0' len(untrusted_payload)=15
Oct 30 13:10:29 dom0 qubesd[10630]: Traceback (most recent call last):
Oct 30 13:10:29 dom0 qubesd[10630]:   File "/usr/lib/python3.5/site-packages/qubes/api/__init__.py", line 262, in respond
Oct 30 13:10:29 dom0 qubesd[10630]:     untrusted_payload=untrusted_payload)
Oct 30 13:10:29 dom0 qubesd[10630]:   File "/usr/lib64/python3.5/asyncio/futures.py", line 381, in __iter__
Oct 30 13:10:29 dom0 qubesd[10630]:     yield self  # This tells Task to wait for completion.
Oct 30 13:10:29 dom0 qubesd[10630]:   File "/usr/lib64/python3.5/asyncio/tasks.py", line 310, in _wakeup
Oct 30 13:10:29 dom0 qubesd[10630]:     future.result()
Oct 30 13:10:29 dom0 qubesd[10630]:   File "/usr/lib64/python3.5/asyncio/futures.py", line 294, in result
Oct 30 13:10:29 dom0 qubesd[10630]:     raise self._exception
Oct 30 13:10:29 dom0 qubesd[10630]:   File "/usr/lib64/python3.5/asyncio/tasks.py", line 240, in _step
Oct 30 13:10:29 dom0 qubesd[10630]:     result = coro.send(None)
Oct 30 13:10:29 dom0 qubesd[10630]:   File "/usr/lib/python3.5/site-packages/qubes/api/admin.py", line 1109, in vm_device_attach
Oct 30 13:10:29 dom0 qubesd[10630]:     yield from self.dest.devices[devclass].attach(assignment)
Oct 30 13:10:29 dom0 qubesd[10630]:   File "/usr/lib/python3.5/site-packages/qubes/devices.py", line 255, in attach
Oct 30 13:10:29 dom0 qubesd[10630]:     device=device, options=device_assignment.options)
Oct 30 13:10:29 dom0 qubesd[10630]:   File "/usr/lib/python3.5/site-packages/qubes/events.py", line 229, in fire_event_async
Oct 30 13:10:29 dom0 qubesd[10630]:     kwargs, pre_event=pre_event)
Oct 30 13:10:29 dom0 qubesd[10630]:   File "/usr/lib/python3.5/site-packages/qubes/events.py", line 164, in _fire_event
Oct 30 13:10:29 dom0 qubesd[10630]:     effect = func(self, event, **kwargs)
Oct 30 13:10:29 dom0 qubesd[10630]:   File "/usr/lib/python3.5/site-packages/qubes/ext/pci.py", line 235, in on_device_pre_attached_pci
Oct 30 13:10:29 dom0 qubesd[10630]:     device=device, vm=vm, options=options))
Oct 30 13:10:29 dom0 qubesd[10630]:   File "/usr/lib/python3.5/site-packages/qubes/app.py", line 94, in wrapper
Oct 30 13:10:29 dom0 qubesd[10630]:     return attr(*args, **kwargs)
Oct 30 13:10:29 dom0 qubesd[10630]:   File "/usr/lib64/python3.5/site-packages/libvirt.py", line 563, in attachDevice
Oct 30 13:10:29 dom0 qubesd[10630]:     if ret == -1: raise libvirtError ('virDomainAttachDevice() failed', dom=self)
Oct 30 13:10:29 dom0 qubesd[10630]: libvirt.libvirtError: internal error: libxenlight failed to attach pci device 0000:00:1a.0

Related issues:

#3205

@adrelanos adrelanos changed the title from PCI attach to running VM failed - fix or improve error message - Got empty response from qubesd. See journalctl in dom0 for details to qvm-pci attach to running VM failed - fix or improve error message - Got empty response from qubesd. See journalctl in dom0 for details Oct 30, 2017

@marmarek

This comment has been minimized.

Show comment
Hide comment
@marmarek

marmarek Oct 30, 2017

Member

Do you see anything interesting in /var/log/libvirt/libxl/libxl-driver.log? If yes, I think the message should point to that log.

Member

marmarek commented Oct 30, 2017

Do you see anything interesting in /var/log/libvirt/libxl/libxl-driver.log? If yes, I think the message should point to that log.

@adrelanos

This comment has been minimized.

Show comment
Hide comment
@adrelanos

adrelanos Oct 30, 2017

Member

Dunno if anything interesting. Please check my /var/log/libvirt/libxl/libxl-driver.log here:

2017-10-19 09:41:27.288+0000: libxl: libxl_pci.c:1167:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 09:47:26.202+0000: libxl: libxl_device.c:1356:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/5/0 not ready
2017-10-19 09:47:37.311+0000: libxl: libxl_device.c:1356:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/5/0 not ready
2017-10-19 10:32:30.403+0000: libxl: libxl_pci.c:1167:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 10:32:40.450+0000: libxl: libxl_device.c:1356:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/8/0 not ready
2017-10-19 10:32:40.457+0000: libxl: libxl_pci.c:1485:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-19 10:32:50.625+0000: libxl: libxl_device.c:1356:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/8/0 not ready
2017-10-19 10:33:00.806+0000: libxl: libxl_device.c:1356:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/8/0 not ready
2017-10-19 10:33:00.865+0000: libxl: libxl_device.c:1264:device_destroy_be_watch_cb: timed out while waiting for /local/domain/9/backend/vif/11/0 to be removed
2017-10-19 10:33:00.869+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 11
2017-10-19 10:33:00.878+0000: libxl: libxl_device.c:1264:device_destroy_be_watch_cb: timed out while waiting for /local/domain/9/backend/vif/10/0 to be removed
2017-10-19 10:33:00.881+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 10
2017-10-19 10:33:10.985+0000: libxl: libxl_device.c:1356:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/9/0 not ready
2017-10-19 10:33:22.110+0000: libxl: libxl_device.c:1356:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/9/0 not ready
2017-10-19 10:37:18.171+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 13:59:17.533+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/30/0
2017-10-19 13:59:17.540+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 30
2017-10-19 14:01:30.761+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/29/backend/vif/32/0
2017-10-19 14:01:30.766+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 32
2017-10-19 14:01:30.816+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/29/backend/vif/31/0
2017-10-19 14:01:30.822+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 31
2017-10-19 14:02:33.658+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-19 14:02:33.661+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-19 14:02:33.662+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 14:02:43.685+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-19 14:02:53.811+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-19 14:08:41.631+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 21:01:23.153+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/3/0 not ready
2017-10-19 21:01:23.159+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 21:01:33.225+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/3/0 not ready
2017-10-19 21:01:33.232+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-19 21:01:43.410+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/3/0 not ready
2017-10-19 21:04:32.031+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 21:08:06.005+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/5/backend/vif/8/0
2017-10-19 21:08:06.012+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 8
2017-10-19 21:08:06.066+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/5/backend/vif/7/0
2017-10-19 21:08:06.069+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 7
2017-10-19 21:08:35.167+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/5/backend/vif/14/0
2017-10-19 21:08:35.172+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 14
2017-10-19 21:08:35.247+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/5/backend/vif/13/0
2017-10-19 21:08:35.251+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 13
2017-10-19 21:42:07.214+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/5/backend/vif/3/0
2017-10-19 21:42:07.220+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 3
2017-10-19 23:10:07.418+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=123: Invalid argument
2017-10-19 23:10:07.418+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=123: Operation not permitted
2017-10-19 23:10:07.418+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 23:10:17.483+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-19 23:10:27.662+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-19 23:10:37.837+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-19 23:12:03.482+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-20 09:28:02.929+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-20 09:28:12.956+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/43/0 not ready
2017-10-20 09:28:23.119+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/43/0 not ready
2017-10-20 09:28:23.126+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-20 09:28:33.299+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/43/0 not ready
2017-10-20 09:28:33.419+0000: libxl: libxl_device.c:1274:device_destroy_be_watch_cb: timed out while waiting for /local/domain/5/backend/vif/38/0 to be removed
2017-10-20 09:28:33.425+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 38
2017-10-20 09:28:33.445+0000: libxl: libxl_device.c:1274:device_destroy_be_watch_cb: timed out while waiting for /local/domain/5/backend/vif/37/0 to be removed
2017-10-20 09:28:33.452+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 37
2017-10-20 09:28:33.479+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/5/backend/vif/41/0
2017-10-20 09:28:33.482+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 41
2017-10-20 09:28:33.519+0000: libxl: libxl_device.c:1274:device_destroy_be_watch_cb: timed out while waiting for /local/domain/5/backend/vif/42/0 to be removed
2017-10-20 09:28:33.523+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 42
2017-10-20 09:28:45.185+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-20 09:28:55.284+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-20 09:28:55.353+0000: libxl: libxl_linux.c:155:libxl__loopdev_cleanup: unable to release device /dev/loop0: No such device or address
2017-10-20 09:28:55.384+0000: libxl: libxl_linux.c:155:libxl__loopdev_cleanup: unable to release device /dev/loop0: No such device or address
2017-10-20 09:28:55.412+0000: libxl: libxl_linux.c:155:libxl__loopdev_cleanup: unable to release device /dev/loop0: No such device or address
2017-10-20 09:28:55.474+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/1/backend/vif/5/0
2017-10-20 09:28:55.481+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 5
2017-10-20 09:28:55.549+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/5/backend/vif/21/0
2017-10-20 09:28:55.590+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 21
2017-10-20 09:29:02.469+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-21 00:24:35.140+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/64/backend/vif/73/0
2017-10-21 00:24:35.144+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 73
2017-10-21 00:24:35.208+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/64/backend/vif/72/0
2017-10-21 00:24:35.212+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 72
2017-10-21 00:39:32.187+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/64/backend/vif/77/0
2017-10-21 00:39:32.192+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 77
2017-10-21 00:39:32.251+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/64/backend/vif/76/0
2017-10-21 00:39:32.261+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 76
2017-10-21 12:31:06.747+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/86/backend/vif/92/0
2017-10-21 12:31:06.751+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 92
2017-10-25 12:37:38.582+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/94/backend/vif/101/0
2017-10-25 12:37:38.588+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 101
2017-10-25 12:37:38.685+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/94/backend/vif/100/0
2017-10-25 12:37:38.690+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 100
2017-10-25 12:38:07.273+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/94/backend/vif/107/0
2017-10-25 12:38:07.280+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 107
2017-10-25 12:38:07.377+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/94/backend/vif/106/0
2017-10-25 12:38:07.383+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 106
2017-10-25 12:38:20.044+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/46/backend/vif/95/0
2017-10-25 12:38:20.048+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 95
2017-10-25 14:22:39.731+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/124/backend/vif/129/0
2017-10-25 14:22:39.736+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 129
2017-10-25 14:22:39.795+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/124/backend/vif/128/0
2017-10-25 14:22:39.798+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 128
2017-10-25 14:22:39.993+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/124/backend/vif/127/0
2017-10-25 14:22:39.999+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 127
2017-10-25 14:22:40.109+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/124/backend/vif/126/0
2017-10-25 14:22:40.116+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 126
2017-10-25 14:22:40.456+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-25 14:22:50.483+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/44/0 not ready
2017-10-25 14:23:00.615+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/44/0 not ready
2017-10-25 14:23:00.618+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-25 14:23:10.749+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/44/0 not ready
2017-10-25 14:44:45.765+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 08:53:57.740+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/6/0
2017-10-26 08:53:57.747+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 6
2017-10-26 08:53:57.849+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/5/0
2017-10-26 08:53:57.871+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 5
2017-10-26 08:54:08.532+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 08:54:08.534+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-26 08:54:08.534+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 08:54:18.559+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 08:54:28.690+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 09:11:46.530+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 12:15:14.048+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/6/0
2017-10-26 12:15:14.051+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 6
2017-10-26 12:15:14.101+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/5/0
2017-10-26 12:15:14.104+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 5
2017-10-26 12:15:25.014+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 12:15:25.022+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 12:15:35.089+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 12:15:35.097+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-26 12:15:45.273+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 12:18:24.491+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 12:40:26.578+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 12:40:36.757+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 12:40:36.765+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-26 12:40:36.765+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 12:40:46.829+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 12:41:10.727+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 13:42:42.211+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/13/0 not ready
2017-10-26 13:42:52.390+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/13/0 not ready
2017-10-26 13:42:52.397+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-26 13:42:52.397+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 13:43:02.462+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/13/0 not ready
2017-10-26 13:58:21.274+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 14:33:06.787+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/30/0
2017-10-26 14:33:06.789+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 30
2017-10-26 14:33:39.449+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/32/0
2017-10-26 14:33:39.456+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 32
2017-10-27 14:33:59.833+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/36/0
2017-10-27 14:33:59.835+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 36
2017-10-27 15:37:33.603+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-27 15:37:33.606+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 15:37:43.662+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-27 15:37:43.667+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-27 15:37:53.817+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-27 16:00:26.607+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 16:43:44.285+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 16:43:54.326+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-27 16:44:04.508+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-27 16:44:04.515+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-27 16:44:14.688+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-27 16:44:32.913+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 16:52:57.585+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 16:53:07.624+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/31/0 not ready
2017-10-27 16:53:17.802+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/31/0 not ready
2017-10-27 16:53:17.808+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-27 16:53:27.978+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/31/0 not ready
2017-10-27 16:55:36.856+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 17:02:30.759+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 17:12:04.393+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 19:58:07.583+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/34/0
2017-10-27 19:58:07.589+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 34
2017-10-27 19:58:07.670+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/33/0
2017-10-27 19:58:07.675+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 33
2017-10-27 20:41:35.932+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:41:45.994+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-27 20:41:56.169+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-27 20:41:56.175+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-27 20:42:06.345+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-27 20:42:19.189+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:42:25.395+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=104: Invalid argument
2017-10-27 20:42:25.395+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=104: Operation not permitted
2017-10-27 20:42:25.395+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:45:28.901+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:45:35.088+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=114: Invalid argument
2017-10-27 20:45:35.088+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=114: Operation not permitted
2017-10-27 20:45:35.088+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:46:58.473+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:47:04.527+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=142: Invalid argument
2017-10-27 20:47:04.527+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=142: Operation not permitted
2017-10-27 20:47:04.528+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:49:57.531+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:50:03.504+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=142: Invalid argument
2017-10-27 20:50:03.504+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=142: Operation not permitted
2017-10-27 20:50:03.504+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:56:11.559+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:56:17.956+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=104: Invalid argument
2017-10-27 20:56:17.956+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=104: Operation not permitted
2017-10-27 20:56:17.956+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:59:09.445+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:59:16.134+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=114: Invalid argument
2017-10-27 20:59:16.135+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=114: Operation not permitted
2017-10-27 20:59:16.135+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-29 15:37:02.009+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-29 15:37:08.001+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=104: Invalid argument
2017-10-29 15:37:08.001+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=104: Operation not permitted
2017-10-29 15:37:08.001+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-29 15:40:02.341+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-29 15:40:08.596+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=142: Invalid argument
2017-10-29 15:40:08.596+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=142: Operation not permitted
2017-10-29 15:40:08.596+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-29 15:52:03.180+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-29 15:52:03.185+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-29 15:52:03.185+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-29 15:56:32.124+0000: libxl: libxl.c:1857:libxl_console_get_tty: unable to read console tty path `/local/domain/2/console/tty': Resource temporarily unavailable
2017-10-30 11:41:40.063+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-30 11:41:40.069+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 11:41:40.069+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 11:41:56.791+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-30 11:41:56.791+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 11:41:56.791+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 11:42:52.145+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-30 11:42:52.145+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 11:42:52.145+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 11:43:31.666+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-30 11:43:31.666+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 11:43:31.666+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 12:08:16.952+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-30 12:08:18.096+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-30 12:10:06.240+0000: libxl: libxl_pci.c:1249:libxl__device_pci_add: PCI device 0:0:1a.0 is not assignable
2017-10-30 12:10:29.332+0000: libxl: libxl_pci.c:1249:libxl__device_pci_add: PCI device 0:0:1a.0 is not assignable
2017-10-30 12:12:23.719+0000: libxl: libxl_pci.c:1249:libxl__device_pci_add: PCI device 0:0:1a.0 is not assignable
2017-10-30 12:16:14.907+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-30 12:16:14.907+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 12:16:14.907+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 12:37:12.346+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:38:17.330+0000: libxl: libxl_exec.c:226:libxl__xenstore_child_wait_deprecated: Device Model not ready
2017-10-30 12:38:17.331+0000: libxl: libxl_pci.c:991:qemu_pci_add_xenstore: qemu refused to add device: 0000:00:1d.0,msitranslate=0,power_mgmt=0
2017-10-30 12:38:27.022+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:38:27.147+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-30 12:38:49.996+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:39:51.247+0000: libxl: libxl_exec.c:226:libxl__xenstore_child_wait_deprecated: Device Model not ready
2017-10-30 12:39:51.248+0000: libxl: libxl_pci.c:991:qemu_pci_add_xenstore: qemu refused to add device: 0000:00:1d.0,msitranslate=0,power_mgmt=0
2017-10-30 12:39:51.249+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 12:39:51.249+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 12:39:51.255+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:39:51.380+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-30 12:41:34.059+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:42:34.727+0000: libxl: libxl_exec.c:226:libxl__xenstore_child_wait_deprecated: Device Model not ready
2017-10-30 12:42:34.728+0000: libxl: libxl_pci.c:991:qemu_pci_add_xenstore: qemu refused to add device: 0000:00:1a.0,msitranslate=0,power_mgmt=0
2017-10-30 12:42:34.729+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 12:42:34.729+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 12:42:35.068+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:42:35.184+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-30 12:42:35.611+0000: libxl: libxl_linux.c:155:libxl__loopdev_cleanup: unable to release device /dev/loop0: No such device or address
2017-10-30 12:43:35.506+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:44:36.332+0000: libxl: libxl_exec.c:226:libxl__xenstore_child_wait_deprecated: Device Model not ready
2017-10-30 12:44:36.334+0000: libxl: libxl_pci.c:991:qemu_pci_add_xenstore: qemu refused to add device: 0000:00:1a.0,msitranslate=0,power_mgmt=0
2017-10-30 12:44:36.338+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 12:44:36.338+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 12:44:36.681+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:44:36.802+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-30 12:49:43.548+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:50:45.087+0000: libxl: libxl_exec.c:226:libxl__xenstore_child_wait_deprecated: Device Model not ready
2017-10-30 12:50:45.088+0000: libxl: libxl_pci.c:991:qemu_pci_add_xenstore: qemu refused to add device: 0000:00:1d.0,msitranslate=0,power_mgmt=0
2017-10-30 12:50:45.088+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 12:50:45.089+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 12:50:45.095+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:50:45.218+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
Member

adrelanos commented Oct 30, 2017

Dunno if anything interesting. Please check my /var/log/libvirt/libxl/libxl-driver.log here:

2017-10-19 09:41:27.288+0000: libxl: libxl_pci.c:1167:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 09:47:26.202+0000: libxl: libxl_device.c:1356:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/5/0 not ready
2017-10-19 09:47:37.311+0000: libxl: libxl_device.c:1356:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/5/0 not ready
2017-10-19 10:32:30.403+0000: libxl: libxl_pci.c:1167:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 10:32:40.450+0000: libxl: libxl_device.c:1356:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/8/0 not ready
2017-10-19 10:32:40.457+0000: libxl: libxl_pci.c:1485:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-19 10:32:50.625+0000: libxl: libxl_device.c:1356:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/8/0 not ready
2017-10-19 10:33:00.806+0000: libxl: libxl_device.c:1356:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/8/0 not ready
2017-10-19 10:33:00.865+0000: libxl: libxl_device.c:1264:device_destroy_be_watch_cb: timed out while waiting for /local/domain/9/backend/vif/11/0 to be removed
2017-10-19 10:33:00.869+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 11
2017-10-19 10:33:00.878+0000: libxl: libxl_device.c:1264:device_destroy_be_watch_cb: timed out while waiting for /local/domain/9/backend/vif/10/0 to be removed
2017-10-19 10:33:00.881+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 10
2017-10-19 10:33:10.985+0000: libxl: libxl_device.c:1356:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/9/0 not ready
2017-10-19 10:33:22.110+0000: libxl: libxl_device.c:1356:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/9/0 not ready
2017-10-19 10:37:18.171+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 13:59:17.533+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/30/0
2017-10-19 13:59:17.540+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 30
2017-10-19 14:01:30.761+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/29/backend/vif/32/0
2017-10-19 14:01:30.766+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 32
2017-10-19 14:01:30.816+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/29/backend/vif/31/0
2017-10-19 14:01:30.822+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 31
2017-10-19 14:02:33.658+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-19 14:02:33.661+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-19 14:02:33.662+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 14:02:43.685+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-19 14:02:53.811+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-19 14:08:41.631+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 21:01:23.153+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/3/0 not ready
2017-10-19 21:01:23.159+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 21:01:33.225+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/3/0 not ready
2017-10-19 21:01:33.232+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-19 21:01:43.410+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/3/0 not ready
2017-10-19 21:04:32.031+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 21:08:06.005+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/5/backend/vif/8/0
2017-10-19 21:08:06.012+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 8
2017-10-19 21:08:06.066+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/5/backend/vif/7/0
2017-10-19 21:08:06.069+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 7
2017-10-19 21:08:35.167+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/5/backend/vif/14/0
2017-10-19 21:08:35.172+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 14
2017-10-19 21:08:35.247+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/5/backend/vif/13/0
2017-10-19 21:08:35.251+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 13
2017-10-19 21:42:07.214+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/5/backend/vif/3/0
2017-10-19 21:42:07.220+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 3
2017-10-19 23:10:07.418+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=123: Invalid argument
2017-10-19 23:10:07.418+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=123: Operation not permitted
2017-10-19 23:10:07.418+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-19 23:10:17.483+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-19 23:10:27.662+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-19 23:10:37.837+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-19 23:12:03.482+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-20 09:28:02.929+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-20 09:28:12.956+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/43/0 not ready
2017-10-20 09:28:23.119+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/43/0 not ready
2017-10-20 09:28:23.126+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-20 09:28:33.299+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/43/0 not ready
2017-10-20 09:28:33.419+0000: libxl: libxl_device.c:1274:device_destroy_be_watch_cb: timed out while waiting for /local/domain/5/backend/vif/38/0 to be removed
2017-10-20 09:28:33.425+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 38
2017-10-20 09:28:33.445+0000: libxl: libxl_device.c:1274:device_destroy_be_watch_cb: timed out while waiting for /local/domain/5/backend/vif/37/0 to be removed
2017-10-20 09:28:33.452+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 37
2017-10-20 09:28:33.479+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/5/backend/vif/41/0
2017-10-20 09:28:33.482+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 41
2017-10-20 09:28:33.519+0000: libxl: libxl_device.c:1274:device_destroy_be_watch_cb: timed out while waiting for /local/domain/5/backend/vif/42/0 to be removed
2017-10-20 09:28:33.523+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 42
2017-10-20 09:28:45.185+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-20 09:28:55.284+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-20 09:28:55.353+0000: libxl: libxl_linux.c:155:libxl__loopdev_cleanup: unable to release device /dev/loop0: No such device or address
2017-10-20 09:28:55.384+0000: libxl: libxl_linux.c:155:libxl__loopdev_cleanup: unable to release device /dev/loop0: No such device or address
2017-10-20 09:28:55.412+0000: libxl: libxl_linux.c:155:libxl__loopdev_cleanup: unable to release device /dev/loop0: No such device or address
2017-10-20 09:28:55.474+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/1/backend/vif/5/0
2017-10-20 09:28:55.481+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 5
2017-10-20 09:28:55.549+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/5/backend/vif/21/0
2017-10-20 09:28:55.590+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 21
2017-10-20 09:29:02.469+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-21 00:24:35.140+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/64/backend/vif/73/0
2017-10-21 00:24:35.144+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 73
2017-10-21 00:24:35.208+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/64/backend/vif/72/0
2017-10-21 00:24:35.212+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 72
2017-10-21 00:39:32.187+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/64/backend/vif/77/0
2017-10-21 00:39:32.192+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 77
2017-10-21 00:39:32.251+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/64/backend/vif/76/0
2017-10-21 00:39:32.261+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 76
2017-10-21 12:31:06.747+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/86/backend/vif/92/0
2017-10-21 12:31:06.751+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 92
2017-10-25 12:37:38.582+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/94/backend/vif/101/0
2017-10-25 12:37:38.588+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 101
2017-10-25 12:37:38.685+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/94/backend/vif/100/0
2017-10-25 12:37:38.690+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 100
2017-10-25 12:38:07.273+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/94/backend/vif/107/0
2017-10-25 12:38:07.280+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 107
2017-10-25 12:38:07.377+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/94/backend/vif/106/0
2017-10-25 12:38:07.383+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 106
2017-10-25 12:38:20.044+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/46/backend/vif/95/0
2017-10-25 12:38:20.048+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 95
2017-10-25 14:22:39.731+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/124/backend/vif/129/0
2017-10-25 14:22:39.736+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 129
2017-10-25 14:22:39.795+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/124/backend/vif/128/0
2017-10-25 14:22:39.798+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 128
2017-10-25 14:22:39.993+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/124/backend/vif/127/0
2017-10-25 14:22:39.999+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 127
2017-10-25 14:22:40.109+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/124/backend/vif/126/0
2017-10-25 14:22:40.116+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 126
2017-10-25 14:22:40.456+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-25 14:22:50.483+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/44/0 not ready
2017-10-25 14:23:00.615+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/44/0 not ready
2017-10-25 14:23:00.618+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-25 14:23:10.749+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/44/0 not ready
2017-10-25 14:44:45.765+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 08:53:57.740+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/6/0
2017-10-26 08:53:57.747+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 6
2017-10-26 08:53:57.849+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/5/0
2017-10-26 08:53:57.871+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 5
2017-10-26 08:54:08.532+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 08:54:08.534+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-26 08:54:08.534+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 08:54:18.559+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 08:54:28.690+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 09:11:46.530+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 12:15:14.048+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/6/0
2017-10-26 12:15:14.051+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 6
2017-10-26 12:15:14.101+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/5/0
2017-10-26 12:15:14.104+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 5
2017-10-26 12:15:25.014+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 12:15:25.022+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 12:15:35.089+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 12:15:35.097+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-26 12:15:45.273+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 12:18:24.491+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 12:40:26.578+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 12:40:36.757+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 12:40:36.765+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-26 12:40:36.765+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 12:40:46.829+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-26 12:41:10.727+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 13:42:42.211+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/13/0 not ready
2017-10-26 13:42:52.390+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/13/0 not ready
2017-10-26 13:42:52.397+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-26 13:42:52.397+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 13:43:02.462+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/13/0 not ready
2017-10-26 13:58:21.274+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-26 14:33:06.787+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/30/0
2017-10-26 14:33:06.789+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 30
2017-10-26 14:33:39.449+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/32/0
2017-10-26 14:33:39.456+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 32
2017-10-27 14:33:59.833+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/36/0
2017-10-27 14:33:59.835+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 36
2017-10-27 15:37:33.603+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-27 15:37:33.606+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 15:37:43.662+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-27 15:37:43.667+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-27 15:37:53.817+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-27 16:00:26.607+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 16:43:44.285+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 16:43:54.326+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-27 16:44:04.508+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-27 16:44:04.515+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-27 16:44:14.688+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/2/0 not ready
2017-10-27 16:44:32.913+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 16:52:57.585+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 16:53:07.624+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/31/0 not ready
2017-10-27 16:53:17.802+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/31/0 not ready
2017-10-27 16:53:17.808+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-27 16:53:27.978+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/31/0 not ready
2017-10-27 16:55:36.856+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 17:02:30.759+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 17:12:04.393+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 19:58:07.583+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/34/0
2017-10-27 19:58:07.589+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 34
2017-10-27 19:58:07.670+0000: libxl: libxl_device.c:1074:device_backend_callback: unable to remove device with path /local/domain/3/backend/vif/33/0
2017-10-27 19:58:07.675+0000: libxl: libxl.c:1673:devices_destroy_cb: libxl__devices_destroy failed for 33
2017-10-27 20:41:35.932+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:41:45.994+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-27 20:41:56.169+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-27 20:41:56.175+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-27 20:42:06.345+0000: libxl: libxl_device.c:1366:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/1/0 not ready
2017-10-27 20:42:19.189+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:42:25.395+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=104: Invalid argument
2017-10-27 20:42:25.395+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=104: Operation not permitted
2017-10-27 20:42:25.395+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:45:28.901+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:45:35.088+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=114: Invalid argument
2017-10-27 20:45:35.088+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=114: Operation not permitted
2017-10-27 20:45:35.088+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:46:58.473+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:47:04.527+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=142: Invalid argument
2017-10-27 20:47:04.527+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=142: Operation not permitted
2017-10-27 20:47:04.528+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:49:57.531+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:50:03.504+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=142: Invalid argument
2017-10-27 20:50:03.504+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=142: Operation not permitted
2017-10-27 20:50:03.504+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:56:11.559+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:56:17.956+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=104: Invalid argument
2017-10-27 20:56:17.956+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=104: Operation not permitted
2017-10-27 20:56:17.956+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:59:09.445+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-27 20:59:16.134+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=114: Invalid argument
2017-10-27 20:59:16.135+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=114: Operation not permitted
2017-10-27 20:59:16.135+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-29 15:37:02.009+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-29 15:37:08.001+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=104: Invalid argument
2017-10-29 15:37:08.001+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=104: Operation not permitted
2017-10-29 15:37:08.001+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-29 15:40:02.341+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-29 15:40:08.596+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=142: Invalid argument
2017-10-29 15:40:08.596+0000: libxl: libxl_pci.c:1496:do_pci_remove: xc_domain_irq_permission irq=142: Operation not permitted
2017-10-29 15:40:08.596+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-29 15:52:03.180+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-29 15:52:03.185+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-29 15:52:03.185+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-29 15:56:32.124+0000: libxl: libxl.c:1857:libxl_console_get_tty: unable to read console tty path `/local/domain/2/console/tty': Resource temporarily unavailable
2017-10-30 11:41:40.063+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-30 11:41:40.069+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 11:41:40.069+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 11:41:56.791+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-30 11:41:56.791+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 11:41:56.791+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 11:42:52.145+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-30 11:42:52.145+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 11:42:52.145+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 11:43:31.666+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-30 11:43:31.666+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 11:43:31.666+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 12:08:16.952+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-30 12:08:18.096+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-30 12:10:06.240+0000: libxl: libxl_pci.c:1249:libxl__device_pci_add: PCI device 0:0:1a.0 is not assignable
2017-10-30 12:10:29.332+0000: libxl: libxl_pci.c:1249:libxl__device_pci_add: PCI device 0:0:1a.0 is not assignable
2017-10-30 12:12:23.719+0000: libxl: libxl_pci.c:1249:libxl__device_pci_add: PCI device 0:0:1a.0 is not assignable
2017-10-30 12:16:14.907+0000: libxl: libxl_pci.c:1132:do_pci_add: xc_assign_device failed: Operation not permitted
2017-10-30 12:16:14.907+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 12:16:14.907+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 12:37:12.346+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:38:17.330+0000: libxl: libxl_exec.c:226:libxl__xenstore_child_wait_deprecated: Device Model not ready
2017-10-30 12:38:17.331+0000: libxl: libxl_pci.c:991:qemu_pci_add_xenstore: qemu refused to add device: 0000:00:1d.0,msitranslate=0,power_mgmt=0
2017-10-30 12:38:27.022+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:38:27.147+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-30 12:38:49.996+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:39:51.247+0000: libxl: libxl_exec.c:226:libxl__xenstore_child_wait_deprecated: Device Model not ready
2017-10-30 12:39:51.248+0000: libxl: libxl_pci.c:991:qemu_pci_add_xenstore: qemu refused to add device: 0000:00:1d.0,msitranslate=0,power_mgmt=0
2017-10-30 12:39:51.249+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 12:39:51.249+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 12:39:51.255+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:39:51.380+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-30 12:41:34.059+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:42:34.727+0000: libxl: libxl_exec.c:226:libxl__xenstore_child_wait_deprecated: Device Model not ready
2017-10-30 12:42:34.728+0000: libxl: libxl_pci.c:991:qemu_pci_add_xenstore: qemu refused to add device: 0000:00:1a.0,msitranslate=0,power_mgmt=0
2017-10-30 12:42:34.729+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 12:42:34.729+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 12:42:35.068+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:42:35.184+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-30 12:42:35.611+0000: libxl: libxl_linux.c:155:libxl__loopdev_cleanup: unable to release device /dev/loop0: No such device or address
2017-10-30 12:43:35.506+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:44:36.332+0000: libxl: libxl_exec.c:226:libxl__xenstore_child_wait_deprecated: Device Model not ready
2017-10-30 12:44:36.334+0000: libxl: libxl_pci.c:991:qemu_pci_add_xenstore: qemu refused to add device: 0000:00:1a.0,msitranslate=0,power_mgmt=0
2017-10-30 12:44:36.338+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 12:44:36.338+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 12:44:36.681+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:44:36.802+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
2017-10-30 12:49:43.548+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:50:45.087+0000: libxl: libxl_exec.c:226:libxl__xenstore_child_wait_deprecated: Device Model not ready
2017-10-30 12:50:45.088+0000: libxl: libxl_pci.c:991:qemu_pci_add_xenstore: qemu refused to add device: 0000:00:1d.0,msitranslate=0,power_mgmt=0
2017-10-30 12:50:45.088+0000: libxl: libxl_pci.c:1336:libxl__add_pcidevs: libxl_device_pci_add failed: -3
2017-10-30 12:50:45.089+0000: libxl: libxl_create.c:1498:domcreate_attach_devices: unable to add pci devices
2017-10-30 12:50:45.095+0000: libxl: libxl_pci.c:1174:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0
2017-10-30 12:50:45.218+0000: libxl: libxl_pci.c:1492:do_pci_remove: xc_physdev_unmap_pirq irq=16: Invalid argument
@marmarek

This comment has been minimized.

Show comment
Hide comment
@marmarek

marmarek Oct 30, 2017

Member

2017-10-30 12:50:45.087+0000: libxl: libxl_exec.c:226:libxl__xenstore_child_wait_deprecated: Device Model not ready
2017-10-30 12:50:45.088+0000: libxl: libxl_pci.c:991:qemu_pci_add_xenstore: qemu refused to add device: 0000:00:1d.0,msitranslate=0,power_mgmt=0

Lets go deeper... /var/log/xen/console/guest-sys-usb-dm.log - anything about PCI hotplug.

Member

marmarek commented Oct 30, 2017

2017-10-30 12:50:45.087+0000: libxl: libxl_exec.c:226:libxl__xenstore_child_wait_deprecated: Device Model not ready
2017-10-30 12:50:45.088+0000: libxl: libxl_pci.c:991:qemu_pci_add_xenstore: qemu refused to add device: 0000:00:1d.0,msitranslate=0,power_mgmt=0

Lets go deeper... /var/log/xen/console/guest-sys-usb-dm.log - anything about PCI hotplug.

@adrelanos

This comment has been minimized.

Show comment
Hide comment
@adrelanos

adrelanos Oct 30, 2017

Member

I have no idea, therefore I've sent the full log by encrypted e-mail to you, @HW42, and posted a few "highlights" where I guestimate that something could be wrong here.

+ echo {"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-14.0", "hostaddr": "0000:00:00.00", "machine_addr": "0000:00:14.0", "permissive": false}}
+ mv /tmp/qmp/new-req_e9a7d62c-9252-417f-b5bd-e8da97b8be77 /tmp/qmp/req/e9a7d62c-9252-417f-b5bd-e8da97b8be77
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
e9a7d62c-9252-417f-b5bd-e8da97b8be77
[00:04.0] xen_pt_realize: Assigning real physical device 00:00.0 to devfn 0x20
[00:04.0] xen_pt_register_regions: IO region 0 registered (size=0x00010000 base_addr=0xf7300000 type: 0x4)
[00:04.0] xen_pt_config_reg_init: Offset 0x0006 mismatch! Emulated=0x0010, host=0x0290, syncing to 0x0290.
[00:04.0] xen_pt_config_reg_init: Offset 0x000e mismatch! Emulated=0x0080, host=0x0000, syncing to 0x0000.
[00:04.0] xen_pt_config_reg_init: Offset 0x0010 mismatch! Emulated=0x0000, host=0xf7300004, syncing to 0xf7300004.
[00:04.0] xen_pt_config_reg_init: Offset 0x0072 mismatch! Emulated=0x0000, host=0x01c2, syncing to 0x0002.
{"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-14.0", "hostaddr": "0000:00:00.00", "machine_addr": "0000:00:14.0", "permissive": false}}
{"timestamp": {"seconds": 1509366929, "microseconds": 451706}, "event": "DEVICE_DELETED", "data": {"path": "/machine/peripheral-anon/device[4]"}}

[00:04.0] xen_pt_config_reg_init: Offset 0x0082 mismatch! Emulated=0x0000, host=0x0086, syncing to 0x0080.
[00:04.0] xen_pt_pci_intx: intx=1
[00:04.0] xen_pt_realize: Real physical device 00:00.0 registered successfully
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
{"timestamp": {"seconds": 1509366929, "microseconds": 451801}, "event": "DEVICE_DELETED", "data": {"path": "/machine/peripheral-anon/device[3]"}}

+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
{"timestamp": {"seconds": 1509366929, "microseconds": 451865}, "event": "DEVICE_DELETED", "data": {"path": "/machine/peripheral-anon/device[2]"}}

+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
{"timestamp": {"seconds": 1509366929, "microseconds": 451921}, "event": "DEVICE_DELETED", "data": {"path": "/machine/peripheral-anon/device[1]"}}

+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
{"timestamp": {"seconds": 1509366929, "microseconds": 451976}, "event": "DEVICE_DELETED", "data": {"device": "scsi0", "path": "/machine/peripheral/scsi0"}}

+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
{"return": {}}

+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ cat /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77
+ rm /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77
+ sed s/"qdev_id"/\n\0/g
+ sed -n /"qdev_id": "xen-pci-pt_0000-00-14.0"/{s/.*"slot": \([0-9]\+\),.*"function": \([0-9]\+\),.*/\1,\2/;p}
+ qmp_req {"execute": "query-pci"}
+ cat /proc/sys/kernel/random/uuid
+ local id=13efce57-4b3b-4cbb-aced-1da548c0857e
+ echo {"execute": "query-pci"}
+ mv /tmp/qmp/new-req_13efce57-4b3b-4cbb-aced-1da548c0857e /tmp/qmp/req/13efce57-4b3b-4cbb-aced-1da548c0857e
+ [ -f /tmp/qmp/res/13efce57-4b3b-4cbb-aced-1da548c0857e ]
+ sleep 0.1
13efce57-4b3b-4cbb-aced-1da548c0857e
+ [ -f /tmp/qmp/res/13efce57-4b3b-4cbb-aced-1da548c0857e ]
+ sleep 0.1
{"execute": "query-pci"}
{"return": [{"bus": 0, "devices": [{"bus": 0, "qdev_id": "", "slot": 0, "class_info": {"class": 1536, "desc": "Host bridge"}, "id": {"device": 4663, "vendor": 32902}, "function": 0, "regions": []}, {"bus": 0, "qdev_id": "", "slot": 1, "class_info": {"class": 1537, "desc": "ISA bridge"}, "id": {"device": 28672, "vendor": 32902}, "function": 0, "regions": []}, {"bus": 0, "qdev_id": "", "slot": 1, "class_info": {"class": 257, "desc": "IDE controller"}, "id": {"device": 28688, "vendor": 32902}, "function": 1, "regions": [{"bar": 4, "size": 16, "address": 49696, "type": "io"}]}, {"bus": 0, "qdev_id": "", "irq": 5, "slot": 1, "class_info": {"class": 3075, "desc": "USB controller"}, "id": {"device": 28704, "vendor": 32902}, "function": 2, "regions": [{"bar": 4, "size": 32, "address": 49664, "type": "io"}]}, {"bus": 0, "qdev_id": "", "irq": 10, "slot": 1, "class_info": {"class": 1664, "desc": "Bridge"}, "id": {"device": 28947, "vendor": 32902}, "function": 3, "regions": []}, {"bus": 0, "qdev_id": "", "irq": 11, "slot": 2, "class_info": {"class": 65408}, "id": {"device": 1, "vendor": 22611}, "function": 0, "regions": [{"bar": 0, "size": 256, "address": 49152, "type": "io"}, {"prefetch": true, "mem_type_64": false, "bar": 1, "size": 16777216, "address": 4026531840, "type": "memory"}]}, {"bus": 0, "qdev_id": "", "slot": 3, "class_info": {"class": 768, "desc": "VGA controller"}, "id": {"device": 4369, "vendor": 4660}, "function": 0, "regions": [{"prefetch": true, "mem_type_64": false, "bar": 0, "size": 16777216, "address": 4043309056, "type": "memory"}, {"prefetch": false, "mem_type_64": false, "bar": 2, "size": 4096, "address": 4060233728, "type": "memory"}, {"prefetch": false, "mem_type_64": false, "bar": 6, "size": 65536, "address": -1, "type": "memory"}]}, {"bus": 0, "qdev_id": "xen-pci-pt_0000-00-14.0", "irq": 0, "slot": 4, "class_info": {"class": 0}, "id": {"device": 7729, "vendor": 32902}, "function": 0, "regions": [{"prefetch": false, "mem_type_64": true, "bar": 0, "size": 65536, "address": -1, "type": "memory"}]}]}]}

+ [ -f /tmp/qmp/res/13efce57-4b3b-4cbb-aced-1da548c0857e ]
+ cat /tmp/qmp/res/13efce57-4b3b-4cbb-aced-1da548c0857e
+ rm /tmp/qmp/res/13efce57-4b3b-4cbb-aced-1da548c0857e
+ slot_func=4,0
+ cut -d , -f 1
+ printf %s 4,0
+ slot=4
+ cut -d , -f 2
+ printf %s 4,0
+ func=0
+ vdevfn=32
+ printf 0x%02x 32
+ xenstore-write device-model/1/parameter 0x20
+ xenstore-write device-model/1/state pci-inserted
+ true
+ xenstore-watch -n 2 device-model/1/command
device-model/1/command
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
pci 0000:00:01.0: [8086:1e2d] type 00 class 0x0c0320
pci 0000:00:01.0: reg 0x10: [mem 0xf7318000-0xf73183ff]
pcifront pci-0: New device on 0000:00:01.0 found.
pcifront pci-0: claiming resource 0000:00:01.0/0
device-model/1/command
+ xenstore-read device-model/1/command
+ cmd=pci-ins
+ [ pci-ins != pci-ins ]
+ xenstore-read device-model/1/parameter
+ para=0000:00:1a.0,msitranslate=0,power_mgmt=0
+ cut -b 1-12
+ printf %s 0000:00:1a.0,msitranslate=0,power_mgmt=0
+ dev=0000:00:1a.0
+ tr : -
+ printf %s 0000:00:1a.0
+ qdev_id=xen-pci-pt_0000-00-1a.0
+ [ pci-ins = pci-rem ]
+ xenstore-read device/pci/0/backend
+ be=/local/domain/0/backend/pci/2/0
+ xenstore-read /local/domain/0/backend/pci/2/0/num_devs
+ devs=2
+ dev_n=
+ seq 0 1
+ sed s/\.0\([0-9]\)$/.\1/
+ xenstore-read /local/domain/0/backend/pci/2/0/dev-0
+ [ 0000:00:1a.0 = 0000:00:14.0 ]
+ sed s/\.0\([0-9]\)$/.\1/
+ xenstore-read /local/domain/0/backend/pci/2/0/dev-1
+ [ 0000:00:1a.0 = 0000:00:1a.0 ]
+ dev_n=1
+ break
+ [ -z 1 ]
+ xenstore-read /local/domain/0/backend/pci/2/0/vdev-1
+ vdev=0000:00:01.00
+ addr_arg=
+ xenstore-read /local/domain/0/backend/pci/2/0/vdevfn-1
xenstore-read: couldn't read path /local/domain/0/backend/pci/2/0/vdevfn-1
+ true
+ vdevfn=
+ [ -n  ]
+ permissive=false
+ grep -q \<permissive=1\>
+ xenstore-read /local/domain/0/backend/pci/2/0/opts-1
+ cat
+ qmp_req {"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1a.0", "hostaddr": "0000:00:01.00", "machine_addr": "0000:00:1a.0", "permissive": false}}
+ cat /proc/sys/kernel/random/uuid
+ local id=012462f4-a80d-4b8b-9ccf-f3b60f17e675
+ echo {"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1a.0", "hostaddr": "0000:00:01.00", "machine_addr": "0000:00:1a.0", "permissive": false}}
+ mv /tmp/qmp/new-req_012462f4-a80d-4b8b-9ccf-f3b60f17e675 /tmp/qmp/req/012462f4-a80d-4b8b-9ccf-f3b60f17e675
+ [ -f /tmp/qmp/res/012462f4-a80d-4b8b-9ccf-f3b60f17e675 ]
+ sleep 0.1
012462f4-a80d-4b8b-9ccf-f3b60f17e675
{"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1a.0", "hostaddr": "0000:00:01.00", "machine_addr": "0000:00:1a.0", "permissive": false}}
[00:05.0] xen_pt_realize: Assigning real physical device 00:01.0 to devfn 0x28
[00:05.0] xen_pt_register_regions: IO region 0 registered (size=0x00001000 base_addr=0xf7318000 type: 0)
[00:05.0] xen_pt_config_reg_init: Offset 0x0006 mismatch! Emulated=0x0010, host=0x0290, syncing to 0x0290.
[00:05.0] xen_pt_config_reg_init: Offset 0x000e mismatch! Emulated=0x0080, host=0x0000, syncing to 0x0000.
[00:05.0] xen_pt_config_reg_init: Offset 0x0010 mismatch! Emulated=0x0000, host=0xf7318000, syncing to 0xf7318000.
[00:05.0] xen_pt_config_reg_init: Offset 0x0052 mismatch! Emulated=0x0000, host=0x01c2, syncing to 0x0002.
[00:05.0] xen_pt_pci_intx: intx=1
[00:05.0] xen_pt_realize: Real physical device 00:01.0 registered successfully
{"return": {}}

+ [ -f /tmp/qmp/res/012462f4-a80d-4b8b-9ccf-f3b60f17e675 ]
+ cat /tmp/qmp/res/012462f4-a80d-4b8b-9ccf-f3b60f17e675
+ rm /tmp/qmp/res/012462f4-a80d-4b8b-9ccf-f3b60f17e675
+ sed -n /"qdev_id": "xen-pci-pt_0000-00-1a.0"/{s/.*"slot": \([0-9]\+\),.*"function": \([0-9]\+\),.*/\1,\2/;p}
+ sed s/"qdev_id"/\n\0/g
+ qmp_req {"execute": "query-pci"}
+ cat /proc/sys/kernel/random/uuid
+ local id=d4cb4572-03a5-4736-9fe2-8b85ee92a8ac
+ echo {"execute": "query-pci"}
+ mv /tmp/qmp/new-req_d4cb4572-03a5-4736-9fe2-8b85ee92a8ac /tmp/qmp/req/d4cb4572-03a5-4736-9fe2-8b85ee92a8ac
+ [ -f /tmp/qmp/res/d4cb4572-03a5-4736-9fe2-8b85ee92a8ac ]
+ sleep 0.1
d4cb4572-03a5-4736-9fe2-8b85ee92a8ac
{"execute": "query-pci"}
{"return": [{"bus": 0, "devices": [{"bus": 0, "qdev_id": "", "slot": 0, "class_info": {"class": 1536, "desc": "Host bridge"}, "id": {"device": 4663, "vendor": 32902}, "function": 0, "regions": []}, {"bus": 0, "qdev_id": "", "slot": 1, "class_info": {"class": 1537, "desc": "ISA bridge"}, "id": {"device": 28672, "vendor": 32902}, "function": 0, "regions": []}, {"bus": 0, "qdev_id": "", "slot": 1, "class_info": {"class": 257, "desc": "IDE controller"}, "id": {"device": 28688, "vendor": 32902}, "function": 1, "regions": [{"bar": 4, "size": 16, "address": 49696, "type": "io"}]}, {"bus": 0, "qdev_id": "", "irq": 5, "slot": 1, "class_info": {"class": 3075, "desc": "USB controller"}, "id": {"device": 28704, "vendor": 32902}, "function": 2, "regions": [{"bar": 4, "size": 32, "address": 49664, "type": "io"}]}, {"bus": 0, "qdev_id": "", "irq": 10, "slot": 1, "class_info": {"class": 1664, "desc": "Bridge"}, "id": {"device": 28947, "vendor": 32902}, "function": 3, "regions": []}, {"bus": 0, "qdev_id": "", "irq": 11, "slot": 2, "class_info": {"class": 65408}, "id": {"device": 1, "vendor": 22611}, "function": 0, "regions": [{"bar": 0, "size": 256, "address": 49152, "type": "io"}, {"prefetch": true, "mem_type_64": false, "bar": 1, "size": 16777216, "address": 4026531840, "type": "memory"}]}, {"bus": 0, "qdev_id": "", "slot": 3, "class_info": {"class": 768, "desc": "VGA controller"}, "id": {"device": 4369, "vendor": 4660}, "function": 0, "regions": [{"prefetch": true, "mem_type_64": false, "bar": 0, "size": 16777216, "address": 4043309056, "type": "memory"}, {"prefetch": false, "mem_type_64": false, "bar": 2, "size": 4096, "address": 4060233728, "type": "memory"}, {"prefetch": false, "mem_type_64": false, "bar": 6, "size": 65536, "address": -1, "type": "memory"}]}, {"bus": 0, "qdev_id": "xen-pci-pt_0000-00-14.0", "irq": 0, "slot": 4, "class_info": {"class": 0}, "id": {"device": 7729, "vendor": 32902}, "function": 0, "regions": [{"prefetch": false, "mem_type_64": true, "bar": 0, "size": 65536, "address": -1, "type": "memory"}]}, {"bus": 0, "qdev_id": "xen-pci-pt_0000-00-1a.0", "irq": 0, "slot": 5, "class_info": {"class": 0}, "id": {"device": 7725, "vendor": 32902}, "function": 0, "regions": [{"prefetch": false, "mem_type_64": false, "bar": 0, "size": 4096, "address": -1, "type": "memory"}]}]}]}

+ [ -f /tmp/qmp/res/d4cb4572-03a5-4736-9fe2-8b85ee92a8ac ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/d4cb4572-03a5-4736-9fe2-8b85ee92a8ac ]
+ cat /tmp/qmp/res/d4cb4572-03a5-4736-9fe2-8b85ee92a8ac
+ rm /tmp/qmp/res/d4cb4572-03a5-4736-9fe2-8b85ee92a8ac
+ slot_func=5,0
+ cut -d , -f 1
+ printf %s 5,0
+ slot=5
+ cut -d , -f 2
+ printf %s 5,0
+ func=0
+ vdevfn=40
+ printf 0x%02x 40
+ xenstore-write device-model/1/parameter 0x28
+ xenstore-write device-model/1/state pci-inserted
+ true
+ xenstore-watch -n 2 device-model/1/command
device-model/1/command
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
pci 0000:00:02.0: [8086:1e26] type 00 class 0x0c0320
pci 0000:00:02.0: reg 0x10: [mem 0xf7317000-0xf73173ff]
pcifront pci-0: New device on 0000:00:02.0 found.
pcifront pci-0: claiming resource 0000:00:02.0/0
device-model/1/command
+ xenstore-read device-model/1/command
+ cmd=pci-ins
+ [ pci-ins != pci-ins ]
+ xenstore-read device-model/1/parameter
+ para=0000:00:1d.0,msitranslate=0,power_mgmt=0
+ cut -b 1-12
+ printf %s 0000:00:1d.0,msitranslate=0,power_mgmt=0
+ dev=0000:00:1d.0
+ tr : -
+ printf %s 0000:00:1d.0
+ qdev_id=xen-pci-pt_0000-00-1d.0
+ [ pci-ins = pci-rem ]
+ xenstore-read device/pci/0/backend
+ be=/local/domain/0/backend/pci/2/0
+ xenstore-read /local/domain/0/backend/pci/2/0/num_devs
+ devs=3
+ dev_n=
+ seq 0 2
+ sed s/\.0\([0-9]\)$/.\1/
+ xenstore-read /local/domain/0/backend/pci/2/0/dev-0
+ [ 0000:00:1d.0 = 0000:00:14.0 ]
+ sed s/\.0\([0-9]\)$/.\1/
+ xenstore-read /local/domain/0/backend/pci/2/0/dev-1
+ [ 0000:00:1d.0 = 0000:00:1a.0 ]
+ sed s/\.0\([0-9]\)$/.\1/
+ xenstore-read /local/domain/0/backend/pci/2/0/dev-2
+ [ 0000:00:1d.0 = 0000:00:1d.0 ]
+ dev_n=2
+ break
+ [ -z 2 ]
+ xenstore-read /local/domain/0/backend/pci/2/0/vdev-2
+ vdev=0000:00:02.00
+ addr_arg=
+ xenstore-read /local/domain/0/backend/pci/2/0/vdevfn-2
xenstore-read: couldn't read path /local/domain/0/backend/pci/2/0/vdevfn-2
+ true
+ vdevfn=
+ [ -n  ]
+ permissive=false
+ grep -q \<permissive=1\>
+ xenstore-read /local/domain/0/backend/pci/2/0/opts-2
+ cat
+ qmp_req {"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1d.0", "hostaddr": "0000:00:02.00", "machine_addr": "0000:00:1d.0", "permissive": false}}
+ cat /proc/sys/kernel/random/uuid
+ local id=72e29461-65ff-4299-ab2f-ad4d69281368
+ echo {"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1d.0", "hostaddr": "0000:00:02.00", "machine_addr": "0000:00:1d.0", "permissive": false}}
+ mv /tmp/qmp/new-req_72e29461-65ff-4299-ab2f-ad4d69281368 /tmp/qmp/req/72e29461-65ff-4299-ab2f-ad4d69281368
+ [ -f /tmp/qmp/res/72e29461-65ff-4299-ab2f-ad4d69281368 ]
+ sleep 0.1
72e29461-65ff-4299-ab2f-ad4d69281368
{"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1d.0", "hostaddr": "0000:00:02.00", "machine_addr": "0000:00:1d.0", "permissive": false}}
[00:06.0] xen_pt_realize: Assigning real physical device 00:02.0 to devfn 0x30
{"error": {"class": "GenericError", "desc": "Need to enable igd-passthru if you're trying to passthrough IGD GFX"}}

+ [ -f /tmp/qmp/res/72e29461-65ff-4299-ab2f-ad4d69281368 ]
+ cat /tmp/qmp/res/72e29461-65ff-4299-ab2f-ad4d69281368
+ rm /tmp/qmp/res/72e29461-65ff-4299-ab2f-ad4d69281368
+ sed -n /"qdev_id": "xen-pci-pt_0000-00-1d.0"/{s/.*"slot": \([0-9]\+\),.*"function": \([0-9]\+\),.*/\1,\2/;p}
+ sed s/"qdev_id"/\n\0/g
+ qmp_req {"execute": "query-pci"}
+ cat /proc/sys/kernel/random/uuid
+ local id=416e0008-58d4-4673-a72a-7d49fbd0f3a7
+ echo {"execute": "query-pci"}
+ mv /tmp/qmp/new-req_416e0008-58d4-4673-a72a-7d49fbd0f3a7 /tmp/qmp/req/416e0008-58d4-4673-a72a-7d49fbd0f3a7
+ [ -f /tmp/qmp/res/416e0008-58d4-4673-a72a-7d49fbd0f3a7 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/416e0008-58d4-4673-a72a-7d49fbd0f3a7 ]
+ sleep 0.1
416e0008-58d4-4673-a72a-7d49fbd0f3a7
{"execute": "query-pci"}
{"return": [{"bus": 0, "devices": [{"bus": 0, "qdev_id": "", "slot": 0, "class_info": {"class": 1536, "desc": "Host bridge"}, "id": {"device": 4663, "vendor": 32902}, "function": 0, "regions": []}, {"bus": 0, "qdev_id": "", "slot": 1, "class_info": {"class": 1537, "desc": "ISA bridge"}, "id": {"device": 28672, "vendor": 32902}, "function": 0, "regions": []}, {"bus": 0, "qdev_id": "", "slot": 1, "class_info": {"class": 257, "desc": "IDE controller"}, "id": {"device": 28688, "vendor": 32902}, "function": 1, "regions": [{"bar": 4, "size": 16, "address": 49696, "type": "io"}]}, {"bus": 0, "qdev_id": "", "irq": 5, "slot": 1, "class_info": {"class": 3075, "desc": "USB controller"}, "id": {"device": 28704, "vendor": 32902}, "function": 2, "regions": [{"bar": 4, "size": 32, "address": 49664, "type": "io"}]}, {"bus": 0, "qdev_id": "", "irq": 10, "slot": 1, "class_info": {"class": 1664, "desc": "Bridge"}, "id": {"device": 28947, "vendor": 32902}, "function": 3, "regions": []}, {"bus": 0, "qdev_id": "", "irq": 11, "slot": 2, "class_info": {"class": 65408}, "id": {"device": 1, "vendor": 22611}, "function": 0, "regions": [{"bar": 0, "size": 256, "address": 49152, "type": "io"}, {"prefetch": true, "mem_type_64": false, "bar": 1, "size": 16777216, "address": 4026531840, "type": "memory"}]}, {"bus": 0, "qdev_id": "", "slot": 3, "class_info": {"class": 768, "desc": "VGA controller"}, "id": {"device": 4369, "vendor": 4660}, "function": 0, "regions": [{"prefetch": true, "mem_type_64": false, "bar": 0, "size": 16777216, "address": 4043309056, "type": "memory"}, {"prefetch": false, "mem_type_64": false, "bar": 2, "size": 4096, "address": 4060233728, "type": "memory"}, {"prefetch": false, "mem_type_64": false, "bar": 6, "size": 65536, "address": -1, "type": "memory"}]}, {"bus": 0, "qdev_id": "xen-pci-pt_0000-00-14.0", "irq": 0, "slot": 4, "class_info": {"class": 0}, "id": {"device": 7729, "vendor": 32902}, "function": 0, "regions": [{"prefetch": false, "mem_type_64": true, "bar": 0, "size": 65536, "address": -1, "type": "memory"}]}, {"bus": 0, "qdev_id": "xen-pci-pt_0000-00-1a.0", "irq": 0, "slot": 5, "class_info": {"class": 0}, "id": {"device": 7725, "vendor": 32902}, "function": 0, "regions": [{"prefetch": false, "mem_type_64": false, "bar": 0, "size": 4096, "address": -1, "type": "memory"}]}]}]}

+ [ -f /tmp/qmp/res/416e0008-58d4-4673-a72a-7d49fbd0f3a7 ]
+ cat /tmp/qmp/res/416e0008-58d4-4673-a72a-7d49fbd0f3a7
+ rm /tmp/qmp/res/416e0008-58d4-4673-a72a-7d49fbd0f3a7
+ slot_func=
+ cut -d , -f 1
+ printf %s 
+ slot=
+ cut -d , -f 2
+ printf %s 
+ func=
/init: line 1: arithmetic syntax error
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
Linux version 4.7.6-xen-stubdom (user@build-fedora4) (gcc version 6.4.1 20170727 (Red Hat 6.4.1-1) (GCC) ) #1 Sun Oct 15 22:56:52 UTC 2017
Grant table initialized
PCI: setting up Xen PCI frontend stub
PCI: pci_cache_line_size set to 64 bytes
xen:balloon: Initialising balloon driver
PCI: System does not support PCI
PCI: System does not support PCI
amd_nb: Cannot enumerate AMD northbridges
{"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1d.0", "hostaddr": "0000:00:02.00", "machine_addr": "0000:00:1d.0", "permissive": false}}
[00:07.0] xen_pt_realize: Assigning real physical device 00:02.0 to devfn 0x38
{"error": {"class": "GenericError", "desc": "Need to enable igd-passthru if you're trying to passthrough IGD GFX"}}

+ [ -f /tmp/qmp/res/c6facbf0-108e-48a1-be10-ea1e0d9064db ]
+ cat /tmp/qmp/res/c6facbf0-108e-48a1-be10-ea1e0d9064db
+ rm /tmp/qmp/res/c6facbf0-108e-48a1-be10-ea1e0d9064db
+ slot_func=
+ cut -d , -f 1
+ printf %s 
+ slot=
+ cut -d , -f 2
+ printf %s 
+ func=
/init: line 1: arithmetic syntax error
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
Linux version 4.7.6-xen-stubdom (user@build-fedora4) (gcc version 6.4.1 20170727 (Red Hat 6.4.1-1) (GCC) ) #1 Sun Oct 15 22:56:52 UTC 2017
Member

adrelanos commented Oct 30, 2017

I have no idea, therefore I've sent the full log by encrypted e-mail to you, @HW42, and posted a few "highlights" where I guestimate that something could be wrong here.

+ echo {"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-14.0", "hostaddr": "0000:00:00.00", "machine_addr": "0000:00:14.0", "permissive": false}}
+ mv /tmp/qmp/new-req_e9a7d62c-9252-417f-b5bd-e8da97b8be77 /tmp/qmp/req/e9a7d62c-9252-417f-b5bd-e8da97b8be77
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
e9a7d62c-9252-417f-b5bd-e8da97b8be77
[00:04.0] xen_pt_realize: Assigning real physical device 00:00.0 to devfn 0x20
[00:04.0] xen_pt_register_regions: IO region 0 registered (size=0x00010000 base_addr=0xf7300000 type: 0x4)
[00:04.0] xen_pt_config_reg_init: Offset 0x0006 mismatch! Emulated=0x0010, host=0x0290, syncing to 0x0290.
[00:04.0] xen_pt_config_reg_init: Offset 0x000e mismatch! Emulated=0x0080, host=0x0000, syncing to 0x0000.
[00:04.0] xen_pt_config_reg_init: Offset 0x0010 mismatch! Emulated=0x0000, host=0xf7300004, syncing to 0xf7300004.
[00:04.0] xen_pt_config_reg_init: Offset 0x0072 mismatch! Emulated=0x0000, host=0x01c2, syncing to 0x0002.
{"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-14.0", "hostaddr": "0000:00:00.00", "machine_addr": "0000:00:14.0", "permissive": false}}
{"timestamp": {"seconds": 1509366929, "microseconds": 451706}, "event": "DEVICE_DELETED", "data": {"path": "/machine/peripheral-anon/device[4]"}}

[00:04.0] xen_pt_config_reg_init: Offset 0x0082 mismatch! Emulated=0x0000, host=0x0086, syncing to 0x0080.
[00:04.0] xen_pt_pci_intx: intx=1
[00:04.0] xen_pt_realize: Real physical device 00:00.0 registered successfully
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
{"timestamp": {"seconds": 1509366929, "microseconds": 451801}, "event": "DEVICE_DELETED", "data": {"path": "/machine/peripheral-anon/device[3]"}}

+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
{"timestamp": {"seconds": 1509366929, "microseconds": 451865}, "event": "DEVICE_DELETED", "data": {"path": "/machine/peripheral-anon/device[2]"}}

+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
{"timestamp": {"seconds": 1509366929, "microseconds": 451921}, "event": "DEVICE_DELETED", "data": {"path": "/machine/peripheral-anon/device[1]"}}

+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
{"timestamp": {"seconds": 1509366929, "microseconds": 451976}, "event": "DEVICE_DELETED", "data": {"device": "scsi0", "path": "/machine/peripheral/scsi0"}}

+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ sleep 0.1
{"return": {}}

+ [ -f /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77 ]
+ cat /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77
+ rm /tmp/qmp/res/e9a7d62c-9252-417f-b5bd-e8da97b8be77
+ sed s/"qdev_id"/\n\0/g
+ sed -n /"qdev_id": "xen-pci-pt_0000-00-14.0"/{s/.*"slot": \([0-9]\+\),.*"function": \([0-9]\+\),.*/\1,\2/;p}
+ qmp_req {"execute": "query-pci"}
+ cat /proc/sys/kernel/random/uuid
+ local id=13efce57-4b3b-4cbb-aced-1da548c0857e
+ echo {"execute": "query-pci"}
+ mv /tmp/qmp/new-req_13efce57-4b3b-4cbb-aced-1da548c0857e /tmp/qmp/req/13efce57-4b3b-4cbb-aced-1da548c0857e
+ [ -f /tmp/qmp/res/13efce57-4b3b-4cbb-aced-1da548c0857e ]
+ sleep 0.1
13efce57-4b3b-4cbb-aced-1da548c0857e
+ [ -f /tmp/qmp/res/13efce57-4b3b-4cbb-aced-1da548c0857e ]
+ sleep 0.1
{"execute": "query-pci"}
{"return": [{"bus": 0, "devices": [{"bus": 0, "qdev_id": "", "slot": 0, "class_info": {"class": 1536, "desc": "Host bridge"}, "id": {"device": 4663, "vendor": 32902}, "function": 0, "regions": []}, {"bus": 0, "qdev_id": "", "slot": 1, "class_info": {"class": 1537, "desc": "ISA bridge"}, "id": {"device": 28672, "vendor": 32902}, "function": 0, "regions": []}, {"bus": 0, "qdev_id": "", "slot": 1, "class_info": {"class": 257, "desc": "IDE controller"}, "id": {"device": 28688, "vendor": 32902}, "function": 1, "regions": [{"bar": 4, "size": 16, "address": 49696, "type": "io"}]}, {"bus": 0, "qdev_id": "", "irq": 5, "slot": 1, "class_info": {"class": 3075, "desc": "USB controller"}, "id": {"device": 28704, "vendor": 32902}, "function": 2, "regions": [{"bar": 4, "size": 32, "address": 49664, "type": "io"}]}, {"bus": 0, "qdev_id": "", "irq": 10, "slot": 1, "class_info": {"class": 1664, "desc": "Bridge"}, "id": {"device": 28947, "vendor": 32902}, "function": 3, "regions": []}, {"bus": 0, "qdev_id": "", "irq": 11, "slot": 2, "class_info": {"class": 65408}, "id": {"device": 1, "vendor": 22611}, "function": 0, "regions": [{"bar": 0, "size": 256, "address": 49152, "type": "io"}, {"prefetch": true, "mem_type_64": false, "bar": 1, "size": 16777216, "address": 4026531840, "type": "memory"}]}, {"bus": 0, "qdev_id": "", "slot": 3, "class_info": {"class": 768, "desc": "VGA controller"}, "id": {"device": 4369, "vendor": 4660}, "function": 0, "regions": [{"prefetch": true, "mem_type_64": false, "bar": 0, "size": 16777216, "address": 4043309056, "type": "memory"}, {"prefetch": false, "mem_type_64": false, "bar": 2, "size": 4096, "address": 4060233728, "type": "memory"}, {"prefetch": false, "mem_type_64": false, "bar": 6, "size": 65536, "address": -1, "type": "memory"}]}, {"bus": 0, "qdev_id": "xen-pci-pt_0000-00-14.0", "irq": 0, "slot": 4, "class_info": {"class": 0}, "id": {"device": 7729, "vendor": 32902}, "function": 0, "regions": [{"prefetch": false, "mem_type_64": true, "bar": 0, "size": 65536, "address": -1, "type": "memory"}]}]}]}

+ [ -f /tmp/qmp/res/13efce57-4b3b-4cbb-aced-1da548c0857e ]
+ cat /tmp/qmp/res/13efce57-4b3b-4cbb-aced-1da548c0857e
+ rm /tmp/qmp/res/13efce57-4b3b-4cbb-aced-1da548c0857e
+ slot_func=4,0
+ cut -d , -f 1
+ printf %s 4,0
+ slot=4
+ cut -d , -f 2
+ printf %s 4,0
+ func=0
+ vdevfn=32
+ printf 0x%02x 32
+ xenstore-write device-model/1/parameter 0x20
+ xenstore-write device-model/1/state pci-inserted
+ true
+ xenstore-watch -n 2 device-model/1/command
device-model/1/command
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
pci 0000:00:01.0: [8086:1e2d] type 00 class 0x0c0320
pci 0000:00:01.0: reg 0x10: [mem 0xf7318000-0xf73183ff]
pcifront pci-0: New device on 0000:00:01.0 found.
pcifront pci-0: claiming resource 0000:00:01.0/0
device-model/1/command
+ xenstore-read device-model/1/command
+ cmd=pci-ins
+ [ pci-ins != pci-ins ]
+ xenstore-read device-model/1/parameter
+ para=0000:00:1a.0,msitranslate=0,power_mgmt=0
+ cut -b 1-12
+ printf %s 0000:00:1a.0,msitranslate=0,power_mgmt=0
+ dev=0000:00:1a.0
+ tr : -
+ printf %s 0000:00:1a.0
+ qdev_id=xen-pci-pt_0000-00-1a.0
+ [ pci-ins = pci-rem ]
+ xenstore-read device/pci/0/backend
+ be=/local/domain/0/backend/pci/2/0
+ xenstore-read /local/domain/0/backend/pci/2/0/num_devs
+ devs=2
+ dev_n=
+ seq 0 1
+ sed s/\.0\([0-9]\)$/.\1/
+ xenstore-read /local/domain/0/backend/pci/2/0/dev-0
+ [ 0000:00:1a.0 = 0000:00:14.0 ]
+ sed s/\.0\([0-9]\)$/.\1/
+ xenstore-read /local/domain/0/backend/pci/2/0/dev-1
+ [ 0000:00:1a.0 = 0000:00:1a.0 ]
+ dev_n=1
+ break
+ [ -z 1 ]
+ xenstore-read /local/domain/0/backend/pci/2/0/vdev-1
+ vdev=0000:00:01.00
+ addr_arg=
+ xenstore-read /local/domain/0/backend/pci/2/0/vdevfn-1
xenstore-read: couldn't read path /local/domain/0/backend/pci/2/0/vdevfn-1
+ true
+ vdevfn=
+ [ -n  ]
+ permissive=false
+ grep -q \<permissive=1\>
+ xenstore-read /local/domain/0/backend/pci/2/0/opts-1
+ cat
+ qmp_req {"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1a.0", "hostaddr": "0000:00:01.00", "machine_addr": "0000:00:1a.0", "permissive": false}}
+ cat /proc/sys/kernel/random/uuid
+ local id=012462f4-a80d-4b8b-9ccf-f3b60f17e675
+ echo {"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1a.0", "hostaddr": "0000:00:01.00", "machine_addr": "0000:00:1a.0", "permissive": false}}
+ mv /tmp/qmp/new-req_012462f4-a80d-4b8b-9ccf-f3b60f17e675 /tmp/qmp/req/012462f4-a80d-4b8b-9ccf-f3b60f17e675
+ [ -f /tmp/qmp/res/012462f4-a80d-4b8b-9ccf-f3b60f17e675 ]
+ sleep 0.1
012462f4-a80d-4b8b-9ccf-f3b60f17e675
{"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1a.0", "hostaddr": "0000:00:01.00", "machine_addr": "0000:00:1a.0", "permissive": false}}
[00:05.0] xen_pt_realize: Assigning real physical device 00:01.0 to devfn 0x28
[00:05.0] xen_pt_register_regions: IO region 0 registered (size=0x00001000 base_addr=0xf7318000 type: 0)
[00:05.0] xen_pt_config_reg_init: Offset 0x0006 mismatch! Emulated=0x0010, host=0x0290, syncing to 0x0290.
[00:05.0] xen_pt_config_reg_init: Offset 0x000e mismatch! Emulated=0x0080, host=0x0000, syncing to 0x0000.
[00:05.0] xen_pt_config_reg_init: Offset 0x0010 mismatch! Emulated=0x0000, host=0xf7318000, syncing to 0xf7318000.
[00:05.0] xen_pt_config_reg_init: Offset 0x0052 mismatch! Emulated=0x0000, host=0x01c2, syncing to 0x0002.
[00:05.0] xen_pt_pci_intx: intx=1
[00:05.0] xen_pt_realize: Real physical device 00:01.0 registered successfully
{"return": {}}

+ [ -f /tmp/qmp/res/012462f4-a80d-4b8b-9ccf-f3b60f17e675 ]
+ cat /tmp/qmp/res/012462f4-a80d-4b8b-9ccf-f3b60f17e675
+ rm /tmp/qmp/res/012462f4-a80d-4b8b-9ccf-f3b60f17e675
+ sed -n /"qdev_id": "xen-pci-pt_0000-00-1a.0"/{s/.*"slot": \([0-9]\+\),.*"function": \([0-9]\+\),.*/\1,\2/;p}
+ sed s/"qdev_id"/\n\0/g
+ qmp_req {"execute": "query-pci"}
+ cat /proc/sys/kernel/random/uuid
+ local id=d4cb4572-03a5-4736-9fe2-8b85ee92a8ac
+ echo {"execute": "query-pci"}
+ mv /tmp/qmp/new-req_d4cb4572-03a5-4736-9fe2-8b85ee92a8ac /tmp/qmp/req/d4cb4572-03a5-4736-9fe2-8b85ee92a8ac
+ [ -f /tmp/qmp/res/d4cb4572-03a5-4736-9fe2-8b85ee92a8ac ]
+ sleep 0.1
d4cb4572-03a5-4736-9fe2-8b85ee92a8ac
{"execute": "query-pci"}
{"return": [{"bus": 0, "devices": [{"bus": 0, "qdev_id": "", "slot": 0, "class_info": {"class": 1536, "desc": "Host bridge"}, "id": {"device": 4663, "vendor": 32902}, "function": 0, "regions": []}, {"bus": 0, "qdev_id": "", "slot": 1, "class_info": {"class": 1537, "desc": "ISA bridge"}, "id": {"device": 28672, "vendor": 32902}, "function": 0, "regions": []}, {"bus": 0, "qdev_id": "", "slot": 1, "class_info": {"class": 257, "desc": "IDE controller"}, "id": {"device": 28688, "vendor": 32902}, "function": 1, "regions": [{"bar": 4, "size": 16, "address": 49696, "type": "io"}]}, {"bus": 0, "qdev_id": "", "irq": 5, "slot": 1, "class_info": {"class": 3075, "desc": "USB controller"}, "id": {"device": 28704, "vendor": 32902}, "function": 2, "regions": [{"bar": 4, "size": 32, "address": 49664, "type": "io"}]}, {"bus": 0, "qdev_id": "", "irq": 10, "slot": 1, "class_info": {"class": 1664, "desc": "Bridge"}, "id": {"device": 28947, "vendor": 32902}, "function": 3, "regions": []}, {"bus": 0, "qdev_id": "", "irq": 11, "slot": 2, "class_info": {"class": 65408}, "id": {"device": 1, "vendor": 22611}, "function": 0, "regions": [{"bar": 0, "size": 256, "address": 49152, "type": "io"}, {"prefetch": true, "mem_type_64": false, "bar": 1, "size": 16777216, "address": 4026531840, "type": "memory"}]}, {"bus": 0, "qdev_id": "", "slot": 3, "class_info": {"class": 768, "desc": "VGA controller"}, "id": {"device": 4369, "vendor": 4660}, "function": 0, "regions": [{"prefetch": true, "mem_type_64": false, "bar": 0, "size": 16777216, "address": 4043309056, "type": "memory"}, {"prefetch": false, "mem_type_64": false, "bar": 2, "size": 4096, "address": 4060233728, "type": "memory"}, {"prefetch": false, "mem_type_64": false, "bar": 6, "size": 65536, "address": -1, "type": "memory"}]}, {"bus": 0, "qdev_id": "xen-pci-pt_0000-00-14.0", "irq": 0, "slot": 4, "class_info": {"class": 0}, "id": {"device": 7729, "vendor": 32902}, "function": 0, "regions": [{"prefetch": false, "mem_type_64": true, "bar": 0, "size": 65536, "address": -1, "type": "memory"}]}, {"bus": 0, "qdev_id": "xen-pci-pt_0000-00-1a.0", "irq": 0, "slot": 5, "class_info": {"class": 0}, "id": {"device": 7725, "vendor": 32902}, "function": 0, "regions": [{"prefetch": false, "mem_type_64": false, "bar": 0, "size": 4096, "address": -1, "type": "memory"}]}]}]}

+ [ -f /tmp/qmp/res/d4cb4572-03a5-4736-9fe2-8b85ee92a8ac ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/d4cb4572-03a5-4736-9fe2-8b85ee92a8ac ]
+ cat /tmp/qmp/res/d4cb4572-03a5-4736-9fe2-8b85ee92a8ac
+ rm /tmp/qmp/res/d4cb4572-03a5-4736-9fe2-8b85ee92a8ac
+ slot_func=5,0
+ cut -d , -f 1
+ printf %s 5,0
+ slot=5
+ cut -d , -f 2
+ printf %s 5,0
+ func=0
+ vdevfn=40
+ printf 0x%02x 40
+ xenstore-write device-model/1/parameter 0x28
+ xenstore-write device-model/1/state pci-inserted
+ true
+ xenstore-watch -n 2 device-model/1/command
device-model/1/command
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
pci 0000:00:02.0: [8086:1e26] type 00 class 0x0c0320
pci 0000:00:02.0: reg 0x10: [mem 0xf7317000-0xf73173ff]
pcifront pci-0: New device on 0000:00:02.0 found.
pcifront pci-0: claiming resource 0000:00:02.0/0
device-model/1/command
+ xenstore-read device-model/1/command
+ cmd=pci-ins
+ [ pci-ins != pci-ins ]
+ xenstore-read device-model/1/parameter
+ para=0000:00:1d.0,msitranslate=0,power_mgmt=0
+ cut -b 1-12
+ printf %s 0000:00:1d.0,msitranslate=0,power_mgmt=0
+ dev=0000:00:1d.0
+ tr : -
+ printf %s 0000:00:1d.0
+ qdev_id=xen-pci-pt_0000-00-1d.0
+ [ pci-ins = pci-rem ]
+ xenstore-read device/pci/0/backend
+ be=/local/domain/0/backend/pci/2/0
+ xenstore-read /local/domain/0/backend/pci/2/0/num_devs
+ devs=3
+ dev_n=
+ seq 0 2
+ sed s/\.0\([0-9]\)$/.\1/
+ xenstore-read /local/domain/0/backend/pci/2/0/dev-0
+ [ 0000:00:1d.0 = 0000:00:14.0 ]
+ sed s/\.0\([0-9]\)$/.\1/
+ xenstore-read /local/domain/0/backend/pci/2/0/dev-1
+ [ 0000:00:1d.0 = 0000:00:1a.0 ]
+ sed s/\.0\([0-9]\)$/.\1/
+ xenstore-read /local/domain/0/backend/pci/2/0/dev-2
+ [ 0000:00:1d.0 = 0000:00:1d.0 ]
+ dev_n=2
+ break
+ [ -z 2 ]
+ xenstore-read /local/domain/0/backend/pci/2/0/vdev-2
+ vdev=0000:00:02.00
+ addr_arg=
+ xenstore-read /local/domain/0/backend/pci/2/0/vdevfn-2
xenstore-read: couldn't read path /local/domain/0/backend/pci/2/0/vdevfn-2
+ true
+ vdevfn=
+ [ -n  ]
+ permissive=false
+ grep -q \<permissive=1\>
+ xenstore-read /local/domain/0/backend/pci/2/0/opts-2
+ cat
+ qmp_req {"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1d.0", "hostaddr": "0000:00:02.00", "machine_addr": "0000:00:1d.0", "permissive": false}}
+ cat /proc/sys/kernel/random/uuid
+ local id=72e29461-65ff-4299-ab2f-ad4d69281368
+ echo {"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1d.0", "hostaddr": "0000:00:02.00", "machine_addr": "0000:00:1d.0", "permissive": false}}
+ mv /tmp/qmp/new-req_72e29461-65ff-4299-ab2f-ad4d69281368 /tmp/qmp/req/72e29461-65ff-4299-ab2f-ad4d69281368
+ [ -f /tmp/qmp/res/72e29461-65ff-4299-ab2f-ad4d69281368 ]
+ sleep 0.1
72e29461-65ff-4299-ab2f-ad4d69281368
{"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1d.0", "hostaddr": "0000:00:02.00", "machine_addr": "0000:00:1d.0", "permissive": false}}
[00:06.0] xen_pt_realize: Assigning real physical device 00:02.0 to devfn 0x30
{"error": {"class": "GenericError", "desc": "Need to enable igd-passthru if you're trying to passthrough IGD GFX"}}

+ [ -f /tmp/qmp/res/72e29461-65ff-4299-ab2f-ad4d69281368 ]
+ cat /tmp/qmp/res/72e29461-65ff-4299-ab2f-ad4d69281368
+ rm /tmp/qmp/res/72e29461-65ff-4299-ab2f-ad4d69281368
+ sed -n /"qdev_id": "xen-pci-pt_0000-00-1d.0"/{s/.*"slot": \([0-9]\+\),.*"function": \([0-9]\+\),.*/\1,\2/;p}
+ sed s/"qdev_id"/\n\0/g
+ qmp_req {"execute": "query-pci"}
+ cat /proc/sys/kernel/random/uuid
+ local id=416e0008-58d4-4673-a72a-7d49fbd0f3a7
+ echo {"execute": "query-pci"}
+ mv /tmp/qmp/new-req_416e0008-58d4-4673-a72a-7d49fbd0f3a7 /tmp/qmp/req/416e0008-58d4-4673-a72a-7d49fbd0f3a7
+ [ -f /tmp/qmp/res/416e0008-58d4-4673-a72a-7d49fbd0f3a7 ]
+ sleep 0.1
+ [ -f /tmp/qmp/res/416e0008-58d4-4673-a72a-7d49fbd0f3a7 ]
+ sleep 0.1
416e0008-58d4-4673-a72a-7d49fbd0f3a7
{"execute": "query-pci"}
{"return": [{"bus": 0, "devices": [{"bus": 0, "qdev_id": "", "slot": 0, "class_info": {"class": 1536, "desc": "Host bridge"}, "id": {"device": 4663, "vendor": 32902}, "function": 0, "regions": []}, {"bus": 0, "qdev_id": "", "slot": 1, "class_info": {"class": 1537, "desc": "ISA bridge"}, "id": {"device": 28672, "vendor": 32902}, "function": 0, "regions": []}, {"bus": 0, "qdev_id": "", "slot": 1, "class_info": {"class": 257, "desc": "IDE controller"}, "id": {"device": 28688, "vendor": 32902}, "function": 1, "regions": [{"bar": 4, "size": 16, "address": 49696, "type": "io"}]}, {"bus": 0, "qdev_id": "", "irq": 5, "slot": 1, "class_info": {"class": 3075, "desc": "USB controller"}, "id": {"device": 28704, "vendor": 32902}, "function": 2, "regions": [{"bar": 4, "size": 32, "address": 49664, "type": "io"}]}, {"bus": 0, "qdev_id": "", "irq": 10, "slot": 1, "class_info": {"class": 1664, "desc": "Bridge"}, "id": {"device": 28947, "vendor": 32902}, "function": 3, "regions": []}, {"bus": 0, "qdev_id": "", "irq": 11, "slot": 2, "class_info": {"class": 65408}, "id": {"device": 1, "vendor": 22611}, "function": 0, "regions": [{"bar": 0, "size": 256, "address": 49152, "type": "io"}, {"prefetch": true, "mem_type_64": false, "bar": 1, "size": 16777216, "address": 4026531840, "type": "memory"}]}, {"bus": 0, "qdev_id": "", "slot": 3, "class_info": {"class": 768, "desc": "VGA controller"}, "id": {"device": 4369, "vendor": 4660}, "function": 0, "regions": [{"prefetch": true, "mem_type_64": false, "bar": 0, "size": 16777216, "address": 4043309056, "type": "memory"}, {"prefetch": false, "mem_type_64": false, "bar": 2, "size": 4096, "address": 4060233728, "type": "memory"}, {"prefetch": false, "mem_type_64": false, "bar": 6, "size": 65536, "address": -1, "type": "memory"}]}, {"bus": 0, "qdev_id": "xen-pci-pt_0000-00-14.0", "irq": 0, "slot": 4, "class_info": {"class": 0}, "id": {"device": 7729, "vendor": 32902}, "function": 0, "regions": [{"prefetch": false, "mem_type_64": true, "bar": 0, "size": 65536, "address": -1, "type": "memory"}]}, {"bus": 0, "qdev_id": "xen-pci-pt_0000-00-1a.0", "irq": 0, "slot": 5, "class_info": {"class": 0}, "id": {"device": 7725, "vendor": 32902}, "function": 0, "regions": [{"prefetch": false, "mem_type_64": false, "bar": 0, "size": 4096, "address": -1, "type": "memory"}]}]}]}

+ [ -f /tmp/qmp/res/416e0008-58d4-4673-a72a-7d49fbd0f3a7 ]
+ cat /tmp/qmp/res/416e0008-58d4-4673-a72a-7d49fbd0f3a7
+ rm /tmp/qmp/res/416e0008-58d4-4673-a72a-7d49fbd0f3a7
+ slot_func=
+ cut -d , -f 1
+ printf %s 
+ slot=
+ cut -d , -f 2
+ printf %s 
+ func=
/init: line 1: arithmetic syntax error
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
Linux version 4.7.6-xen-stubdom (user@build-fedora4) (gcc version 6.4.1 20170727 (Red Hat 6.4.1-1) (GCC) ) #1 Sun Oct 15 22:56:52 UTC 2017
Grant table initialized
PCI: setting up Xen PCI frontend stub
PCI: pci_cache_line_size set to 64 bytes
xen:balloon: Initialising balloon driver
PCI: System does not support PCI
PCI: System does not support PCI
amd_nb: Cannot enumerate AMD northbridges
{"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1d.0", "hostaddr": "0000:00:02.00", "machine_addr": "0000:00:1d.0", "permissive": false}}
[00:07.0] xen_pt_realize: Assigning real physical device 00:02.0 to devfn 0x38
{"error": {"class": "GenericError", "desc": "Need to enable igd-passthru if you're trying to passthrough IGD GFX"}}

+ [ -f /tmp/qmp/res/c6facbf0-108e-48a1-be10-ea1e0d9064db ]
+ cat /tmp/qmp/res/c6facbf0-108e-48a1-be10-ea1e0d9064db
+ rm /tmp/qmp/res/c6facbf0-108e-48a1-be10-ea1e0d9064db
+ slot_func=
+ cut -d , -f 1
+ printf %s 
+ slot=
+ cut -d , -f 2
+ printf %s 
+ func=
/init: line 1: arithmetic syntax error
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
pcifront pci-0: Rescanning PCI Frontend Bus 0000:00
Linux version 4.7.6-xen-stubdom (user@build-fedora4) (gcc version 6.4.1 20170727 (Red Hat 6.4.1-1) (GCC) ) #1 Sun Oct 15 22:56:52 UTC 2017
@marmarek

This comment has been minimized.

Show comment
Hide comment
@marmarek

marmarek Oct 30, 2017

Member

{"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1d.0", "hostaddr": "0000:00:02.00", "machine_addr": "0000:00:1d.0", "permissive": false}}
[00:07.0] xen_pt_realize: Assigning real physical device 00:02.0 to devfn 0x38
{"error": {"class": "GenericError", "desc": "Need to enable igd-passthru if you're trying to passthrough IGD GFX"}}

Have you really tried to assign GPU, or is this another misleading error?

  • [ -f /tmp/qmp/res/c6facbf0-108e-48a1-be10-ea1e0d9064db ]
  • cat /tmp/qmp/res/c6facbf0-108e-48a1-be10-ea1e0d9064db
  • rm /tmp/qmp/res/c6facbf0-108e-48a1-be10-ea1e0d9064db
  • slot_func=
  • cut -d , -f 1
  • printf %s
  • slot=
  • cut -d , -f 2
  • printf %s
  • func=
    /init: line 1: arithmetic syntax error

This looks like the issue causing "Device Model not ready" and "qemu refused to add device"

Member

marmarek commented Oct 30, 2017

{"execute": "device_add", "arguments": {"driver": "xen-pci-passthrough", "id": "xen-pci-pt_0000-00-1d.0", "hostaddr": "0000:00:02.00", "machine_addr": "0000:00:1d.0", "permissive": false}}
[00:07.0] xen_pt_realize: Assigning real physical device 00:02.0 to devfn 0x38
{"error": {"class": "GenericError", "desc": "Need to enable igd-passthru if you're trying to passthrough IGD GFX"}}

Have you really tried to assign GPU, or is this another misleading error?

  • [ -f /tmp/qmp/res/c6facbf0-108e-48a1-be10-ea1e0d9064db ]
  • cat /tmp/qmp/res/c6facbf0-108e-48a1-be10-ea1e0d9064db
  • rm /tmp/qmp/res/c6facbf0-108e-48a1-be10-ea1e0d9064db
  • slot_func=
  • cut -d , -f 1
  • printf %s
  • slot=
  • cut -d , -f 2
  • printf %s
  • func=
    /init: line 1: arithmetic syntax error

This looks like the issue causing "Device Model not ready" and "qemu refused to add device"

HW42 added a commit to HW42/qubes-vmm-xen-stubdom-linux that referenced this issue Oct 31, 2017

qemu: Use machine BDF when cheking for IGDs
The check for graphic card pass-through assumes that it sees the real
BDF but when running inside a stubdom BDF 0000:00:02.0 is simply the
third passed-through device. So use the machine BDF instead of the
pcifront BDF.

QubesOS/qubes-issues#3263

@HW42 HW42 referenced this issue in QubesOS/qubes-vmm-xen-stubdom-linux Oct 31, 2017

Merged

qemu: Use machine BDF when cheking for IGDs #8

@HW42

This comment has been minimized.

Show comment
Hide comment
@HW42

HW42 Oct 31, 2017

Have you really tried to assign GPU, or is this another misleading error?

This will happen if you assign three or more devices since QEMU thinks 0000:00:02.0 is a graphic card. Should be fixed by QubesOS/qubes-vmm-xen-stubdom-linux#8.

HW42 commented Oct 31, 2017

Have you really tried to assign GPU, or is this another misleading error?

This will happen if you assign three or more devices since QEMU thinks 0000:00:02.0 is a graphic card. Should be fixed by QubesOS/qubes-vmm-xen-stubdom-linux#8.

@adrelanos

This comment has been minimized.

Show comment
Hide comment
@adrelanos

adrelanos Oct 31, 2017

Member

Have you really tried to assign GPU, or is this another misleading error?

Probably not (by mistake if anything), but I could re-setup this environment to test, unless you're not confident that QubesOS/qubes-vmm-xen-stubdom-linux#8 is the bug and fixes this.

/init: line 1: arithmetic syntax error

Is that the same bug, I mean, does your QubesOS/qubes-vmm-xen-stubdom-linux#8 pull request also fix that? @HW42

Member

adrelanos commented Oct 31, 2017

Have you really tried to assign GPU, or is this another misleading error?

Probably not (by mistake if anything), but I could re-setup this environment to test, unless you're not confident that QubesOS/qubes-vmm-xen-stubdom-linux#8 is the bug and fixes this.

/init: line 1: arithmetic syntax error

Is that the same bug, I mean, does your QubesOS/qubes-vmm-xen-stubdom-linux#8 pull request also fix that? @HW42

@HW42

This comment has been minimized.

Show comment
Hide comment
@HW42

HW42 Oct 31, 2017

/init: line 1: arithmetic syntax error

Is that the same bug, I mean, does your QubesOS/qubes-vmm-xen-stubdom-linux#8 pull request also fix that? @HW42

That's just the consequence of the error QEMU outputs, since the script doesn't handle errors.

HW42 commented Oct 31, 2017

/init: line 1: arithmetic syntax error

Is that the same bug, I mean, does your QubesOS/qubes-vmm-xen-stubdom-linux#8 pull request also fix that? @HW42

That's just the consequence of the error QEMU outputs, since the script doesn't handle errors.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment