trigger-rebuild

[marmarek]

just for CI

[qubesos-bot]

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2024071323-4.3&flavor=pull-requests

Test run included the following:

• Update for Xen 4.19 qubes-vmm-xen-stubdom-linux#68 (QubesOS/qubes-vmm-xen-stubdom-linux@56f4d22)
• trigger-rebuild #146 (77693f8)
• Update to 4.19-rc qubes-vmm-xen#185 (QubesOS/qubes-vmm-xen@1a62d32)
• trigger rebuild qubes-core-vchan-xen#40 (QubesOS/qubes-core-vchan-xen@89d7393)
• Update to 10.5.0 and adjust for Xen 4.19 qubes-core-libvirt#49 (QubesOS/qubes-core-libvirt@efeb066)

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2024070519-4.3&flavor=update

• system_tests_extra

  • TC_00_QVCTest_whonix-workstation-17: test_010_screenshare (failure)
    self.assertNotEqual(vm.run('test -e /dev/vid... AssertionError: 0 == 0

• system_tests_suspend

  • suspend: unnamed test (unknown)

  • suspend: Failed (test died)
    # Test died: no candidate needle with tag(s) 'xscreensaver-prompt' ...

  • suspend: wait_serial (wait serial expected)
    # wait_serial expected: "lspci; echo 2E8vz-\$?-"...

  • suspend: wait_serial (wait serial expected)
    # wait_serial expected: qr/2E8vz-\d+-/...

Failed tests

11 failures

• system_tests_pvgrub_salt_storage

  • [unstable] TC_41_HVMGrub_debian-12-xfce: test_000_standalone_vm (error)
    qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

  • [unstable] TC_41_HVMGrub_debian-12-xfce: test_010_template_based_vm (error)
    qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

  • TC_41_HVMGrub_fedora-40-xfce: test_000_standalone_vm (error)
    qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

  • TC_41_HVMGrub_fedora-40-xfce: test_010_template_based_vm (error)
    qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

• system_tests_splitgpg

  • TC_10_Thunderbird_whonix-workstation-17: test_020_send_receive_inline_with_attachment (failure)
    dogtail.tree.SearchError: descendent of [application | Thunderbird]...

• system_tests_extra

  • [unstable] TC_00_QVCTest_debian-12-xfce: test_020_webcam (failure + cleanup)
    AssertionError: 'qubes-video-companion webcam' exited early (0): b'...

  • TC_00_QVCTest_whonix-workstation-17: test_010_screenshare (failure)
    self.assertNotEqual(vm.run('test -e /dev/vid... AssertionError: 0 == 0

• system_tests_suspend

  • suspend: unnamed test (unknown)

  • suspend: Failed (test died)
    # Test died: no candidate needle with tag(s) 'xscreensaver-prompt' ...

  • suspend: wait_serial (wait serial expected)
    # wait_serial expected: "lspci; echo 2E8vz-\$?-"...

  • suspend: wait_serial (wait serial expected)
    # wait_serial expected: qr/2E8vz-\d+-/...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/105374#dependencies

6 fixed

• system_tests_splitgpg

  • TC_10_Thunderbird_debian-12-xfce: test_010_send_receive_inline_signed_only (failure)
    dogtail.tree.SearchError: descendent of [application | Thunderbird]...

• system_tests_extra

  • TC_00_QVCTest_fedora-40-xfce: test_020_webcam (failure + cleanup)
    AssertionError: 'qubes-video-companion webcam' exited early (0): b'...

  • TC_00_QVCTest_whonix-gateway-17: test_020_webcam (failure + cleanup)
    AssertionError: 'qubes-video-companion webcam' exited early (0): b'...

  • TC_00_QVCTest_whonix-workstation-17: test_020_webcam (failure + cleanup)
    AssertionError: 'qubes-video-companion webcam' exited early (0): b'...

• system_tests_usbproxy

  • TC_20_USBProxy_core3_fedora-40-xfce: test_070_attach_not_installed_front (error)
    qubesusbproxy.core3ext.QubesUSBException: Device attach failed: 202...

• system_tests_network_updates

  • TC_11_QvmTemplateMgmtVM_debian-12-xfce: test_000_template_list (failure)
    AssertionError: libvirt event impl drain timeout

Unstable tests

• system_tests_update

  update2/Failed (1/5 times with errors)

  • job 103358 # Test died: command 'script -c 'qubes-vm-update --max-concurrency=...

• system_tests_basic_vm_qrexec_gui

  TC_20_AudioVM_Pulse_whonix-workstation-17/test_220_audio_play_pulseaudio (2/5 times with errors)

  • job 101758 AssertionError: too short audio, expected 10s, got 8.73532879818594...
  • job 103642 AssertionError: too short audio, expected 10s, got 8.64043083900226...
  TC_20_AudioVM_Pulse_whonix-workstation-17/test_221_audio_rec_muted_pulseaudio (1/5 times with errors)

  • job 103642 Cannot process volume group qubes_dom0...
  TC_20_AudioVM_Pulse_whonix-workstation-17/test_222_audio_rec_unmuted_pulseaudio (1/5 times with errors)

  • job 101758 AssertionError: too short audio, expected 10s, got 9.36446712018140...
  TC_20_AudioVM_Pulse_whonix-workstation-17/test_223_audio_play_hvm (1/5 times with errors)

  • job 102413 AssertionError: only silence detected, no useful audio data

• system_tests_pvgrub_salt_storage

  TC_41_HVMGrub_debian-12-xfce/test_000_standalone_vm (2/5 times with errors)

  • job 101773 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  • job 102428 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  TC_41_HVMGrub_debian-12-xfce/test_010_template_based_vm (2/5 times with errors)

  • job 101773 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  • job 102428 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

• system_tests_splitgpg

  TC_10_Thunderbird_debian-12-xfce/test_010_send_receive_inline_signed_only (1/5 times with errors)

  • job 105472 dogtail.tree.SearchError: descendent of [application | Thunderbird]...

• system_tests_extra

  TC_00_QVCTest_debian-12-xfce/test_020_webcam (2/5 times with errors)

  • job 102420 AssertionError: 'qubes-video-companion webcam' exited early (0): b'...
  • job 104728 AssertionError: 'qubes-video-companion webcam' exited early (0): b'...
  TC_00_QVCTest_fedora-40-xfce/test_020_webcam (2/5 times with errors)

  • job 101765 AssertionError: 'qubes-video-companion webcam' exited early (0): b'...
  • job 105464 AssertionError: 'qubes-video-companion webcam' exited early (0): b'...
  TC_00_QVCTest_whonix-gateway-17/test_020_webcam (3/5 times with errors)

  • job 102420 AssertionError: 'qubes-video-companion webcam' exited early (0): b'...
  • job 103649 self.assertNotEqual(vm.run('test -e /dev/vid... AssertionError: 0 == 0
  • job 105464 AssertionError: 'qubes-video-companion webcam' exited early (0): b'...
  TC_00_QVCTest_whonix-workstation-17/test_020_webcam (3/5 times with errors)

  • job 102420 AssertionError: 'qubes-video-companion webcam' exited early (0): b'...
  • job 103649 AssertionError: 'qubes-video-companion webcam' exited early (0): b'...
  • job 105464 AssertionError: 'qubes-video-companion webcam' exited early (0): b'...

• system_tests_usbproxy

  TC_20_USBProxy_core3_fedora-40-xfce/test_070_attach_not_installed_front (1/5 times with errors)

  • job 105442 qubesusbproxy.core3ext.QubesUSBException: Device attach failed: 202...

• system_tests_network_updates

  TC_11_QvmTemplateMgmtVM_debian-12-xfce/test_000_template_list (1/5 times with errors)

  • job 105469 AssertionError: libvirt event impl drain timeout
  TC_10_QvmTemplate_whonix-gateway-17/test_010_template_install (1/5 times with errors)

  • job 103656 AssertionError: libvirt event impl drain timeout
  VmUpdates_debian-12-xfce/test_020_updates_available_notification (1/5 times with errors)

  • job 104735 subprocess.CalledProcessError: Command '/usr/lib/qubes/upgrades-sta...
  VmUpdates_debian-12-xfce/test_110_update_via_proxy_qubes_vm_update (1/5 times with errors)

  • job 104735 AssertionError: 1 not found in [0] : dpkg -l test-pkg | grep 1.1: b''
  VmUpdates_fedora-40-xfce/test_110_update_via_proxy_qubes_vm_update (1/5 times with errors)

  • job 104735 AssertionError: 1 not found in [0, 100] : rpm -q test-pkg | grep 1....
  VmUpdates_debian-12-xfce/test_111_update_via_proxy_qubes_vm_update_cli (1/5 times with errors)

  • job 104735 AssertionError: 1 not found in [0] : dpkg -l test-pkg | grep 1.1: b''
  VmUpdates_fedora-40-xfce/test_111_update_via_proxy_qubes_vm_update_cli (1/5 times with errors)

  • job 104735 AssertionError: 1 not found in [0, 100] : rpm -q test-pkg | grep 1....
  VmUpdates_debian-12-xfce/test_130_no_network_qubes_vm_update (1/5 times with errors)

  • job 104735 AssertionError: qubes-vm-update return unexpected code: 0 in (1, 2, 5)
  VmUpdates_fedora-40-xfce/test_130_no_network_qubes_vm_update (1/5 times with errors)

  • job 104735 AssertionError: qubes-vm-update return unexpected code: 0 in (1, 2, 5)
  VmUpdates_debian-12-xfce/test_131_no_network_qubes_vm_update_cli (1/5 times with errors)

  • job 104735 AssertionError: qubes-vm-update return unexpected code: 0 in (1, 2, 5)
  VmUpdates_fedora-40-xfce/test_131_no_network_qubes_vm_update_cli (1/5 times with errors)

  • job 104735 AssertionError: qubes-vm-update return unexpected code: 0 in (1, 2, 5)

• system_tests_dispvm

  TC_20_DispVM_fedora-40-xfce/test_100_open_in_dispvm (2/5 times with errors)

  • job 101764 AssertionError: './open-file test.txt' failed with ./open-file test...
  • job 102419 AssertionError: './open-file test.txt' failed with ./open-file test...

• system_tests_basic_vm_qrexec_gui_zfs

  TC_00_Basic/test_120_start_standalone_with_cdrom_dom0 (1/5 times with errors)

  • job 101113 AssertionError: 1 != 0 : b'Timeout waiting for dom0:loop6 device to...
  TC_20_AudioVM_Pulse_whonix-workstation-17-pool/test_220_audio_play_pulseaudio (1/5 times with errors)

  • job 101113 AssertionError: Command 'timeout 20s paplay --format=float32le --ra...
  TC_20_AudioVM_Pulse_whonix-workstation-17-pool/test_222_audio_rec_unmuted_pulseaudio (1/5 times with errors)

  • job 101113 AssertionError: only silence detected, no useful audio data
  TC_20_AudioVM_Pulse_debian-12-xfce-pool/test_223_audio_play_hvm (1/5 times with errors)

  • job 103646 AssertionError: only silence detected, no useful audio data
  TC_20_AudioVM_Pulse_whonix-workstation-17-pool/test_223_audio_play_hvm (1/5 times with errors)

  • job 101113 AssertionError: Command 'timeout 20s paplay --format=float32le --ra...
  TC_20_AudioVM_Pulse_whonix-workstation-17-pool/test_252_audio_playback_audiovm_switch_hvm (1/5 times with errors)

  • job 101113 AssertionError: Command 'timeout 20s paplay --format=float32le --ra...

• system_tests_basic_vm_qrexec_gui_btrfs

  TC_20_AudioVM_Pulse_fedora-40-xfce-pool/test_225_audio_rec_unmuted_hvm (1/5 times with errors)

  • job 101782 AssertionError: too short audio, expected 10s, got 6.28875283446712...
  TC_20_AudioVM_Pulse_whonix-workstation-17-pool/test_252_audio_playback_audiovm_switch_hvm (1/5 times with errors)

  • job 101782 AssertionError: pacat for test-inst-vm1 (xid 90) running(False) in ...

• system_tests_basic_vm_qrexec_gui_ext4

  TC_20_AudioVM_Pulse_debian-12-xfce-pool/test_223_audio_play_hvm (1/5 times with errors)

  • job 102415 AssertionError: only silence detected, no useful audio data

• system_tests_basic_vm_qrexec_gui_xfs

  TC_20_AudioVM_Pulse_whonix-workstation-17-pool/test_220_audio_play_pulseaudio (1/5 times with errors)

  • job 101781 AssertionError: too short audio, expected 10s, got 8.33947845804988...
  TC_20_AudioVM_Pulse_whonix-workstation-17-pool/test_222_audio_rec_unmuted_pulseaudio (1/5 times with errors)

  • job 101781 AssertionError: too short audio, expected 10s, got 8.17784580498866...
  TC_20_AudioVM_Pulse_whonix-workstation-17-pool/test_223_audio_play_hvm (1/5 times with errors)

  • job 101781 AssertionError: too short audio, expected 10s, got 7.71551020408163...
  TC_20_AudioVM_PipeWire_debian-12-xfce-pool/test_226_audio_playback_pipewire (1/5 times with errors)

  • job 102416 AssertionError: too short audio, expected 10s, got 8.31034013605442...
  TC_20_AudioVM_PipeWire_debian-12-xfce-pool/test_228_audio_rec_unmuted_pipewire (1/5 times with errors)

  • job 102416 AssertionError: too short audio, expected 10s, got 8.89784580498866...
  TC_20_AudioVM_PipeWire_fedora-40-xfce-pool/test_228_audio_rec_unmuted_pipewire (1/5 times with errors)

  • job 102416 AssertionError: too short audio, expected 10s, got 9.45630385487528...
  TC_20_AudioVM_PipeWire_debian-12-xfce-pool/test_250_audio_playback_audiovm_pipewire (1/5 times with errors)

  • job 102416 AssertionError: too short audio, expected 10s, got 7.48553287981859...
  TC_20_AudioVM_PipeWire_debian-12-xfce-pool/test_251_audio_playback_audiovm_pipewire_late_start (1/5 times with errors)

  • job 102416 AssertionError: too short audio, expected 10s, got 9.19612244897959...
  TC_20_AudioVM_Pulse_whonix-workstation-17-pool/test_252_audio_playback_audiovm_switch_hvm (1/5 times with errors)

  • job 102416 AssertionError: too short audio, expected 10s, got 6.77941043083900...

• system_tests_update@hw1

  update2/Failed (1/5 times with errors)

  • job 103358 # Test died: command 'script -c 'qubes-vm-update --max-concurrency=...

• system_tests_basic_vm_qrexec_gui@hw1

  TC_20_AudioVM_Pulse_whonix-workstation-17/test_220_audio_play_pulseaudio (2/5 times with errors)

  • job 101758 AssertionError: too short audio, expected 10s, got 8.73532879818594...
  • job 103642 AssertionError: too short audio, expected 10s, got 8.64043083900226...
  TC_20_AudioVM_Pulse_whonix-workstation-17/test_221_audio_rec_muted_pulseaudio (1/5 times with errors)

  • job 103642 Cannot process volume group qubes_dom0...
  TC_20_AudioVM_Pulse_whonix-workstation-17/test_222_audio_rec_unmuted_pulseaudio (1/5 times with errors)

  • job 101758 AssertionError: too short audio, expected 10s, got 9.36446712018140...
  TC_20_AudioVM_Pulse_whonix-workstation-17/test_223_audio_play_hvm (1/5 times with errors)

  • job 102413 AssertionError: only silence detected, no useful audio data

• system_tests_suspend@hw1

  suspend/ (1/5 times with errors)

  • job 103660 None
  suspend/Failed (1/5 times with errors)

  • job 103660 # Test died: no candidate needle with tag(s) 'xscreensaver-prompt' ...
  suspend/wait_serial (1/5 times with errors)

  • job 103660 # wait_serial expected: qr/2E8vz-\d+-/...

• system_tests_update@hw7

  update2/Failed (1/5 times with errors)

  • job 103358 # Test died: command 'script -c 'qubes-vm-update --max-concurrency=...