Skip to content

tests: dom0 update via qubes-vm-update - #861

Merged
marmarek merged 5 commits into
QubesOS:mainfrom
marmarek:tests-dom0-vm-update
Aug 7, 2026
Merged

tests: dom0 update via qubes-vm-update#861
marmarek merged 5 commits into
QubesOS:mainfrom
marmarek:tests-dom0-vm-update

Conversation

@marmarek

@marmarek marmarek commented Aug 3, 2026

Copy link
Copy Markdown
Member

No description provided.

@codecov

codecov Bot commented Aug 3, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 70.43%. Comparing base (35d28d3) to head (cb85f10).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #861      +/-   ##
==========================================
- Coverage   70.44%   70.43%   -0.02%     
==========================================
  Files          61       61              
  Lines       14165    14191      +26     
==========================================
+ Hits         9979     9995      +16     
- Misses       4186     4196      +10     
Flag Coverage Δ
unittests 70.43% <ø> (-0.02%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@qubesos-bot

qubesos-bot commented Aug 3, 2026

Copy link
Copy Markdown

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2026080611-devel&flavor=pull-requests

Test run included the following:

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2026050504-devel&flavor=update

  • system_tests_extra

  • system_tests_usbproxy

    • TC_20_USBProxy_core3_debian-13-xfce: test_030_detach (error)
      qubesusbproxy.core3ext.QubesUSBException: Device detach failed: 20...
  • system_tests_guivm_gpu_gui_interactive@hw13

    • update_guivm: wait_serial (wait serial expected)
      # wait_serial expected: "root"...

    • update_guivm: Failed (test died)
      # Test died: Root prompt not there at qubesos/lib/qubesdistribution...

Failed tests

14 failures
  • system_tests_whonix

    • [unstable] whonixcheck: fail (unknown)
      Whonixcheck for anon-whonix failed...

    • [unstable] whonixcheck: fail (unknown)
      Whonixcheck for whonix-gateway-18 failed...

    • [unstable] whonixcheck: fail (unknown)
      Whonixcheck for sys-whonix failed...

    • [unstable] whonixcheck: Failed (test died)
      # Test died: systemcheck failed at qubesos/tests/whonixcheck.pm lin...

  • system_tests_extra

  • system_tests_whonix@hw1

    • [unstable] whonixcheck: fail (unknown)
      Whonixcheck for anon-whonix failed...

    • [unstable] whonixcheck: fail (unknown)
      Whonixcheck for sys-whonix failed...

    • [unstable] whonixcheck: Failed (test died)
      # Test died: systemcheck failed at qubesos/tests/whonixcheck.pm lin...

  • system_tests_usbproxy

    • TC_20_USBProxy_core3_debian-13-xfce: test_030_detach (error)
      qubesusbproxy.core3ext.QubesUSBException: Device detach failed: 20...
  • system_tests_network_updates

    • [unstable] TC_00_Dom0Upgrade_whonix-gateway-18: test_000_update_salt (failure)
      ?[0;31mDuration: 179146.41 ms?[0;0m... ?[0;31m Changes: ?[0;0m
  • system_tests_guivm_gpu_gui_interactive@hw13

    • update_guivm: wait_serial (wait serial expected)
      # wait_serial expected: "root"...

    • update_guivm: Failed (test died)
      # Test died: Root prompt not there at qubesos/lib/qubesdistribution...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/176874#dependencies

30 fixed
  • system_tests_pvgrub_salt_storage

    • system_tests: Fail (unknown)
      Tests qubes.tests.integ.grub failed (exit code 1), details reported...

    • system_tests: Failed (test died)
      # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...

    • TC_41_HVMGrub_debian-13-xfce: test_000_standalone_vm (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

    • TC_41_HVMGrub_debian-13-xfce: test_001_standalone_vm_dracut (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

    • TC_41_HVMGrub_debian-13-xfce: test_010_template_based_vm (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

    • TC_41_HVMGrub_debian-13-xfce: test_011_template_based_vm_dracut (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

    • TC_41_HVMGrub_fedora-43-xfce: test_010_template_based_vm (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

  • system_tests_extra

    • TC_01_InputProxyExclude_debian-13-xfce: test_000_qemu_tablet (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

    • TC_01_InputProxyExclude_fedora-43-xfce: test_000_qemu_tablet (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

    • TC_00_QVCTest_fedora-43-xfce: test_010_screenshare (failure + cleanup)
      ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 1179648 != 0

    • TC_00_QVCTest_whonix-gateway-18: test_010_screenshare (failure + cleanup)
      AssertionError: 2.3156185715769593 not less than 2.0

    • TC_00_PDFConverter_fedora-43-xfce: test_004_cancel_stops_conversion (failure)
      AssertionError: DispVM not cleaned up 10s after cancel: {<DispVM at...

  • system_tests_network_ipv6

    • system_tests: Fail (unknown)
      Tests qubes.tests.integ.network_ipv6 failed (exit code 1), details ...

    • system_tests: Failed (test died)
      # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...

    • VmIPv6Networking_fedora-43-xfce: test_001_simple_networking_paused_from_none_to_existent (error)
      raise TimeoutError from exc_val... TimeoutError

  • system_tests_audio@hw1

    • system_tests: Fail (unknown)
      Tests qubes.tests.integ.audio failed (exit code 1), details reporte...

    • system_tests: Failed (test died)
      # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...

    • TC_20_AudioVM_Pulse_debian-13-xfce: test_222_audio_rec_unmuted_pulseaudio (failure)
      AssertionError: only silence detected, no useful audio data

  • system_tests_usbproxy

    • system_tests: wait_serial (wait serial expected)
      # wait_serial expected: qr/h3uXO-\d+-/...

    • TC_20_USBProxy_core3_fedora-43-xfce: test_090_attach_stubdom (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

  • system_tests_audio

  • system_tests_guivm_gpu_gui_interactive@hw13

    • shutdown: unnamed test (unknown)
    • shutdown: Failed (test died)
      # Test died: no candidate needle with tag(s) 'text-logged-in-root' ...

Unstable tests

Details
  • system_tests_whonix

    whonixcheck/Failed (1/5 times with errors)
    • job 189348 # Test died: command 'qvm-run -ap whonix-gateway-18 'LC_ALL=C whon...
    whonixcheck/fail (1/5 times with errors)
    • job 189348 Whonixcheck for anon-whonix failed...
    whonixcheck/wait_serial (1/5 times with errors)
    • job 189348 # Command: qvm-run -ap whonix-gateway-18 'LC_ALL=C whonixcheck --v...
    whonixcheck/wait_serial (1/5 times with errors)
    • job 189348 # Command: curl --form upload=@/var/log/libvirt/libxl/libxl-driver....
  • system_tests_gui_tools

    qui_widgets_update/ (1/5 times with errors)
    qui_widgets_update/ (1/5 times with errors)
    qui_widgets_update/Failed (1/5 times with errors)
    • job 189375 # Test died: no candidate needle with tag(s) 'qubes-update-finish' ...
  • system_tests_network

    system_tests/Fail (1/5 times with errors)
    • job 190295 Tests qubes.tests.integ.network failed (exit code 1), details repor...
    system_tests/Failed (1/5 times with errors)
    • job 191203 # Test died: command 'curl --form upload=@tests-qubes.tests.integ.n...
    system_tests/Failed (1/5 times with errors)
    • job 190295 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    VmNetworking_debian-13-xfce/test_001_simple_networking_paused_from_none_to_existent (1/5 times with errors)
    • job 190295 raise TimeoutError from exc_val... TimeoutError
    VmNetworking_debian-13-xfce/test_110_dynamic_attach (1/5 times with errors)
    • job 190295 raise TimeoutError from exc_val... TimeoutError
  • system_tests_pvgrub_salt_storage

    system_tests/Fail (2/5 times with errors)
    • job 190476 Tests qubes.tests.integ.grub failed (exit code 1), details reported...
    • job 191206 Tests qubes.tests.integ.grub failed (exit code 1), details reported...
    system_tests/Failed (1/5 times with errors)
    • job 190298 # Test died: command 'curl --form upload=@nose2-junit.xml --form up...
    system_tests/Failed (2/5 times with errors)
    • job 190476 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 191206 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_41_HVMGrub_debian-13-xfce/test_010_template_based_vm (2/5 times with errors)
    • job 190476 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    • job 191206 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_41_HVMGrub_fedora-44-xfce/test_010_template_based_vm (2/5 times with errors)
    • job 190476 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    • job 191206 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_41_HVMGrub_debian-13-xfce/test_011_template_based_vm_dracut (1/5 times with errors)
    • job 190476 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  • system_tests_extra

    system_tests/Fail (1/5 times with errors)
    • job 190469 Tests qubes.tests.extra failed (exit code 1), details reported sepa...
    system_tests/Failed (1/5 times with errors)
    • job 190469 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_00_PDFConverter_debian-13-xfce/test_004_cancel_stops_conversion (1/5 times with errors)
    • job 190469 AssertionError: DispVM not cleaned up 10s after cancel: {<DispVM at...
    TC_00_PDFConverter_fedora-44-xfce/test_004_cancel_stops_conversion (1/5 times with errors)
    • job 190469 AssertionError: DispVM not cleaned up 10s after cancel: {<DispVM at...
  • system_tests_qrexec

    system_tests/Fail (2/5 times with errors)
    • job 190299 Tests qubes.tests.integ.qrexec failed (exit code 1), details report...
    • job 190314 Tests qubes.tests.integ.qrexec failed (exit code 1), details report...
    system_tests/Failed (2/5 times with errors)
    • job 190299 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 190314 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_00_Qrexec_whonix-workstation-18/test_095_qrexec_service_socket_vm (2/5 times with errors)
    • job 190299 AssertionError: waiting for /etc/qubes-rpc/test.Socket in VM timed out
    • job 190314 AssertionError: waiting for /etc/qubes-rpc/test.Socket in VM timed out
  • system_tests_network_ipv6

    system_tests/Fail (3/5 times with errors)
    • job 189378 Tests qubes.tests.integ.network_ipv6 failed (exit code 1), details ...
    • job 190296 Tests qubes.tests.integ.network_ipv6 failed (exit code 1), details ...
    • job 191204 Tests qubes.tests.integ.network_ipv6 failed (exit code 1), details ...
    system_tests/Failed (1/5 times with errors)
    • job 190474 # Test died: command 'curl --form upload=@tests-qubes.tests.integ.n...
    system_tests/Failed (3/5 times with errors)
    • job 189378 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 190296 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 191204 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    VmIPv6Networking_debian-13-xfce/test_001_simple_networking_paused_from_none_to_existent (1/5 times with errors)
    • job 189378 subprocess.CalledProcessError: Command 'qubes.WaitForNetworkUplink'...
    VmIPv6Networking_debian-13-xfce/test_001_simple_networking_paused_restart_netvm (1/5 times with errors)
    • job 190296 AssertionError: Timeout while waiting for VM test-inst-netvm1 shutdown
    VmIPv6Networking_fedora-44-xfce/test_501_simple_networking_paused_from_none_to_existent (1/5 times with errors)
    • job 191204 raise TimeoutError from exc_val... TimeoutError
    VmIPv6Networking_fedora-44-xfce/test_510_ipv6_simple_proxyvm (1/5 times with errors)
    • job 190296 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  • system_tests_kde_gui_interactive

    gui_keyboard_layout/Failed (1/5 times with errors)
    • job 189137 # Test died: command 'qvm-shutdown --wait work' timed out at /usr/l...
    gui_keyboard_layout/wait_serial (1/5 times with errors)
    • job 189137 # Command: qvm-shutdown --wait work...
  • system_tests_audio@hw1

    system_tests/Fail (3/5 times with errors)
    • job 189136 Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
    • job 190447 Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
    • job 191177 Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
    system_tests/Failed (2/5 times with errors)
    • job 190447 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 191177 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    system_tests/Failed (1/5 times with errors)
    • job 189136 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_20_AudioVM_PipeWire_whonix-workstation-18/test_251_audio_playback_audiovm_pipewire_late_start (1/5 times with errors)
    • job 189136 AssertionError: too short audio, expected 10s, got 9.09505668934240...
    TC_20_AudioVM_PipeWire_debian-13-xfce/test_260_audio_mic_enabled_switch_audiovm (1/5 times with errors)
    • job 191177 AssertionError: pacat for test-inst-vm1 (xid 50) running(False) in ...
    TC_20_AudioVM_PipeWire_fedora-44-xfce/test_260_audio_mic_enabled_switch_audiovm (1/5 times with errors)
    • job 191177 AssertionError: pacat for test-inst-vm1 (xid 59) running(False) in ...
    TC_20_AudioVM_PipeWire_whonix-workstation-18/test_260_audio_mic_enabled_switch_audiovm (1/5 times with errors)
    • job 190447 AssertionError: 0 not greater than 0 : Failed to move-source-output
  • system_tests_whonix@hw1

    whonixcheck/Failed (1/5 times with errors)
    • job 189348 # Test died: command 'qvm-run -ap whonix-gateway-18 'LC_ALL=C whon...
    whonixcheck/fail (1/5 times with errors)
    • job 189348 Whonixcheck for anon-whonix failed...
    whonixcheck/wait_serial (1/5 times with errors)
    • job 189348 # Command: qvm-run -ap whonix-gateway-18 'LC_ALL=C whonixcheck --v...
    whonixcheck/wait_serial (1/5 times with errors)
    • job 189348 # Command: curl --form upload=@/var/log/libvirt/libxl/libxl-driver....
  • system_tests_gui_tools@hw7

    qui_widgets_update/ (1/5 times with errors)
    qui_widgets_update/ (1/5 times with errors)
    qui_widgets_update/Failed (1/5 times with errors)
    • job 189375 # Test died: no candidate needle with tag(s) 'qubes-update-finish' ...
  • system_tests_usbproxy

    system_tests/Fail (1/5 times with errors)
    • job 190443 Tests qubes.tests.extra failed (exit code 1), details reported sepa...
    system_tests/Failed (1/5 times with errors)
    • job 190443 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_00_USBProxy_fedora-44-xfce/test_020_detach_on_remove (1/5 times with errors)
    • job 190443 AssertionError: 0 != 1 : Device not cleaned up
  • system_tests_audio

    system_tests/Fail (3/5 times with errors)
    • job 189136 Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
    • job 190447 Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
    • job 191177 Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
    system_tests/Failed (2/5 times with errors)
    • job 190447 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 191177 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    system_tests/Failed (1/5 times with errors)
    • job 189136 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_20_AudioVM_PipeWire_whonix-workstation-18/test_251_audio_playback_audiovm_pipewire_late_start (1/5 times with errors)
    • job 189136 AssertionError: too short audio, expected 10s, got 9.09505668934240...
    TC_20_AudioVM_PipeWire_debian-13-xfce/test_260_audio_mic_enabled_switch_audiovm (1/5 times with errors)
    • job 191177 AssertionError: pacat for test-inst-vm1 (xid 50) running(False) in ...
    TC_20_AudioVM_PipeWire_fedora-44-xfce/test_260_audio_mic_enabled_switch_audiovm (1/5 times with errors)
    • job 191177 AssertionError: pacat for test-inst-vm1 (xid 59) running(False) in ...
    TC_20_AudioVM_PipeWire_whonix-workstation-18/test_260_audio_mic_enabled_switch_audiovm (1/5 times with errors)
    • job 190447 AssertionError: 0 not greater than 0 : Failed to move-source-output
  • system_tests_network_updates

    system_tests/Fail (3/5 times with errors)
    • job 190297 Tests qubes.tests.integ.dom0_update failed (exit code 1), details r...
    • job 190312 Tests qubes.tests.integ.dom0_update failed (exit code 1), details r...
    • job 190475 Tests qubes.tests.integ.dom0_update failed (exit code 1), details r...
    system_tests/Fail (1/5 times with errors)
    • job 191227 Tests qubes.tests.integ.vm_update failed (exit code 1), details rep...
    fetch_packages_list/Failed (1/5 times with errors)
    system_tests/Failed (4/5 times with errors)
    • job 190297 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 190312 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 190475 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 191227 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_11_QvmTemplateMgmtVM_whonix-gateway-18/test_000_template_list (1/5 times with errors)
    • job 190475 subprocess.CalledProcessError: Command 'timeout=120; while ! tor-ci...
    TC_00_Dom0Upgrade_whonix-gateway-18/test_000_update_salt (2/5 times with errors)
    • job 190297 ?[0;31mDuration: 140907.985 ms?[0;0m... ?[0;31m Changes: ?[0;0m
    • job 190312 ?[0;31mDuration: 135117.105 ms?[0;0m... ?[0;31m Changes: ?[0;0m
    TC_00_Dom0Upgrade_whonix-gateway-18/test_001_update_check (2/5 times with errors)
    VmUpdates_fedora-44-xfce/test_011_pkcon_via_proxy (1/5 times with errors)
    • job 191227 AssertionError: 7 not found in [0, 100] : pkcon install -y test-pkg...
    VmUpdates_debian-13-xfce/test_110_update_via_proxy_qubes_vm_update (1/5 times with errors)
    • job 191227 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

Performance Tests

Performance degradation:

19 performance degradations
  • whonix-gateway-18_exec-root: 154.78 🔻 ( previous job: 126.14, degradation: 122.71%)
  • whonix-gateway-18_socket-data-duplex: 106.55 🔻 ( previous job: 90.03, degradation: 118.34%)
  • whonix-workstation-18_exec-root: 160.47 🔻 ( previous job: 144.02, degradation: 111.42%)
  • whonix-workstation-18_socket: 9.99 🔻 ( previous job: 7.66, degradation: 130.33%)
  • whonix-workstation-18_socket-root: 10.32 🔻 ( previous job: 8.87, degradation: 116.34%)
  • whonix-workstation-18_exec-data-duplex-root: 157.44 🔻 ( previous job: 130.67, degradation: 120.49%)
  • dom0_root_seq1m_q1t1_write 3:write_bandwidth_kb: 170291.00 🔻 ( previous job: 199974.00, degradation: 85.16%)
  • dom0_root_rnd4k_q1t1_read 3:read_bandwidth_kb: 7378.00 🔻 ( previous job: 8963.00, degradation: 82.32%)
  • dom0_root_rnd4k_q1t1_write 3:write_bandwidth_kb: 3228.00 🔻 ( previous job: 5055.00, degradation: 63.86%)
  • dom0_varlibqubes_rnd4k_q32t1_read 3:read_bandwidth_kb: 16526.00 🔻 ( previous job: 102155.00, degradation: 16.18%)
  • dom0_varlibqubes_rnd4k_q32t1_write 3:write_bandwidth_kb: 4754.00 🔻 ( previous job: 10623.00, degradation: 44.75%)
  • debian-13-xfce_dom0-dispvm-gui-api (mean:8.614): 103.37 🔻 ( previous job: 93.50, degradation: 110.56%)
  • debian-13-xfce_dom0-dispvm-preload-4-api (mean:3.008): 36.10 🔻 ( previous job: 30.73, degradation: 117.46%)
  • debian-13-xfce_dom0-dispvm-preload-4-gui-api (mean:4.075): 48.90 🔻 ( previous job: 44.40, degradation: 110.14%)
  • whonix-workstation-18_dom0-dispvm-api (mean:9.601): 115.21 🔻 ( previous job: 97.14, degradation: 118.61%)
  • whonix-workstation-18_dom0-dispvm-gui-api (mean:11.817): 141.80 🔻 ( previous job: 121.86, degradation: 116.37%)
  • whonix-workstation-18_dom0-dispvm-preload-2-delay-0-api (mean:4.571): 54.85 🔻 ( previous job: 48.26, degradation: 113.66%)
  • whonix-workstation-18_dom0-dispvm-preload-4-api (mean:3.593): 43.11 🔻 ( previous job: 38.29, degradation: 112.60%)
  • whonix-workstation-18_dom0-dispvm-preload-4-delay-minus-1d2-api (mean:4.065): 48.78 🔻 ( previous job: 42.67, degradation: 114.33%)

Remaining performance tests:

92 tests
  • debian-13-xfce_exec: 8.58 🔻 ( previous job: 7.85, degradation: 109.21%)
  • debian-13-xfce_exec-root: 27.37 🔻 ( previous job: 26.74, degradation: 102.35%)
  • debian-13-xfce_socket: 8.77 🔻 ( previous job: 8.37, degradation: 104.79%)
  • debian-13-xfce_socket-root: 9.32 🔻 ( previous job: 9.13, degradation: 102.07%)
  • debian-13-xfce_exec-data-simplex: 64.76 🔻 ( previous job: 63.05, degradation: 102.71%)
  • debian-13-xfce_exec-data-duplex: 66.25 🔻 ( previous job: 62.45, degradation: 106.08%)
  • debian-13-xfce_exec-data-duplex-root: 79.13 🔻 ( previous job: 78.04, degradation: 101.39%)
  • debian-13-xfce_socket-data-duplex: 78.95 🟢 ( previous job: 85.67, improvement: 92.16%)
  • fedora-44-xfce_exec: 9.11
  • fedora-44-xfce_exec-root: 71.40
  • fedora-44-xfce_socket: 9.11
  • fedora-44-xfce_socket-root: 9.46
  • fedora-44-xfce_exec-data-simplex: 71.86
  • fedora-44-xfce_exec-data-duplex: 70.90
  • fedora-44-xfce_exec-data-duplex-root: 109.78
  • fedora-44-xfce_socket-data-duplex: 84.16
  • whonix-gateway-18_exec: 8.05 🔻 ( previous job: 8.01, degradation: 100.55%)
  • whonix-gateway-18_socket: 8.43 🟢 ( previous job: 8.63, improvement: 97.70%)
  • whonix-gateway-18_socket-root: 8.59 🔻 ( previous job: 8.37, degradation: 102.60%)
  • whonix-gateway-18_exec-data-simplex: 67.57 🔻 ( previous job: 62.50, degradation: 108.12%)
  • whonix-gateway-18_exec-data-duplex: 65.92 🟢 ( previous job: 68.01, improvement: 96.93%)
  • whonix-gateway-18_exec-data-duplex-root: 145.02 🔻 ( previous job: 137.28, degradation: 105.64%)
  • whonix-workstation-18_exec: 8.90 🔻 ( previous job: 8.14, degradation: 109.40%)
  • whonix-workstation-18_exec-data-simplex: 69.86 🔻 ( previous job: 66.36, degradation: 105.28%)
  • whonix-workstation-18_exec-data-duplex: 58.05 🟢 ( previous job: 65.56, improvement: 88.56%)
  • whonix-workstation-18_socket-data-duplex: 86.42 🟢 ( previous job: 92.97, improvement: 92.95%)
  • dom0_root_seq1m_q8t1_read 3:read_bandwidth_kb: 478801.00 🟢 ( previous job: 388793.00, improvement: 123.15%)
  • dom0_root_seq1m_q8t1_write 3:write_bandwidth_kb: 155817.00 🟢 ( previous job: 119690.00, improvement: 130.18%)
  • dom0_root_seq1m_q1t1_read 3:read_bandwidth_kb: 436179.00 🟢 ( previous job: 245223.00, improvement: 177.87%)
  • dom0_root_rnd4k_q32t1_read 3:read_bandwidth_kb: 109706.00 🟢 ( previous job: 13948.00, improvement: 786.54%)
  • dom0_root_rnd4k_q32t1_write 3:write_bandwidth_kb: 8769.00 🟢 ( previous job: 6899.00, improvement: 127.11%)
  • dom0_varlibqubes_seq1m_q8t1_read 3:read_bandwidth_kb: 445255.00 🟢 ( previous job: 429040.00, improvement: 103.78%)
  • dom0_varlibqubes_seq1m_q8t1_write 3:write_bandwidth_kb: 333304.00 🟢 ( previous job: 257066.00, improvement: 129.66%)
  • dom0_varlibqubes_seq1m_q1t1_read 3:read_bandwidth_kb: 448300.00 🟢 ( previous job: 446202.00, improvement: 100.47%)
  • dom0_varlibqubes_seq1m_q1t1_write 3:write_bandwidth_kb: 198417.00 🔻 ( previous job: 201978.00, degradation: 98.24%)
  • dom0_varlibqubes_rnd4k_q1t1_read 3:read_bandwidth_kb: 8507.00 🟢 ( previous job: 8179.00, improvement: 104.01%)
  • dom0_varlibqubes_rnd4k_q1t1_write 3:write_bandwidth_kb: 5101.00 🟢 ( previous job: 4404.00, improvement: 115.83%)
  • fedora-44-xfce_root_seq1m_q8t1_read 3:read_bandwidth_kb: 405168.00
  • fedora-44-xfce_root_seq1m_q8t1_write 3:write_bandwidth_kb: 110889.00
  • fedora-44-xfce_root_seq1m_q1t1_read 3:read_bandwidth_kb: 308132.00
  • fedora-44-xfce_root_seq1m_q1t1_write 3:write_bandwidth_kb: 48231.00
  • fedora-44-xfce_root_rnd4k_q32t1_read 3:read_bandwidth_kb: 84300.00
  • fedora-44-xfce_root_rnd4k_q32t1_write 3:write_bandwidth_kb: 2964.00
  • fedora-44-xfce_root_rnd4k_q1t1_read 3:read_bandwidth_kb: 9235.00
  • fedora-44-xfce_root_rnd4k_q1t1_write 3:write_bandwidth_kb: 1130.00
  • fedora-44-xfce_private_seq1m_q8t1_read 3:read_bandwidth_kb: 413966.00
  • fedora-44-xfce_private_seq1m_q8t1_write 3:write_bandwidth_kb: 229850.00
  • fedora-44-xfce_private_seq1m_q1t1_read 3:read_bandwidth_kb: 335544.00
  • fedora-44-xfce_private_seq1m_q1t1_write 3:write_bandwidth_kb: 33222.00
  • fedora-44-xfce_private_rnd4k_q32t1_read 3:read_bandwidth_kb: 91117.00
  • fedora-44-xfce_private_rnd4k_q32t1_write 3:write_bandwidth_kb: 1782.00
  • fedora-44-xfce_private_rnd4k_q1t1_read 3:read_bandwidth_kb: 8068.00
  • fedora-44-xfce_private_rnd4k_q1t1_write 3:write_bandwidth_kb: 880.00
  • fedora-44-xfce_volatile_seq1m_q8t1_read 3:read_bandwidth_kb: 354968.00
  • fedora-44-xfce_volatile_seq1m_q8t1_write 3:write_bandwidth_kb: 100949.00
  • fedora-44-xfce_volatile_seq1m_q1t1_read 3:read_bandwidth_kb: 347210.00
  • fedora-44-xfce_volatile_seq1m_q1t1_write 3:write_bandwidth_kb: 68921.00
  • fedora-44-xfce_volatile_rnd4k_q32t1_read 3:read_bandwidth_kb: 79582.00
  • fedora-44-xfce_volatile_rnd4k_q32t1_write 3:write_bandwidth_kb: 2236.00
  • fedora-44-xfce_volatile_rnd4k_q1t1_read 3:read_bandwidth_kb: 7680.00
  • fedora-44-xfce_volatile_rnd4k_q1t1_write 3:write_bandwidth_kb: 882.00
  • debian-13-xfce_dom0-dispvm-api (mean:6.513): 78.16 🔻 ( previous job: 74.50, degradation: 104.92%)
  • debian-13-xfce_dom0-dispvm-preload-2-api (mean:3.132): 37.59 🟢 ( previous job: 37.79, improvement: 99.47%)
  • debian-13-xfce_dom0-dispvm-preload-2-delay-0-api (mean:3.004): 36.05 🔻 ( previous job: 34.29, degradation: 105.13%)
  • debian-13-xfce_dom0-dispvm-preload-2-delay-minus-1d2-api (mean:3.304): 39.65 🔻 ( previous job: 38.52, degradation: 102.94%)
  • debian-13-xfce_dom0-dispvm-preload-4-delay-0-api (mean:2.472): 29.66 🔻 ( previous job: 29.50, degradation: 100.54%)
  • debian-13-xfce_dom0-dispvm-preload-4-delay-minus-1d2-api (mean:2.537): 30.45 🔻 ( previous job: 28.74, degradation: 105.93%)
  • debian-13-xfce_dom0-dispvm-preload-2-gui-api (mean:4.857): 58.28 🔻 ( previous job: 53.65, degradation: 108.63%)
  • debian-13-xfce_dom0-dispvm-preload-6-gui-api (mean:3.429): 41.15 🟢 ( previous job: 41.47, improvement: 99.24%)
  • debian-13-xfce_dom0-vm-api (mean:0.029): 0.35 🟢 ( previous job: 0.62, improvement: 56.29%)
  • debian-13-xfce_dom0-vm-gui-api (mean:0.029): 0.35 🟢 ( previous job: 0.47, improvement: 74.62%)
  • fedora-44-xfce_dom0-dispvm-api (mean:8.476): 101.72
  • fedora-44-xfce_dom0-dispvm-gui-api (mean:10.157): 121.88
  • fedora-44-xfce_dom0-dispvm-preload-2-api (mean:3.885): 46.62
  • fedora-44-xfce_dom0-dispvm-preload-2-delay-0-api (mean:3.928): 47.13
  • fedora-44-xfce_dom0-dispvm-preload-2-delay-minus-1d2-api (mean:4.213): 50.55
  • fedora-44-xfce_dom0-dispvm-preload-4-api (mean:2.861): 34.33
  • fedora-44-xfce_dom0-dispvm-preload-4-delay-0-api (mean:2.87): 34.44
  • fedora-44-xfce_dom0-dispvm-preload-4-delay-minus-1d2-api (mean:3.034): 36.41
  • fedora-44-xfce_dom0-dispvm-preload-2-gui-api (mean:5.476): 65.71
  • fedora-44-xfce_dom0-dispvm-preload-4-gui-api (mean:4.305): 51.66
  • fedora-44-xfce_dom0-dispvm-preload-6-gui-api (mean:3.664): 43.97
  • fedora-44-xfce_dom0-vm-api (mean:0.029): 0.35
  • fedora-44-xfce_dom0-vm-gui-api (mean:0.035): 0.42
  • whonix-workstation-18_dom0-dispvm-preload-2-api (mean:4.415): 52.98 🔻 ( previous job: 48.39, degradation: 109.47%)
  • whonix-workstation-18_dom0-dispvm-preload-2-delay-minus-1d2-api (mean:5.246): 62.95 🔻 ( previous job: 59.22, degradation: 106.30%)
  • whonix-workstation-18_dom0-dispvm-preload-4-delay-0-api (mean:3.54): 42.48 🟢 ( previous job: 43.23, improvement: 98.27%)
  • whonix-workstation-18_dom0-dispvm-preload-2-gui-api (mean:6.372): 76.46 🔻 ( previous job: 72.05, degradation: 106.13%)
  • whonix-workstation-18_dom0-dispvm-preload-4-gui-api (mean:4.687): 56.25 🔻 ( previous job: 52.81, degradation: 106.50%)
  • whonix-workstation-18_dom0-dispvm-preload-6-gui-api (mean:4.167): 50.00 🟢 ( previous job: 50.72, improvement: 98.59%)
  • whonix-workstation-18_dom0-vm-api (mean:0.02): 0.24 🟢 ( previous job: 0.43, improvement: 55.43%)
  • whonix-workstation-18_dom0-vm-gui-api (mean:0.035): 0.42 🟢 ( previous job: 0.56, improvement: 75.54%)

@marmarek

marmarek commented Aug 4, 2026

Copy link
Copy Markdown
Member Author

openQArun TEST=system_tests_audio,system_tests_pvgrub_salt_storage,system_tests_network_updates MACHINE=64bit

Timing precision is not great in nested virt. This test usually fails
with error like "too short audio, expected 10s, got 7.768299319727891".
The test is already running also on real hardware, and there it's more
reliable, but keep running it on nested virt, as it's more flexible
scheduling-wise.
I missed one of the grub tests.

Fixes: 7448ed2 "tests: reduce maxmem of HVM when running in nested virt"
Retrying in a tight loop sometimes doesn't give enough time for change
to be noticed.
Do not expect all services running already while audiovm is still
starting. The test has 10s timeout (part of assert_pacat_running()), but
lets start counting once VM is fully started.
@marmarek
marmarek force-pushed the tests-dom0-vm-update branch from 6b51ee5 to cb85f10 Compare August 6, 2026 10:11
@marmarek
marmarek merged commit 2e5b555 into QubesOS:main Aug 7, 2026
4 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants