[reactor_set_interrupt] Timeout after reactor_set_interrupt_mode

[mmkayPL]

CI Intermittent Failure

Link to the failed CI build

https://ci.spdk.io/public_build/autotest-per-patch_83835.html
https://ci.spdk.io/results/autotest-per-patch/builds/83835/archive/ubuntu18-vg-autotest/build.log

Execution failed at

00:05:32.980 11:19:15 -- interrupt/interrupt_common.sh@44 -- # cpu_rate=0.0
00:05:32.980 11:19:15 -- interrupt/interrupt_common.sh@45 -- # cpu_rate=0
00:05:32.980 11:19:15 -- interrupt/interrupt_common.sh@47 -- # [[ idle = \b\u\s\y ]]
00:05:32.980 11:19:15 -- interrupt/interrupt_common.sh@49 -- # [[ idle = \i\d\l\e ]]
00:05:32.980 11:19:15 -- interrupt/interrupt_common.sh@49 -- # [[ 0 -gt 30 ]]
00:05:32.980 11:19:15 -- interrupt/interrupt_common.sh@52 -- # return 0
00:05:32.980 11:19:15 -- interrupt/reactor_set_interrupt.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py --plugin interrupt_plugin reactor_set_interrupt_mode 0
00:05:33.239 [2022-08-26 11:19:15.514651] interrupt_tgt.c: 62:rpc_reactor_set_interrupt_mode: NOTICE: RPC Start to enable interrupt mode on reactor 0.
00:05:33.239 [2022-08-26 11:19:15.518471] thread.c:1906:spdk_thread_set_interrupt_mode: NOTICE: Set spdk_thread (app_thread) to intr mode from poll mode.
00:05:33.239 [2022-08-26 11:19:15.518533] interrupt_tgt.c: 32:rpc_reactor_set_interrupt_mode_cb: NOTICE: complete reactor switch
00:06:40.972 Timeout while waiting for response:
00:06:40.972
00:06:40.972
00:06:40.972 11:20:15 -- interrupt/reactor_set_interrupt.sh@59 -- # trap - ERR
00:06:40.972 11:20:15 -- interrupt/reactor_set_interrupt.sh@59 -- # print_backtrace
00:06:40.972 11:20:15 -- common/autotest_common.sh@1038 -- # [[ ehxBET =~ e ]]
00:06:40.972 11:20:15 -- common/autotest_common.sh@1040 -- # args=("${BASH_ARGV[@]}")
00:06:40.972 11:20:15 -- common/autotest_common.sh@1040 -- # local args
00:06:40.972 11:20:15 -- common/autotest_common.sh@1042 -- # xtrace_disable
00:06:40.972 11:20:15 -- common/autotest_common.sh@14 -- # '[' no '!=' yes ']'
00:06:40.972 11:20:15 -- common/autotest_common.sh@15 -- # PREV_BASH_OPTS=ehxBET
00:06:40.972 11:20:15 -- common/autotest_common.sh@16 -- # [[ ehxBET == \x ]]
00:06:40.972 11:20:15 -- common/autotest_common.sh@17 -- # XTRACE_DISABLED=yes
00:06:40.972 11:20:15 -- common/autotest_common.sh@19 -- # set +x
00:06:40.972 ========== Backtrace start: ==========
00:06:40.972
00:06:40.972 in test/interrupt/reactor_set_interrupt.sh:59 -> reactor_set_intr_mode(["19350"])
00:06:40.972 ...
00:06:40.972 54 fi
00:06:40.972 55 # CPU utilization of reactor 2 should be idle
00:06:40.972 56 reactor_is_idle $spdk_pid 2
00:06:40.972 57
00:06:40.972 58 # Set reactor 0 back to intr mode
00:06:40.972 => 59 $rpc_py --plugin interrupt_plugin reactor_set_interrupt_mode 0
00:06:40.972 60 if [ "$without_thd"x != x ]; then
00:06:40.972 61 # Schedule spdk_threads in thd2_ids back to reactor 0
00:06:40.972 62 for i in ${thd0_ids[*]}; do
00:06:40.972 63 $rpc_py thread_set_cpumask -i $i -m $r0_mask
00:06:40.972 64 done
00:06:40.972 ...
00:06:40.972 in test/interrupt/reactor_set_interrupt.sh:78 -> reactor_set_mode_with_threads(["19350"])
00:06:40.972 ...
00:06:40.972 73 reactor_set_intr_mode $1 "without_thd"
00:06:40.972 74 return 0
00:06:40.972 75 }
00:06:40.972 76
00:06:40.972 77 function reactor_set_mode_with_threads() {
00:06:40.972 => 78 reactor_set_intr_mode $1
00:06:40.972 79 return 0
00:06:40.972 80 }
00:06:40.972 81
00:06:40.972 82 # Set reactors with intr_tgt without spdk_thread
00:06:40.972 83 start_intr_tgt

[spdkci]

Another instance of this failure. Reported by @mmkayPL. log: https://ci.spdk.io/public_build/autotest-per-patch_83835.html

[Comphix]

Xiaodong, please take a look at this issue. Thanks.

[spdkci]

Another instance of this failure. Reported by @yidong0635. log: https://ci.spdk.io/public_build/autotest-per-patch_84300.html

[spdkci]

Another instance of this failure. Reported by @tomzawadzki. log: https://ci.spdk.io/public_build/autotest-per-patch_86896.html

[spdkci]

Another instance of this failure. Reported by @mikeBashStuff. log: https://ci.spdk.io/public_build/autotest-per-patch_87418.html

[spdkci]

Another instance of this failure. Reported by @mikeBashStuff. log: https://ci.spdk.io/public_build/autotest-per-patch_87539.html

[spdkci]

Another instance of this failure. Reported by @sberbz. log: https://ci.spdk.io/public_build/autotest-per-patch_90458.html

[spdkci]

Another instance of this failure. Reported by @ksztyber. log: https://ci.spdk.io/public_build/autotest-per-patch_92160.html

[KKaras169169]

@dong-liuliu any update on this issue? No reports were made for past two months, maybe we could close this one?

[Comphix]

Looks like we could close this one as it does not report in past two months.

[mikeBashStuff]

#3234 (comment)

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-nightly-lts_1650.html

[spdkci]

Another instance of this failure. Reported by @apaszkie. log: https://ci.spdk.io/public_build/autotest-per-patch_119705.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-nightly_3572.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-spdk-v24.01-LTS-vs-dpdk-v22.11_393.html