[fio_dif_rand_params] timed out while waiting for icresp

[ksztyber]

Looks like the initiator didn't receive icresp:

00:15:00.363   09:33:30	-- common/autotest_common.sh@1324 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61
00:15:00.363  filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16
00:15:00.363  ...
00:15:00.363  filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16
00:15:00.363  ...
00:15:00.363  filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16
00:15:00.363  ...
00:15:00.363  fio-3.28
00:15:00.363  Starting 24 threads
00:15:00.620  TELEMETRY: No legacy callbacks, legacy socket not created
00:15:00.974  [2023-06-23 09:33:31.082885] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another.
00:15:00.974  [2023-06-23 09:33:31.083073] rpc.c:  42:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock
00:15:15.852  [2023-06-23 09:33:43.588143] nvme_tcp.c:1997:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to construct the tqpair=0x1c31080 via correct icresp
00:15:15.852  [2023-06-23 09:33:43.588324] nvme_tcp.c:1808:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1c31080
00:15:15.852  [2023-06-23 09:33:43.588431] nvme_qpair.c: 797:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 5
00:15:15.852  fio: io_u error on file Nvme2n1: Input/output error: read offset=15101952, buflen=4096
00:15:15.852  fio: io_u error on file Nvme2n1: Input/output error: read offset=37466112, buflen=4096
00:15:15.852  fio: io_u error on file Nvme2n1: Input/output error: read offset=25821184, buflen=4096
00:15:15.852  fio: io_u error on file Nvme2n1: Input/output error: read offset=43319296, buflen=4096
00:15:15.852  fio: io_u error on file Nvme2n1: Input/output error: read offset=46706688, buflen=4096
00:15:15.852  fio: io_u error on file Nvme2n1: Input/output error: read offset=8212480, buflen=4096
00:15:15.852  fio: io_u error on file Nvme2n1: Input/output error: read offset=7217152, buflen=4096
00:15:15.852  fio: io_u error on file Nvme2n1: Input/output error: read offset=37064704, buflen=4096
...

Link to the failed CI build

https://ci.spdk.io/results/autotest-per-patch/builds/106224/archive/nvmf-tcp-uring-vg-autotest/build.log
https://ci.spdk.io/public_build/autotest-per-patch_106224.html

[spdkci]

Another instance of this failure. Reported by @ksztyber. log: https://ci.spdk.io/public_build/autotest-per-patch_106224.html

[spdkci]

Another instance of this failure. Reported by @ksztyber. log: https://ci.spdk.io/public_build/autotest-per-patch_106071.html

[spdkci]

Another instance of this failure. Reported by @ksztyber. log: https://ci.spdk.io/public_build/autotest-per-patch_106496.html

[spdkci]

Another instance of this failure. Reported by @ksztyber. log: https://ci.spdk.io/public_build/autotest-per-patch_106951.html

[spdkci]

Another instance of this failure. Reported by @sberbz. log: https://ci.spdk.io/public_build/autotest-per-patch_107464.html

[spdkci]

Another instance of this failure. Reported by @ksztyber. log: https://ci.spdk.io/public_build/autotest-per-patch_107878.html

[spdkci]

Another instance of this failure. Reported by @sberbz. log: https://ci.spdk.io/public_build/autotest-per-patch_108071.html

[spdkci]

Another instance of this failure. Reported by @richael02. log: https://ci.spdk.io/public_build/autotest-per-patch_108044.html

[spdkci]

Another instance of this failure. Reported by @mikeBashStuff. log: https://ci.spdk.io/public_build/autotest-per-patch_108936.html

[spdkci]

Another instance of this failure. Reported by @apaszkie. log: https://ci.spdk.io/public_build/autotest-per-patch_109193.html

[spdkci]

Another instance of this failure. Reported by @KKaras169169. log: https://ci.spdk.io/public_build/autotest-per-patch_109398.html

[spdkci]

Another instance of this failure. Reported by @apaszkie. log: https://ci.spdk.io/public_build/autotest-per-patch_109582.html

[spdkci]

Another instance of this failure. Reported by @jimharris. log: https://ci.spdk.io/public_build/autotest-per-patch_109650.html

[spdkci]

Another instance of this failure. Reported by @mmkayPL. log: https://ci.spdk.io/public_build/autotest-per-patch_109976.html

[spdkci]

Another instance of this failure. Reported by @tomzawadzki. log: https://ci.spdk.io/public_build/autotest-per-patch_110195.html

[spdkci]

Another instance of this failure. Reported by @apaszkie. log: https://ci.spdk.io/public_build/autotest-per-patch_110702.html

[spdkci]

Another instance of this failure. Reported by @ksztyber. log: https://ci.spdk.io/public_build/autotest-per-patch_111644.html

[spdkci]

Another instance of this failure. Reported by @apaszkie. log: https://ci.spdk.io/public_build/autotest-per-patch_112179.html

[spdkci]

Another instance of this failure. Reported by @Haoqian-He. log: https://ci.spdk.io/public_build/autotest-per-patch_112596.html

[spdkci]

Another instance of this failure. Reported by @jimharris. log: https://ci.spdk.io/public_build/autotest-per-patch_112615.html

[spdkci]

Another instance of this failure. Reported by @tomzawadzki. log: https://ci.spdk.io/public_build/autotest-per-patch_112705.html

[spdkci]

Another instance of this failure. Reported by @apaszkie. log: https://ci.spdk.io/public_build/autotest-per-patch_113422.html

[spdkci]

Another instance of this failure. Reported by @sberbz. log: https://ci.spdk.io/public_build/autotest-per-patch_113537.html

[spdkci]

Another instance of this failure. Reported by @mikeBashStuff. log: https://ci.spdk.io/public_build/autotest-per-patch_114505.html

[spdkci]

Another instance of this failure. Reported by @ksprzacz. log: https://ci.spdk.io/public_build/autotest-per-patch_114709.html

[spdkci]

Another instance of this failure. Reported by @mikeBashStuff. log: https://ci.spdk.io/public_build/autotest-per-patch_114741.html

[spdkci]

Another instance of this failure. Reported by @KKaras169169. log: https://ci.spdk.io/public_build/autotest-per-patch_115131.html

[spdkci]

Another instance of this failure. Reported by @mikeBashStuff. log: Not Found

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-spdk-v24.01-LTS-vs-dpdk-v22.11_235.html

[spdkci]

Another instance of this failure. Reported by @sberbz. log: https://ci.spdk.io/public_build/autotest-per-patch_119478.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-spdk-master-vs-dpdk-v22.11_1650.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-spdk-master-vs-dpdk-v23.11_266.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-nightly_3549.html

[spdkci]

Another instance of this failure. Reported by @apaszkie. log: https://ci.spdk.io/public_build/autotest-per-patch_119648.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-spdk-v24.01-LTS-vs-dpdk-v22.11_270.html

[spdkci]

Another instance of this failure. Reported by @shuhei-matsumoto. log: https://ci.spdk.io/public_build/autotest-per-patch_119655.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-nightly-lts_1688.html

[spdkci]

Another instance of this failure. Reported by @shuhei-matsumoto. log: https://ci.spdk.io/public_build/autotest-per-patch_119894.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-spdk-master-vs-dpdk-main_3349.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-nightly-lts_1704.html

[spdkci]

Another instance of this failure. Reported by @shuhei-matsumoto. log: https://ci.spdk.io/public_build/autotest-per-patch_120228.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-nightly_3586.html

[spdkci]

Another instance of this failure. Reported by @sberbz. log: https://ci.spdk.io/public_build/autotest-per-patch_120347.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-spdk-master-vs-dpdk-v23.11_314.html

[spdkci]

Another instance of this failure. Reported by @ksztyber. log: https://ci.spdk.io/public_build/autotest-per-patch_120534.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-nightly-lts_1727.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-spdk-v24.01-LTS-vs-dpdk-v23.11_324.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-spdk-v24.01-LTS-vs-dpdk-v22.11_328.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-spdk-master-vs-dpdk-main_3382.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-spdk-master-vs-dpdk-v23.11_331.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-nightly_3618.html

[spdkci]

Another instance of this failure. Reported by @ksztyber. log: https://ci.spdk.io/public_build/autotest-per-patch_120919.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-spdk-v24.01-LTS-vs-dpdk-v22.11_348.html

[spdkci]

Another instance of this failure. Reported by @mikeBashStuff. log: https://ci.spdk.io/public_build/autotest-per-patch_121340.html

[spdkci]

Another instance of this failure. Reported by @DamiaSan. log: https://ci.spdk.io/public_build/autotest-per-patch_121474.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-spdk-v24.01-LTS-vs-dpdk-v22.11_368.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-spdk-v24.01-LTS-vs-dpdk-v23.11_370.html

[spdkci]

Another instance of this failure. Reported by @spdkci / Known Issue Detector. log: https://ci.spdk.io/public_build/autotest-spdk-master-vs-dpdk-v23.11_375.html