ACRN: some cases still failed because of the log missing

[Zhaoningx]

Background
I have reported a bug #44347 for the ACRN log missing, and it is suggested to use the option --disable-suite-name-check. After the twister reporting overhaul, the problem has been exposed again.

Describe the bug
After the twister reporting overhaul, some cases still failed on ACRN because of the log missing.
the details:
run test case tests/kernel/threads/thread_apis/:

ningzhax@zephyrtest-blue:~/zephyrproject/zephyr$ twister -p acrn_ehl_crb --device-testing -T tests/kernel/threads/thread_apis/  --device-serial-pty="/opt/remotehw/acrn-test-pty.exp,ehlsku11" --west-flash="/opt/remotehw/remotehw-x86-acrn.sh,ehlsku11" -v --no-skipped-report --disable-suite-name-check
Renaming output directory to /home/ningzhax/zephyrproject/zephyr/twister-out.5
INFO    - Zephyr version: v3.1.0-rc3-6-g5a7b0fb616dc
INFO    - JOBS: 8
INFO    - Using 'zephyr' toolchain.
INFO    - Building initial testsuite list...
INFO    - Writing JSON report /home/ningzhax/zephyrproject/zephyr/twister-out/testplan.json
INFO    - Using 'zephyr' toolchain.

Device testing on:

| Platform     | ID   | Serial device   |
|--------------|------|-----------------|
| acrn_ehl_crb |      |                 |

INFO    - 2 test scenarios (2 configurations) selected, 0 configurations discarded due to filters.
INFO    - Adding tasks to the queue...
INFO    - Added initial list of jobs to queue
INFO    - 1/2 acrn_ehl_crb              tests/kernel/threads/thread_apis/kernel.threads.apis.pinonly PASSED (device 69.128s)
INFO    - 2/2 acrn_ehl_crb              tests/kernel/threads/thread_apis/kernel.threads.apis PASSED (device 69.119s)

INFO    - 2 of 2 test configurations passed (100.00%), 0 failed, 0 skipped with 0 warnings in 162.38 seconds
INFO    - In total 82 test cases were executed, 0 skipped on 1 out of total 456 platforms (0.22%)
INFO    - 2 test configurations executed on platforms, 0 test configurations were only built.

Hardware distribution summary:

| Board        | ID   |   Counter |
|--------------|------|-----------|
| acrn_ehl_crb |      |         2 |
INFO    - Saving reports...
INFO    - Writing JSON report /home/ningzhax/zephyrproject/zephyr/twister-out/twister.json
INFO    - Using 'zephyr' toolchain.
INFO    - Writing xunit report /home/ningzhax/zephyrproject/zephyr/twister-out/twister.xml...
INFO    - Writing xunit report /home/ningzhax/zephyrproject/zephyr/twister-out/twister_report.xml...
INFO    - Run completed

the handler.log:

ACRN:\>vm_console 0^M
----- Entering VM 0 Shell -----^M
: 0^M
PASS - test_k_thread_foreach in 0.2 seconds^M
===================================================================^M
START - test_k_thread_foreach_unlocked^M
TEST_UNLOCKED: Newly added thread found^M
TEST_UNLOCKED: tid: 0x1207a0, prio: 0^M
TEST_UNLOCKED: Newly added thread in callback found^M
TEST_UNLOCKED: tid: 0x120f60, prio: 0^M
TEST_UNLOCKED: Newly added thread found^M
TEST_UNLOCKED: tid: 0x1207a0, prio: 0^M
PASS - test_k_thread_foreach_unlocked in 0.4 seconds^M
===================================================================^M
START - test_k_thread_foreach_null_cb^M
ASSERTION FAIL [user_cb != ((void *)0)] @ WEST_TOPDIR/zephyr/kernel/thread.c:51^M
user_cb can not be NULL^M
E: RAX: 0x0000000000000004 RBX: 0x000000000011e398 RCX: 0x0000000000000001 RDX: 0x000000000011ae08^M
E: RSI: 0x0000000000000033 RDI: 0x000000000011ad4b RBP: 0x0000000000178fb0 RSP: 0x0000000000178f88^M
E:  R8: 0x0000000000000001  R9: 0x0000000000178d00 R10: 0x00000000ffffffff R11: 0x0000000000000035^M
E: R12: 0x0000000000000000 R13: 0x00000000001193d8 R14: 0x0000000000000200 R15: 0x0000000000000000^M
E: RSP: 0x0000000000178f88 RFLAGS: 0x0000000000000246 CS: 0x0018 CR3: 0x0000000000188000^M
E: RIP: 0x0000000000106150^M
E: >>> ZEPHYR FATAL ERROR 4: Kernel panic on CPU 0^M
E: Current thread: 0x1225a0 (test_k_thread_foreach_null_cb)^M
PASS - test_k_thread_foreach_null_cb in 0.7 seconds^M
===================================================================^M
START - test_k_thread_foreach_unlocked_null_cb^M
ASSERTION FAIL [user_cb != ((void *)0)] @ WEST_TOPDIR/zephyr/kernel/thread.c:79^M
user_cb can not be NULL^M
E: RAX: 0x0000000000000004 RBX: 0x000000000011e3c0 RCX: 0x0000000000000001 RDX: 0x000000000011ae08^M
E: RSI: 0x000000000000004f RDI: 0x000000000011ad4b RBP: 0x0000000000178fb0 RSP: 0x0000000000178f78^M
E:  R8: 0x0000000000000001  R9: 0x0000000000178d00 R10: 0x00000000ffffffff R11: 0x0000000000000037^M
E: R12: 0x00000000001225a0 R13: 0x0000000000000000 R14: 0x000000000011944f R15: 0x0000000000000000^M
E: RSP: 0x0000000000178f78 RFLAGS: 0x0000000000000246 CS: 0x0018 CR3: 0x0000000000188000^M
E: RIP: 0x0000000000106150^M
...(and so on)

in twister_report.xml:

<testsuites><testsuite errors="0" failures="44" name="acrn_ehl_crb" skipped="0" tests="82" time="138.25" timestamp="2022-05-31T23:38:05.353860">

We can see that the case tests/kernel/threads/thread_apis can be run on ACRN, but there are 44 failure Unknow errors in the twister_report.xml file. They are all caused by the missing log.

To Reproduce
twister -p acrn_ehl_crb --device-testing -T tests/kernel/threads/thread_apis/ --device-serial-pty="/opt/remotehw/acrn-test-pty.exp,ehlsku11" --west-flash="/opt/remotehw/remotehw-x86-acrn.sh,ehlsku11" -v --no-skipped-report --disable-suite-name-check

Environment (please complete the following information):

• zephyr SDK: 14.1
• Commit: 5a7b0fb

[nashif]

per comment in #46189 this is resolved.