Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

twister : retry failed parameter is not valid #46470

Closed
shaoanxli opened this issue Jun 13, 2022 · 0 comments
Closed

twister : retry failed parameter is not valid #46470

shaoanxli opened this issue Jun 13, 2022 · 0 comments
Labels
bug The issue is a bug, or the PR is fixing a bug

Comments

@shaoanxli
Copy link
Contributor

Describe the bug
The parameter "--retry-failed" in twister is not valid.

To Reproduce
Steps to reproduce the behavior:

  1. source zephyr-env.sh
  2. twister -p frdm_k64f --device-testing --hardware-map map.yml -T tests/kernel/mbox/mbox_api/ --retry-failed 2 -vv
  3. See error

Expected behavior
Have made a bug in this case , then the "--retry-failed" parameter should have taken effect , but it only run once.

Impact
Some occasional mistakes will show inappropriately.

Logs and console output

INFO    - Zephyr version: zephyr-v3.1.0-296-gd84989a71827
INFO    - JOBS: 8
DEBUG   - Reading test case configuration files under /home/shaoanli/zephyrproject/zephyr/tests/kernel/mbox/mbox_api...
DEBUG   - Found possible test case in /home/shaoanli/zephyrproject/zephyr/tests/kernel/mbox/mbox_api
DEBUG   - Reading platform configuration files under /home/shaoanli/zephyrproject/zephyr/boards...
DEBUG   - Reading platform configuration files under /home/shaoanli/zephyrproject/zephyr/scripts/pylib/twister/boards...
DEBUG   - Running cmake script /home/shaoanli/zephyrproject/zephyr/cmake/modules/verify-toolchain.cmake
DEBUG   - Calling cmake with arguments: ['-DFORMAT=json', '-P', PosixPath('/home/shaoanli/zephyrproject/zephyr/cmake/modules/verify-toolchain.cmake')]
DEBUG   - Finished running  /home/shaoanli/zephyrproject/zephyr/cmake/modules/verify-toolchain.cmake
INFO    - Using 'zephyr' toolchain.
DEBUG   - platform filter: ['frdm_k64f']
DEBUG   -     arch_filter: None
DEBUG   -      tag_filter: None
DEBUG   -     exclude_tag: None
INFO    - Building initial testsuite list...
DEBUG   - frdm_k64f                 tests/kernel/mbox/mbox_api/kernel.mailbox.api.linker_generator SKIPPED: Not in testsuite platform allow list
INFO    - Writing JSON report /home/shaoanli/zephyrproject/zephyr/twister-out/testplan.json
DEBUG   - Running cmake script /home/shaoanli/zephyrproject/zephyr/cmake/modules/verify-toolchain.cmake
DEBUG   - Calling cmake with arguments: ['-DFORMAT=json', '-P', PosixPath('/home/shaoanli/zephyrproject/zephyr/cmake/modules/verify-toolchain.cmake')]
DEBUG   - Finished running  /home/shaoanli/zephyrproject/zephyr/cmake/modules/verify-toolchain.cmake
INFO    - Using 'zephyr' toolchain.

Device testing on:

| Platform   | ID                       | Serial device   |
|------------|--------------------------|-----------------|
| frdm_k64f  | 0240020116B95E69EB47A3D1 | /dev/ttyACM0    |

INFO    - 2 test scenarios (2 configurations) selected, 1 configurations discarded due to filters.
INFO    - Adding tasks to the queue...
DEBUG   - adding frdm_k64f/tests/kernel/mbox/mbox_api/kernel.mailbox.api
INFO    - Added initial list of jobs to queue
DEBUG   - Launch process 0
DEBUG   - Launch process 1
DEBUG   - Launch process 2
DEBUG   - Launch process 3
DEBUG   - Launch process 4
DEBUG   - Running cmake on /home/shaoanli/zephyrproject/zephyr/tests/kernel/mbox/mbox_api for frdm_k64f
DEBUG   - Calling cmake with arguments: ['-B/home/shaoanli/zephyrproject/zephyr/twister-out/frdm_k64f/tests/kernel/mbox/mbox_api/kernel.mailbox.api', '-S/home/shaoanli/zephyrproject/zephyr/tests/kernel/mbox/mbox_api', '-DTC_RUNID=4212312ac38497e746f4f8820e9609be', '-DEXTRA_CFLAGS=-Werror', '-DEXTRA_AFLAGS=-Werror -Wa,--fatal-warnings', '-DEXTRA_LDFLAGS=-Wl,--fatal-warnings', '-DEXTRA_GEN_DEFINES_ARGS=--edtlib-Werror', '-GUnix Makefiles', '-DBOARD=frdm_k64f']
DEBUG   - Launch process 5
DEBUG   - Launch process 6
DEBUG   - Launch process 7
DEBUG   - Finished building /home/shaoanli/zephyrproject/zephyr/tests/kernel/mbox/mbox_api for frdm_k64f
DEBUG   - build test: frdm_k64f/tests/kernel/mbox/mbox_api/kernel.mailbox.api
DEBUG   - Building /home/shaoanli/zephyrproject/zephyr/tests/kernel/mbox/mbox_api for frdm_k64f
DEBUG   - run test: frdm_k64f/tests/kernel/mbox/mbox_api/kernel.mailbox.api
DEBUG   - Using serial device /dev/ttyACM0 @ 115200 baud
DEBUG   - Flash command: ['west', 'flash', '--skip-rebuild', '-d', '/home/shaoanli/zephyrproject/zephyr/twister-out/frdm_k64f/tests/kernel/mbox/mbox_api/kernel.mailbox.api', '--runner', 'pyocd', '--', '--board-id', '0240020116B95E69EB47A3D1']
DEBUG   - DEVICE: *** Booting Zephyr OS build zephyr-v3.1.0-296-gd84989a71827  ***
DEBUG   - DEVICE: Running TESTSUITE mbox_api
DEBUG   - DEVICE: ===================================================================
DEBUG   - DEVICE: START - test_mbox_kinit
DEBUG   - DEVICE: PASS - test_mbox_kinit in 0.1 seconds
DEBUG   - DEVICE: ===================================================================
DEBUG   - DEVICE: START - test_mbox_kdefine
DEBUG   - DEVICE: PASS - test_mbox_kdefine in 0.1 seconds
DEBUG   - DEVICE: ===================================================================
DEBUG   - DEVICE: START - test_enhance_capability
DEBUG   - DEVICE: E: ***** BUS FAULT *****
DEBUG   - DEVICE: E:   Imprecise data bus error
DEBUG   - DEVICE: E: r0/a1:  0x20000868  r1/a2:  0x20000a68  r2/a3:  0x000000ff
DEBUG   - DEVICE: E: r3/a4:  0x00000000 r12/ip:  0x20003140 r14/lr:  0x00004b49
DEBUG   - DEVICE: E:  xpsr:  0x21000000
DEBUG   - DEVICE: E: Faulting instruction address (r15/pc): 0x00005054
DEBUG   - DEVICE: E: >>> ZEPHYR FATAL ERROR 0: CPU exception on CPU 0
DEBUG   - DEVICE: E: Current thread: 0x20000868 (test_enhance_capability)
DEBUG   - DEVICE: E: Halting system
DEBUG   - -- west flash: using runner pyocd
-- runners.pyocd: Flashing file: /home/shaoanli/zephyrproject/zephyr/twister-out/frdm_k64f/tests/kernel/mbox/mbox_api/kernel.mailbox.api/zephyr/zephyr.bin
[---|---|---|---|---|---|---|---|---|----]
[========================================]

DEBUG   - Timed out while monitoring serial output on frdm_k64f
DEBUG   - run status: frdm_k64f/tests/kernel/mbox/mbox_api/kernel.mailbox.api error
INFO    - 2/2 frdm_k64f                 tests/kernel/mbox/mbox_api/kernel.mailbox.api      FAILED No Console Output(Timeout) (device 62.884s)
ERROR   - see: /home/shaoanli/zephyrproject/zephyr/twister-out/frdm_k64f/tests/kernel/mbox/mbox_api/kernel.mailbox.api/handler.log

INFO    - 2 Iteration:
INFO    - Adding tasks to the queue...
INFO    - Added initial list of jobs to queue
DEBUG   - Launch process 0
DEBUG   - Launch process 1
DEBUG   - Launch process 2
DEBUG   - Launch process 3
DEBUG   - Launch process 4
DEBUG   - Launch process 5
DEBUG   - Launch process 6
DEBUG   - Launch process 7

DEBUG   - --------------------------------
DEBUG   - Total Test suites: 2
DEBUG   - Total Test cases: 38
DEBUG   - Skipped test cases: 0
DEBUG   - Completed Testsuites: 2
DEBUG   - Passing Testsuites: 0
DEBUG   - Failing Testsuites: 1
DEBUG   - Skipped Testsuites: 1
DEBUG   - Skipped Testsuites (runtime): 0
DEBUG   - Skipped Testsuites (filter): 1
DEBUG   - Errors: 1
DEBUG   - --------------------------------
INFO    - 0 of 2 test configurations passed (0.00%), 2 failed, 1 skipped with 0 warnings in 129.84 seconds
INFO    - In total 38 test cases were executed, 0 skipped on 1 out of total 461 platforms (0.22%)
INFO    - 1 test configurations executed on platforms, 0 test configurations were only built.

Hardware distribution summary:

| Board     | ID                       |   Counter |
|-----------|--------------------------|-----------|
| frdm_k64f | 0240020116B95E69EB47A3D1 |         1 |
INFO    - Saving reports...
INFO    - Writing JSON report /home/shaoanli/zephyrproject/zephyr/twister-out/twister.json
DEBUG   - Running cmake script /home/shaoanli/zephyrproject/zephyr/cmake/modules/verify-toolchain.cmake
DEBUG   - Calling cmake with arguments: ['-DFORMAT=json', '-P', PosixPath('/home/shaoanli/zephyrproject/zephyr/cmake/modules/verify-toolchain.cmake')]
DEBUG   - Finished running  /home/shaoanli/zephyrproject/zephyr/cmake/modules/verify-toolchain.cmake
INFO    - Using 'zephyr' toolchain.
INFO    - Writing xunit report /home/shaoanli/zephyrproject/zephyr/twister-out/twister.xml...
INFO    - Writing xunit report /home/shaoanli/zephyrproject/zephyr/twister-out/twister_report.xml...
INFO    - Run completed

Environment :
OS: Linux,
Toolchain Zephyr SDK 0.14.1
Commit SHA or Version: d84989a

@shaoanxli shaoanxli added the bug The issue is a bug, or the PR is fixing a bug label Jun 13, 2022
@shaoanxli shaoanxli changed the title frdm_k64f: twister : retry failed parameter is not valid twister : retry failed parameter is not valid Jun 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug The issue is a bug, or the PR is fixing a bug
Projects
None yet
Development

No branches or pull requests

1 participant