02-tests/task 01 Release 2017.01 - RC2

[A-Paul]

• bitarithm_timings success
• bloom_bytes success
• cpp11_condition_variable success
• cpp11_mutex success
• cpp11_thread success
• fault_handler success
• float success
• fmt_print success
• gnrc_ipv6_ext
• gnrc_sixlowpan
• gnrc_sock_ip success
• gnrc_sock_udp success
• irq success
• libfixmath success
• libfixmath_unittests success
• lwip_sock_ip success
• malloc success
• msg_send_receive success
• msg_try_receive success
• mutex_order success
• mutex_unlock_and_sleep success
• netstats_l2 success
• od failed see 02-tests/task 01 Release 2017.01 - RC2 #39 (comment)
• periph_cpuid success
• periph_hwrng success
• periph_timer success
• pipe success
• pkg_u8g2 success
• posix_semaphore success
• posix_sleep success
• pthread success
• pthread_barrier success
• pthread_cleanup success
• pthread_condition_variable success
• pthread_cooperation success
• pthread_rwlock success
• pthread_tls success
• sched_testing success
• sizeof_tcb success
• slip
• struct_tm_utility success
• thread_basic success
• thread_cooperation success
• thread_exit success
• thread_flags success
• thread_flood success
• thread_msg success
• thread_msg_avail success
• thread_msg_block_wo_queue success
• thread_msg_block_w_queue success
• thread_msg_seq success
• xtimer_drift failed see (tests: xtimer_drift gets stuck on native RIOT#6052)
• xtimer_hang success
• xtimer_longterm success
• xtimer_msg success
• xtimer_msg_receive_timeout success
• xtimer_now64_continuity success
• xtimer_periodic_wakeup success
• xtimer_remove success
• xtimer_reset success
• xtimer_usleep success

Part of the script to create the list:

find "$BASEDIR" -maxdepth 2 -mindepth 2 -type f \
    \( -name 'main.c' -or -name 'main.cpp' \) \
    -exec grep -Eq '@ingroup[[:blank:]]+\<test' {} \; \
    -print | sed 's#^\(.*\)/[^/]*$#\1#' | sort > "$LIST"

Create the markdown:

sed -e 's#^.*/\([^/]*\)$#- [ ] \1#' "$LIST"

[A-Paul]

tests/od fails.

aar680@mobi31:~/git/RIOT/tests/od$ make test
TERMFLAGS= tests/01-run.py
ATTENTION: This script is currently not suitable for non-native platforms
Timeout in expect script

Makefile:20: recipe for target 'test' failed
make: *** [test] Error 1

[cgundogan]

Behaves correctly on my side (?)

RIOT/tests/od % make clean all test
Building application "tests_od" for "native" with MCU "native".

"make" -C RIOT/boards/native
"make" -C RIOT/boards/native/drivers
"make" -C RIOT/core
"make" -C RIOT/cpu/native
"make" -C RIOT/cpu/native/periph
"make" -C RIOT/drivers
"make" -C RIOT/sys
"make" -C RIOT/sys/auto_init
"make" -C RIOT/sys/od
   text    data     bss     dec     hex filename
  30377     384   47684   78445   1326d RIOT/tests/od/bin/native/tests_od.elf
TERMFLAGS= tests/01-run.py
ATTENTION: This script is currently not suitable for non-native platforms
All tests successful

[cgundogan]

I was able to reproduce @A-Paul's error with BOARD!=native. But isn't the log saying

ATTENTION: This script is currently not suitable for non-native platforms

anyways?

[A-Paul]

How did you have a successful run on native and reproduce the error?
Pointless. I failed recognizing the "!" in

BOARD!=native

[miri64]

@A-Paul can you check with traceback activated?

diff --git a/tests/od/tests/01-run.py b/tests/od/tests/01-run.py
index 31e5c59..36f0896 100755
--- a/tests/od/tests/01-run.py
+++ b/tests/od/tests/01-run.py
@@ -284,4 +284,4 @@ def testfunc(child):
     print("All tests successful")
 
 if __name__ == "__main__":
-    sys.exit(testrunner.run(testfunc, timeout=1, echo=False))
+    sys.exit(testrunner.run(testfunc, timeout=1, echo=False, traceback=True))

[miri64]

(maybe even with "echo" activated?)

[A-Paul]

@miri64 I have things to do till afternoon. I'll check it later.
How do I activated those flags?

[A-Paul]

Here's a detail I forgot to publish. Compare the last line with the expected values.

aar680@mobi31:~/git/RIOT/tests/od$ make term | head
[...]
main(): This is RIOT! (Version: 2017.04-devel-10-g669a2-mobi31-2017.01-branch)
od(short_str, sizeof(short_str), OD_WIDTH_DEFAULT, 0)
000000000 037700041101

[miri64]

In the line I posted in the diff you can see how to do that (set them as parameters of the run function).

[miri64]

Seems like you got some garbage in there (the first 2 bytes are supposed to be 000000, not 037700). Curious only you get this :-/.

[PeterKietzmann]

I guess he's not.

make clean all test
Building application "tests_od" for "native" with MCU "native".
...

TERMFLAGS= tests/01-run.py
ATTENTION: This script is currently not suitable for non-native platforms
Timeout in expect script
  File "/home/kietzmann/Dokumente/RIOT_repo_devel/RIOT/dist/tools/testrunner/testrunner.py", line 27, in run
    testfunc(child)
  File "tests/01-run.py", line 21, in testfunc
    child.expect_exact(r'000000000 000000041101')
  File "/usr/local/lib/python3.4/dist-packages/pexpect/spawnbase.py", line 390, in expect_exact
    return exp.expect_loop(timeout)
  File "/usr/local/lib/python3.4/dist-packages/pexpect/expect.py", line 107, in expect_loop
    return self.timeout(e)
  File "/usr/local/lib/python3.4/dist-packages/pexpect/expect.py", line 70, in timeout
    raise TIMEOUT(msg)

make: *** [test] Fehler 1
kietzmann@kietzmann-Latitude-E6410:~/Dokumente/RIOT_repo_devel/RIOT/tests/od$ make term
/home/kietzmann/Dokumente/RIOT_repo_devel/RIOT/tests/od/bin/native/tests_od.elf  
RIOT native interrupts/signals initialized.
LED_RED_OFF
LED_GREEN_ON
RIOT native board initialized.
RIOT native hardware initialization complete.

main(): This is RIOT! (Version: 2017.04-devel-10-g669a2-kietzmann-Latitude-E6410-HEAD)
od(short_str, sizeof(short_str), OD_WIDTH_DEFAULT, 0)
000000000 037700041101

[PeterKietzmann]

Can this be dependant on the compiler version? I have a quite old gcc version 4.9.3.

[miri64]

Mine's 5.4.0. Working on a "fix" right now.

[miri64]

See RIOT-OS/RIOT#6529