Release 2019.07 - RC1 #128

MrKevinWeiss · 2019-07-08T12:36:31Z

This issue lists the status of all tests for the Release Candidate 1 of the 2019.07 release.

Specs tested:

01-ci (@cladmi docker, llvm)
- Task #01 - Compile test
- Task #02 - Unittests on native
- Task #03 - Unittests on native separated
- Task #04 - Unittests on iotlab-m3(FAILED)(fixed 2019.07-branch)
02-tests (@cladmi @MrKevinWeiss)
03-single-hop-ipv6-icmp (@MrKevinWeiss)
04-single-hop-6lowpan-icmp (@MrKevinWeiss)
05-single-hop-route (@MrKevinWeiss)
06-single-hop-udp (@leandrolanzieri)
- Task #01 - UDP on iotlab-m3 [Packet Loss: 0.2%]
- Task #02 - UDP on iotlab-m3 (UDP port compression) [Packet Loss: 0%]
- Task #03 - UDP on native (non-existent neighbor)
- Task #04 - UDP on iotlab-m3 (non-existent neighbor)
- Task #05 - Empty UDP on native [Packet Loss: 0%]
- Task #06 - Empty UDP on iotlab-m3 [Packet Loss: 0%]
07-multi-hop (@MrKevinWeiss)
08-interop
09-coap (@leandrolanzieri)
10-icmpv6-error (@MrKevinWeiss)
11-lorawan (@jia200x)
- Task #01 - LoRaWAN example (FAILED)
- Task #02 - OTAA join procedure
- Task #03 - ABP join procedure (FAILED)
- Task #04 - LoRaWAN device parameters persistence (FAILED)
99-compile-and-test-one-board
- Task #01 - Run tests on different hardwares

MrKevinWeiss · 2019-07-08T12:44:47Z

As tested just before the RC1 @cladmi found the following issues on the board

Board Test Results

#### arduino-mega2560/failuresummary.md

Failures during test:
- [tests/bitarithm_timings](tests/bitarithm_timings/test.failed)
- [tests/event_wait_timeout](tests/event_wait_timeout/test.failed)
- [tests/evtimer_msg](tests/evtimer_msg/test.failed)
- [tests/isr_yield_higher](tests/isr_yield_higher/test.failed)
- [tests/libfixmath](tests/libfixmath/test.failed)
- [tests/periph_gpio](tests/periph_gpio/test.failed)
- [tests/pipe](tests/pipe/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/pkg_jsmn](tests/pkg_jsmn/test.failed)
- [tests/pkg_libb2](tests/pkg_libb2/test.failed)
- [tests/pkg_lora-serialization](tests/pkg_lora-serialization/test.failed)
- [tests/pkg_micro-ecc](tests/pkg_micro-ecc/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)
- [tests/trickle](tests/trickle/test.failed)

#### cc2650-launchpad/failuresummary.md

Failures during test:
- [tests/driver_grove_ledbar](tests/driver_grove_ledbar/test.failed)
- [tests/driver_my9221](tests/driver_my9221/test.failed)
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/periph_timer](tests/periph_timer/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)

#### frdm-k64f/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/periph_timer](tests/periph_timer/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)

#### frdm-kw41z/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)
- [tests/thread_flags](tests/thread_flags/test.failed)
- [tests/xtimer_periodic_wakeup](tests/xtimer_periodic_wakeup/test.failed)
- [tests/xtimer_usleep](tests/xtimer_usleep/test.failed)

#### msba2/failuresummary.md

Failures during test:
- [tests/driver_grove_ledbar](tests/driver_grove_ledbar/test.failed)
- [tests/driver_my9221](tests/driver_my9221/test.failed)
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sixlowpan](tests/gnrc_sixlowpan/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/libfixmath](tests/libfixmath/test.failed)
- [tests/libfixmath_unittests](tests/libfixmath_unittests/test.failed)
- [tests/lwip_sock_tcp](tests/lwip_sock_tcp/test.failed)
- [tests/periph_rtc](tests/periph_rtc/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/pkg_libcose](tests/pkg_libcose/test.failed)
- [tests/pkg_qdsa](tests/pkg_qdsa/test.failed)
- [tests/pkg_relic](tests/pkg_relic/test.failed)
- [tests/pkg_tweetnacl](tests/pkg_tweetnacl/test.failed)
- [tests/pthread_tls](tests/pthread_tls/test.failed)
- [tests/xtimer_periodic_wakeup](tests/xtimer_periodic_wakeup/test.failed)

#### mulle/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/periph_timer](tests/periph_timer/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/pkg_littlefs](tests/pkg_littlefs/test.failed)
- [tests/pkg_spiffs](tests/pkg_spiffs/test.failed)
- [tests/shell](tests/shell/test.failed)

#### nrf52dk/failuresummary.md

Failures during compilation:
- [tests/mcuboot](tests/mcuboot/compilation.failed)

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/pthread_rwlock](tests/pthread_rwlock/test.failed)

#### nucleo-f103rb/failuresummary.md

Failures during test:
- [tests/driver_grove_ledbar](tests/driver_grove_ledbar/test.failed)
- [tests/driver_hd44780](tests/driver_hd44780/test.failed)
- [tests/driver_my9221](tests/driver_my9221/test.failed)
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/xtimer_periodic_wakeup](tests/xtimer_periodic_wakeup/test.failed)
- [tests/xtimer_usleep_short](tests/xtimer_usleep_short/test.failed)

#### pba-d-01-kw2x/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)

#### sltb001a/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)
- [tests/xtimer_periodic_wakeup](tests/xtimer_periodic_wakeup/test.failed)

#### stm32f3discovery/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)

fjmolinas · 2019-07-08T13:27:44Z

For boards failing with tests/ps_schedstatistics fix can come from:

core/schedstatistics: fix call to uninitialized xtimer RIOT#11781
doc: XTIMER_BACKOFF inconsistency RIOT#11522 is also part of the case for boards that have XTIMER_HZ!=1Mhz

For:

- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)

I think they fail because they need to be run with sudo (because of ethos). @kaspar030 has done some work with the CI to enable running ethos without sudo (RIOT-OS/RIOT#11816 is one of the PR's), we needed and have been using this to tests RIOT-OS/RIOT#11818.

MrKevinWeiss · 2019-07-08T13:50:04Z

Compared to the last RC1 no knew bugs seem to be introduced.

cladmi · 2019-07-08T15:17:42Z

For:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
I think they fail because they need to be run with sudo (because of ethos). @kaspar030 has done some work with the CI to enable running ethos without sudo (RIOT-OS/RIOT#11816 is one of the PR's), we needed and have been using this to tests RIOT-OS/RIOT#11818.

Indeed. The test are the result of running make flash test without root or manual setup as currently done in CI. As TEST_ON_CI_WHITELIST += all is not set for these tests there is no failure in murdock.

I do not consider TEST_ON_CI_WHITELIST as I want to see what does not currently work through make test alone. So it includes the current state of the tests automation even if tests could succeed when run differently.

It is stupid automated testing :)

The test were run using master cb57c6ff1 with some other required commits to run on my setup with multiple boards connected and no local toolchain.
But these should not affect testing as they only modify flash/reset.

I checked the output and I also had other issues on my test machine:

python3-scapy from debian-stretch (0.20) and ubuntu-bionic (0.23) do not have scapy.all.raw so needed to install pip version 2.40. It is the same as provided in debian-buster or ubuntu-cosmic.

Despite being installed, tcpdump and bridge were not in regular users PATH. So I added symlinks. It may come up later when tests must be run without sudo.

The test result should not change but the output should.

cladmi · 2019-07-08T17:04:43Z

I will run the task 01-ci -- Task #01 - Compile test with BUILD_IN_DOCKER=1 and also with TOOLCHAIN=llvm.

sudo docker images
REPOSITORY          TAG                 IMAGE ID            CREATED             SIZE
riot/riotbuild      latest              bc9d9f175587        7 months ago        3.58GB

sudo docker pull riot/riotbuild:latest
latest: Pulling from riot/riotbuild
Digest: sha256:5218a0692039934276c98c44b70bbb1cc8bc31a7f171670e625cecd2e3f0fc24
Status: Image is up to date for riot/riotbuild:latest

I can also run the automated test suite on different boards as I already did.

MrKevinWeiss · 2019-07-09T06:53:57Z

@kb2ma Would you be interested in testing task 09-coap by chance?

miri64 · 2019-07-09T09:52:00Z

Please run the failing sudo tests regardless of whether there will be execution without root in the CI or not (since that requires some bootstrapping for scapy, rather not for this release), manually. That is the point why they are included in the release specs ;-)

kb2ma · 2019-07-09T10:33:04Z

Yes, happy to run 09-coap.

kb2ma · 2019-07-09T10:35:11Z

@leandrolanzieri, I don't want to interrupt if you plan to continue with 09-coap. Let me know.

leandrolanzieri · 2019-07-09T10:58:14Z

@kb2ma sorry, yes, almost done with them

leandrolanzieri · 2019-07-09T11:15:48Z

Everything looks good for 09-coap and 06-single-hop-udp

MrKevinWeiss · 2019-07-09T11:24:58Z

07-Multihop had 0% packet loss and no packet buff problems!

# task 1
100 packets transmitted, 100 packets received, 0% packet loss
round-trip min/avg/max = 36.106/41.166/46.321 ms

# task 3
100 packets transmitted, 100 packets received, 0% packet loss
round-trip min/avg/max = 0.364/0.364/0.365 ms

MrKevinWeiss · 2019-07-09T13:15:27Z

05

# task 1
round-trip min/avg/max = 0.309/0.829/2.558 ms

# task 3
round-trip min/avg/max = 0.325/0.830/2.391 ms

cladmi · 2019-07-09T13:50:36Z

For the TOOLCHAIN=llvm with BUILD_IN_DOCKER=1 I got a lot of failures due to the fact that llvm is generating bigger firmwares. Like

RIOT_CI_BUILD=1 BOARD=blackpill TOOLCHAIN=llvm BUILD_IN_DOCKER=1 make -C examples/asymcute_mqttsn/

RIOT_CI_BUILD=1 BOARD=blackpill TOOLCHAIN=llvm  BUILD_IN_DOCKER=1 make -C examples/asymcute_mqttsn/
make: Entering directory '/home/harter/work/git/worktree/riot_release_llvm/examples/asymcute_mqttsn'
Launching build container using image "riot/riotbuild:latest".
sudo docker run --rm -t -u "$(id -u)" \
    -v '/usr/share/zoneinfo/Europe/Berlin:/etc/localtime:ro' -v '/home/harter/work/git/worktree/riot_release_llvm:/data/riotbuild/riotbase' -e 'RIOTBASE=/data/riotbuild/riotbase' -e 'CCACHE_BASEDIR=/data/riotbuild/riotbase' -e 'BUILD_DIR=/data/riotbuild/riotbase/build' -e 'RIOTPROJECT=/data/riotbuild/riotbase' -e 'RIOTCPU=/data/riotbuild/riotbase/cpu' -e 'RIOTBOARD=/data/riotbuild/riotbase/boards' -e 'RIOTMAKE=/data/riotbuild/riotbase/makefiles' -v /home/harter/.gitcache:/data/riotbuild/gitcache -e GIT_CACHE_DIR=/data/riotbuild/gitcache  -v /home/harter/work/git/RIOT/.git:/home/harter/work/git/RIOT/.git \
    -e 'BOARD=blackpill' -e 'RIOT_CI_BUILD=1' -e 'TOOLCHAIN=llvm' \
    -w '/data/riotbuild/riotbase/examples/asymcute_mqttsn/' \
    'riot/riotbuild:latest' make   
[sudo] password for harter: 
Building application "asymcute_mqttsn" for "blackpill" with MCU "stm32f1".

/opt/gcc-arm-none-eabi-7-2018-q2-update/bin/../lib/gcc/arm-none-eabi/7.3.1/../../../../arm-none-eabi/bin/ld: /data/riotbuild/riotbase/examples/asymcute_mqttsn/bin/blackpill/asymcute_mqttsn.elf section `.text' will not fit in region `rom'
/opt/gcc-arm-none-eabi-7-2018-q2-update/bin/../lib/gcc/arm-none-eabi/7.3.1/../../../../arm-none-eabi/bin/ld: region `rom' overflowed by 900 bytes
collect2: error: ld returned 1 exit status
/data/riotbuild/riotbase/Makefile.include:475: recipe for target '/data/riotbuild/riotbase/examples/asymcute_mqttsn/bin/blackpill/asymcute_mqttsn.elf' failed
make: *** [/data/riotbuild/riotbase/examples/asymcute_mqttsn/bin/blackpill/asymcute_mqttsn.elf] Error 1
/home/harter/work/git/worktree/riot_release_llvm/makefiles/docker.inc.mk:266: recipe for target '..in-docker-container' failed
make: *** [..in-docker-container] Error 2
make: Leaving directory '/home/harter/work/git/worktree/riot_release_llvm/examples/asymcute_mqttsn'

I will limit to the boards we run in CI for the next run.

MrKevinWeiss · 2019-07-09T13:57:59Z

Hmm it seems that I am have some problems on Task #02 - ICMPv6 echo unicast addresess on iotlab-m3 (default route)

Can someone confirm?

cladmi · 2019-07-09T14:07:57Z

I did a run of scan-build-analyze for the boards tested with llvm using

BUILD_IN_DOCKER=1 TOOLCHAIN=llvm ./dist/tools/compile_and_test_for_board/compile_and_test_for_board.py --compile-targets scan-build-analyze --no-test . iotlab-m3

I used some sed hack to split the warnings in RIOT and in packages. Otherwise the ones in packages would be repeated for each board/application.

It currently reported ~130 in RIOT (including deprecation warnings for ubjson).
I will try to do a dedicated issue for the ones that look like bugs.

https://ci-ilab.imp.fu-berlin.de/job/RIOT%20scan-build-analyze/16/riot_scan_build/

leandrolanzieri · 2019-07-09T14:42:45Z

Hmm it seems that I am have some problems on Task #02 - ICMPv6 echo unicast addresess on iotlab-m3 (default route)

Can someone confirm?

It's working for me, 1% Packet Loss

cladmi · 2019-07-09T16:57:36Z

Please run the failing sudo tests regardless of whether there will be execution without root in the CI or not (since that requires some bootstrapping for scapy, rather not for this release), manually. That is the point why they are included in the release specs ;-)

In theory, also all the non automated tests should also be executed.
Not only the ones with a test target.

From RIOT-OS/RIOT#11821
I noticed that currently, the first issue with CI is not the sudo but that scapy is not installed in workers and on tests RPis.

kaspar030 · 2019-07-09T21:52:50Z

I noticed that currently, the first issue with CI is not the sudo but that scapy is not installed in workers and on tests RPis.

Yup. This is unfortunately not a matter of just installing scapy, as scapy wants to open a raw socket, which only root can do.

miri64 · 2019-07-09T22:03:55Z

[…] as scapy wants to open a raw socket, which only root can do.

Will fix very soon (but not in a backportable state I fear)

kaspar030 · 2019-07-09T22:13:34Z

Will fix very soon (but not in a backportable state I fear)

There might also be a workaround using ambient capabilities: https://stackoverflow.com/a/47982075/5910429
If only the raw socket capability is missing, we can create a wrapper binary that allows only that.

miri64 · 2019-07-09T22:32:17Z

There is a TUN/TAP-Wrapper hidden inside scapy's socket abstraction I'd like to experiment with tomorrow. If that works without root I'll rather go for that than some permission foobar.

miri64 · 2019-07-09T22:36:33Z

(all our scapy raw sockets use either TUN or TAP interfaces so far, so if they have user permissions granted at creation—see ip tuntap help—this seems to me the more obvious way)

kaspar030 · 2019-07-10T06:29:27Z

There is a TUN/TAP-Wrapper hidden inside scapy's socket abstraction I'd like to experiment with tomorrow. If that works without root I'll rather go for that than some permission foobar.

Totally agreed! And let me know if I can help. (I just stumbled over the workaround and wanted to share it.)

MrKevinWeiss · 2019-07-10T07:37:03Z

So I did 05-task4 and with 0% packetloss round-trip min/avg/max = 122.022/140.804/158.292 ms

MrKevinWeiss · 2019-07-10T09:29:41Z

I am getting some pretty high packet loss for 04-Task #1 - ICMPv6 link-local echo with iotlab-m3 only when running locally, between 10% and 50%.
I tried on other channels and it still seems to fail.
I tried on IoTlabs and it was fine.
I tried switching m3 boards and it still fails
I tried increasing the interval from 10 to 50 and it really helped
I tried with samr to samr and it still failed

I was using the tests/gnrc_udp to test.

@miri64, @cgundogan, any ideas? @PeterKietzmann said it could be the Hamburg air or maybe it is our M3 boards that have some issue, maybe floating pins or something? I will note the the USB is a little bit sensitive to position.

miri64 · 2019-07-10T09:51:48Z

@PeterKietzmann said it could be the Hamburg air or maybe it is our M3 boards that have some issue, maybe floating pins or something?

If it works on IoT-LAB (have you tried different sites?) or Varduz, it seems to be the Hamburg air. We had problmes in the past where tests over radio conducted at HAW Hamburg failed while they worked at other places. Maybe there is something jamming the spectrum in your building.

MrKevinWeiss · 2019-07-18T11:48:00Z

02-1 passed but I needed to manually do sudo from some tests and run BUILD_IN_DOCKER=1 for cpp tests (since it isn't setup)

MrKevinWeiss · 2019-07-18T11:53:13Z

~~@fjmolinas odd to put those links in~~ <= ahh copy and paste. I guess the gnrc stuff needs sudo and I the fatfs needs an sd card or something special on the sd card... It is a pretty special case.

cladmi · 2019-07-18T11:57:24Z

It says Tests failed: 5 with 4 tests listed.

MrKevinWeiss · 2019-07-18T11:59:35Z

arrays start at 2

fjmolinas · 2019-07-18T11:59:49Z

It says Tests failed: 5 with 4 tests listed.

Yep I was implementing a python test script for 11-lorawan and when checking out the RC1 branch it didn't get removed. I didn't want to re-run the tests because of that.

fjmolinas · 2019-07-18T12:00:43Z

@fjmolinas odd to put those links in <= ahh copy and paste. I guess the gnrc stuff needs sudo and I the fatfs needs an sd card or something special on the sd card... It is a pretty special case.

I'll mark as passing sin I re-ran those 3 with sudo and they are passing. Running for samr21 now..

fjmolinas · 2019-07-18T12:08:15Z

99-compile-and-test-one-board Task #1 - Run tests on different hardwares

I could leave it running over night for 4 boards, any preferences? @MrKevinWeiss

MrKevinWeiss · 2019-07-18T12:11:09Z

Oh very nice @fjmolinas I really appreciate the help. I would say choose ones that don't have known flashing or term problems and different cpus.

cladmi · 2019-07-18T12:22:37Z

I can run the tests again on arduino-mega2560 cc2650-launchpad frdm-k64f frdm-kw41z msba2 mulle nrf52dk nucleo-f103rb pba-d-01-kw2x sltb001a stm32f3discovery

fjmolinas · 2019-07-18T12:24:53Z

8-interop Task 10 Passes in RC1

LWIP node:

�main(): This is RIOT! (Version: 2019.10-devel-HEAD)
RIOT lwip test application
> udp server start 3000
udp server start 3000
Success: started UDP server on port 3000
> help udp
help udp
Command              Description
---------------------------------------
ip                   Send IP packets and listen for packets of certain type
tcp                  Send TCP messages and listen for messages on TCP port
udp                  Send UDP messages and listen for messages on UDP port
ifconfig             Shows assigned IPv6 addresses
reboot               Reboot the node
ps                   Prints information about running threads.
random_init          initializes the PRNG
random_get           returns 32 bit of pseudo randomness
> udp send
udp send
usage: udp send <addr> <port> <hex data> [<num> [<delay in us>]]
> udp send fe80::1711:6b10:65f6:bc02
udp send fe80::1711:6b10:65f6:bc02
usage: udp send <addr> <port> <hex data> [<num> [<delay in us>]]
> udp send fe80::1711:6b10:65f6:bc02 3000 12345678             
udp send fe80::1711:6b10:65f6:bc02 3000 12345678
Success: send 4 byte over UDP to [fe80::1711:6b10:65f6:bc02]:3000
> ifconfig
ifconfig
L6_00:  inet6 fe80::1711:6b10:65f8:bc36

> Received UDP data from [fe80::1711:6b10:65f6:bc02]:1026:
00000000  12  34  56  78

emb6 node

RIOT emb6 test application
> help
help
Command              Description
---------------------------------------
ping6                Send pings and receive pongs
udp                  Send UDP messages and listen for messages on UDP port
ifconfig             Shows assigned IPv6 addresses
reboot               Reboot the node
ps                   Prints information about running threads.
random_init          initializes the PRNG
random_get           returns 32 bit of pseudo randomness
> udp server start 3000
udp server start 3000
Success: started UDP server on port 3000
> ifconfig
ifconfig
0:  inet6 fe80::1711:6b10:65f6:bc02
    
> Received from [fe80::1711:6b10:65f8:bc36]:3000:
00000000  12  34  56  78
udp send fe80::1711:6b10:65f8:bc36 3000 12345678
udp send fe80::1711:6b10:65f8:bc36 3000 12345678
Success: send 4 byte to [fe80::1711:6b10:65f8:bc36]:3000)

cladmi · 2019-07-18T12:26:51Z

As said in #128 (comment) 01/task2 and 01/task3 worked. The 01/Task4 works on the 2019.07-branch as RIOT-OS/RIOT#11858 was merged.

But I cannot tick the checkbox.

fjmolinas · 2019-07-18T12:28:56Z

8-interop Task 9 Passes in RC1

gnrc node

�main(): This is RIOT! (Version: 2019.10-devel-HEAD)
RIOT network stack example application
All up, running the shell now
> ifconfig
ifconfig
Iface  7  HWaddr: 3C:36  Channel: 26  Page: 0  NID: 0x23
          Long HWaddr: 15:11:6B:10:65:F8:BC:36 
           TX-Power: 0dBm  State: IDLE  max. Retrans.: 3  CSMA Retries: 4 
          AUTOACK  ACK_REQ  CSMA  L2-PDU:102 MTU:1280  HL:64  RTR  
          6LO  IPHC  
          Source address length: 8
          Link type: wireless
          inet6 addr: fe80::1711:6b10:65f8:bc36  scope: local  VAL
          inet6 group: ff02::2
          inet6 group: ff02::1
          inet6 group: ff02::1:fff8:bc36
          inet6 group: ff02::1a
          
          Statistics for Layer 2
            RX packets 3  bytes 177
            TX packets 5 (Multicast: 5)  bytes 201
            TX succeeded 5 errors 0
          Statistics for IPv6
            RX packets 3  bytes 240
            TX packets 5 (Multicast: 5)  bytes 306
            TX succeeded 5 errors 0

> udp server start 3000
udp server start 3000
Success: started UDP server on port 3000
> PKTDUMP: data received:
~~ SNIP  0 - size:   4 byte, type: NETTYPE_UNDEF (0)
00000000  12  34  56  78
~~ SNIP  1 - size:   8 byte, type: NETTYPE_UDP (4)
   src-port:  1026  dst-port:  3000
   length: 12  cksum: 0x4203
~~ SNIP  2 - size:  40 byte, type: NETTYPE_IPV6 (2)
traffic class: 0x00 (ECN: 0x0, DSCP: 0x00)
flow label: 0x00000
length: 12  next header: 17  hop limit: 64
source address: fe80::1711:6b10:65f6:bc02
destination address: fe80::1711:6b10:65f8:bc36
~~ SNIP  3 - size:  24 byte, type: NETTYPE_NETIF (-1)
if_pid: 7  rssi: -44  lqi: 255
flags: 0x0
src_l2addr: 15:11:6B:10:65:F6:BC:02
dst_l2addr: 15:11:6B:10:65:F8:BC:36
~~ PKT    -  4 snips, total size:  76 byte
udp send fe80::1711:6b10:65f6:bc02 3000 12345678
udp send fe80::1711:6b10:65f6:bc02 3000 12345678
Success: sent 8 byte(s) to [fe80::1711:6b10:65f6:bc02]:3000

emb6 node

�main(): This is RIOT! (Version: 2019.10-devel-HEAD)
RIOT emb6 test application
> help
help
Command              Description
---------------------------------------
ping6                Send pings and receive pongs
udp                  Send UDP messages and listen for messages on UDP port
ifconfig             Shows assigned IPv6 addresses
reboot               Reboot the node
ps                   Prints information about running threads.
random_init          initializes the PRNG
random_get           returns 32 bit of pseudo randomness
> udp server start 3000
udp server start 3000
Success: started UDP server on port 3000
> ifconfig
ifconfig
0:  inet6 fe80::1711:6b10:65f6:bc02
    
> Received from [fe80::1711:6b10:65f8:bc36]:3000:
00000000  12  34  56  78
udp send fe80::1711:6b10:65f8:bc36 3000 12345678
udp send fe80::1711:6b10:65f8:bc36 3000 12345678
Success: send 4 byte to [fe80::1711:6b10:65f8:bc36]:3000)
> reboot
reboot
�main(): This is RIOT! (Version: 2019.10-devel-HEAD)
RIOT emb6 test application
> ifconfig
ifconfig
0:  inet6 fe80::1711:6b10:65f6:bc02
    
> udp server start 3000
udp server start 3000
Success: started UDP server on port 3000
> udp send fe80::1711:6b10:65f8:bc36 3000 12345678
udp send fe80::1711:6b10:65f8:bc36 3000 12345678
Success: send 4 byte to [fe80::1711:6b10:65f8:bc36]:3000)
> Received from [fe80::1711:6b10:65f8:bc36]:3000:
00000000  31  32  33  34  35  36  37  38

fjmolinas · 2019-07-18T12:31:26Z

8-interop Task 8 Passes in RC1

lwip node

�main(): This is RIOT! (Version: 2019.10-devel-HEAD)
RIOT lwip test application
> udp server start 3000
udp server start 3000
Success: started UDP server on port 3000
> ifconfig
ifconfig
L6_00:  inet6 fe80::1711:6b10:65f6:bc02

> udp send fe80::1711:6b10:65f8:bc36 3000 12345678
udp send fe80::1711:6b10:65f8:bc36 3000 12345678
Success: send 4 byte over UDP to [fe80::1711:6b10:65f8:bc36]:3000
> Received UDP data from [fe80::1711:6b10:65f8:bc36]:3000:
00000000  31  32  33  34  35  36  37  38

RIOT node

RIOT network stack example application
All up, running the shell now
> udp server start 3000
udp server start 3000
Success: started UDP server on port 3000
> ifconfig
ifconfig
Iface  7  HWaddr: 3C:36  Channel: 26  Page: 0  NID: 0x23
          Long HWaddr: 15:11:6B:10:65:F8:BC:36 
           TX-Power: 0dBm  State: IDLE  max. Retrans.: 3  CSMA Retries: 4 
          AUTOACK  ACK_REQ  CSMA  L2-PDU:102 MTU:1280  HL:64  RTR  
          6LO  IPHC  
          Source address length: 8
          Link type: wireless
          inet6 addr: fe80::1711:6b10:65f8:bc36  scope: local  VAL
          inet6 group: ff02::2
          inet6 group: ff02::1
          inet6 group: ff02::1:fff8:bc36
          inet6 group: ff02::1a
          
          Statistics for Layer 2
            RX packets 4  bytes 177
            TX packets 5 (Multicast: 5)  bytes 201
            TX succeeded 5 errors 0
          Statistics for IPv6
            RX packets 2  bytes 128
            TX packets 5 (Multicast: 5)  bytes 306
            TX succeeded 5 errors 0

> PKTDUMP: data received:
~~ SNIP  0 - size:   4 byte, type: NETTYPE_UNDEF (0)
00000000  12  34  56  78
~~ SNIP  1 - size:   8 byte, type: NETTYPE_UDP (4)
   src-port:  3000  dst-port:  3000
   length: 12  cksum: 0x3a4d
~~ SNIP  2 - size:  40 byte, type: NETTYPE_IPV6 (2)
traffic class: 0x00 (ECN: 0x0, DSCP: 0x00)
flow label: 0x00000
length: 12  next header: 17  hop limit: 255
source address: fe80::1711:6b10:65f6:bc02
destination address: fe80::1711:6b10:65f8:bc36
~~ SNIP  3 - size:  24 byte, type: NETTYPE_NETIF (-1)
if_pid: 7  rssi: -44  lqi: 255
flags: 0x0
src_l2addr: 15:11:6B:10:65:F6:BC:02
dst_l2addr: 15:11:6B:10:65:F8:BC:36
~~ PKT    -  4 snips, total size:  76 byte
udp send fe80::1711:6b10:65f6:bc02 3000 12345678
udp send fe80::1711:6b10:65f6:bc02 3000 12345678
Success: sent 8 byte(s) to [fe80::1711:6b10:65f6:bc02]:3000

fjmolinas · 2019-07-18T13:20:30Z

2-tests Task 03 - Subset of tests on samr21-xpro PASSED

ERROR:samr21-xpro:Tests failed: 4
Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)

The first 3 succeed when running with sudo

miri64 · 2019-07-18T14:01:34Z

@fjmolinas: @aabadie should have one of those lying around: https://doc.riot-os.org/group__drivers__io1__xplained.html (he wrote the driver). Maybe the fourth succeeds with that.

smlng · 2019-07-19T08:53:46Z

interop 8 task 02: works with link local and global (ULA) addresses

smlng · 2019-07-19T09:24:51Z

interop 8 task 04: works bidirectional when using CFLAGS += -DGNRC_IPV6_NIB_CONF_SLAAC=1. It also works from Internet host to RIOT w/o that flag, but not from RIOT to Internet host. The latter is weird because it means that source address selection (or exclusion) is different when RIOT is initial sender or only responder - though I assume, that when responding RIOT just switches src and dst addresses w/o checking validity of its own source address.

MrKevinWeiss · 2019-07-19T10:03:55Z

Closing in favor of #133

cladmi · 2019-07-19T10:04:06Z

The arduino-mega2560 did not run due to crap hardware.


#### cc2650-launchpad/failuresummary.md

Failures during test:
- [tests/cond_order](tests/cond_order/test.failed)
- [tests/driver_grove_ledbar](tests/driver_grove_ledbar/test.failed)
- [tests/driver_my9221](tests/driver_my9221/test.failed)
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/periph_timer](tests/periph_timer/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)

#### frdm-k64f/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/periph_timer](tests/periph_timer/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)

#### frdm-kw41z/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)
- [tests/thread_flags](tests/thread_flags/test.failed)
- [tests/unittests](tests/unittests/test.failed)
- [tests/xtimer_periodic_wakeup](tests/xtimer_periodic_wakeup/test.failed)
- [tests/xtimer_usleep](tests/xtimer_usleep/test.failed)

#### msba2/failuresummary.md

Failures during test:
- [tests/driver_grove_ledbar](tests/driver_grove_ledbar/test.failed)
- [tests/driver_my9221](tests/driver_my9221/test.failed)
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sixlowpan](tests/gnrc_sixlowpan/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/libfixmath](tests/libfixmath/test.failed)
- [tests/libfixmath_unittests](tests/libfixmath_unittests/test.failed)
- [tests/lwip_sock_tcp](tests/lwip_sock_tcp/test.failed)
- [tests/periph_rtc](tests/periph_rtc/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/pkg_libcose](tests/pkg_libcose/test.failed)
- [tests/pkg_qdsa](tests/pkg_qdsa/test.failed)
- [tests/pkg_relic](tests/pkg_relic/test.failed)
- [tests/pkg_tweetnacl](tests/pkg_tweetnacl/test.failed)
- [tests/pthread_tls](tests/pthread_tls/test.failed)
- [tests/unittests](tests/unittests/test.failed)
- [tests/xtimer_periodic_wakeup](tests/xtimer_periodic_wakeup/test.failed)

#### mulle/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/periph_timer](tests/periph_timer/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/pkg_littlefs](tests/pkg_littlefs/test.failed)
- [tests/pkg_spiffs](tests/pkg_spiffs/test.failed)
- [tests/shell](tests/shell/test.failed)

#### nrf52dk/failuresummary.md

Failures during compilation:
- [tests/mcuboot](tests/mcuboot/compilation.failed)

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)

#### nucleo-f103rb/failuresummary.md

Failures during test:
- [tests/driver_grove_ledbar](tests/driver_grove_ledbar/test.failed)
- [tests/driver_hd44780](tests/driver_hd44780/test.failed)
- [tests/driver_my9221](tests/driver_my9221/test.failed)
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/xtimer_periodic_wakeup](tests/xtimer_periodic_wakeup/test.failed)
- [tests/xtimer_usleep_short](tests/xtimer_usleep_short/test.failed)

#### pba-d-01-kw2x/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)

#### sltb001a/failuresummary.md

Failures during test:
- [tests/embunit](tests/embunit/test.failed)
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/periph_gpio](tests/periph_gpio/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)
- [tests/xtimer_periodic_wakeup](tests/xtimer_periodic_wakeup/test.failed)

#### stm32f3discovery/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)

miri64 · 2019-07-19T10:13:22Z

interop 8 task 04: works bidirectional when using CFLAGS += -DGNRC_IPV6_NIB_CONF_SLAAC=1. It also works from Internet host to RIOT w/o that flag, but not from RIOT to Internet host. The latter is weird because it means that source address selection (or exclusion) is different when RIOT is initial sender or only responder - though I assume, that when responding RIOT just switches src and dst addresses w/o checking validity of its own source address.

It's not weird, because for ping reply the source address is known (the one the sender of the echo request used as destination address), so that is used. If you are the sender of an echo request it has to be determined first, so source address selection is triggered.

smlng · 2019-07-19T10:15:57Z

mhm, yeah sure the source address is known (as I wrote: just switch src and dst addresses) - however, it might be invalid and hence should not be used?!

miri64 · 2019-07-19T10:22:39Z

You are right. A check in gnrc_ipv6 is needed for that. However, this is a minor issue and should not be blocking for the release.

MrKevinWeiss · 2019-07-19T10:51:38Z

However, this is a minor issue and should not be blocking for the release.

😌

MrKevinWeiss added the help wanted label Jul 8, 2019

MrKevinWeiss self-assigned this Jul 8, 2019

cladmi mentioned this issue Jul 9, 2019

2019.07-RC1: run all tests on murdock RIOT-OS/RIOT#11821

Closed

MrKevinWeiss closed this as completed Jul 19, 2019

cladmi mentioned this issue Jul 19, 2019

test_utils_interactive_sync: add a helper for synchronizing tests RIOT-OS/RIOT#11875

Merged

cladmi mentioned this issue Aug 2, 2019

[RFC] tests: add 'test-manual' targets RIOT-OS/RIOT#11954

Closed

5 tasks

miri64 mentioned this issue Aug 6, 2019

gnrc_ipv6: check validity of preconfigured source on send RIOT-OS/RIOT#11970

Merged

cladmi mentioned this issue Aug 12, 2019

boards/common/nucleo: increase XTIMER_BACKOFF for STM32F103 RIOT-OS/RIOT#11975

Merged

cladmi mentioned this issue Aug 21, 2019

unittests/sht1x: decrease the amount of tested values on board RIOT-OS/RIOT#12054

Merged

kb2ma mentioned this issue Oct 15, 2019

Release 2019.10 - RC1 #140

Closed

80 tasks

Release 2019.07 - RC1 #128

Release 2019.07 - RC1 #128

Comments

MrKevinWeiss commented Jul 8, 2019 • edited Loading

MrKevinWeiss commented Jul 8, 2019

fjmolinas commented Jul 8, 2019 • edited Loading

MrKevinWeiss commented Jul 8, 2019

cladmi commented Jul 8, 2019

cladmi commented Jul 8, 2019

MrKevinWeiss commented Jul 9, 2019

miri64 commented Jul 9, 2019

kb2ma commented Jul 9, 2019

kb2ma commented Jul 9, 2019

leandrolanzieri commented Jul 9, 2019

leandrolanzieri commented Jul 9, 2019

MrKevinWeiss commented Jul 9, 2019 • edited Loading

MrKevinWeiss commented Jul 9, 2019

cladmi commented Jul 9, 2019

MrKevinWeiss commented Jul 9, 2019

cladmi commented Jul 9, 2019

leandrolanzieri commented Jul 9, 2019

cladmi commented Jul 9, 2019

kaspar030 commented Jul 9, 2019

miri64 commented Jul 9, 2019 • edited Loading

kaspar030 commented Jul 9, 2019

miri64 commented Jul 9, 2019

miri64 commented Jul 9, 2019

kaspar030 commented Jul 10, 2019

MrKevinWeiss commented Jul 10, 2019

MrKevinWeiss commented Jul 10, 2019 • edited Loading

miri64 commented Jul 10, 2019

MrKevinWeiss commented Jul 18, 2019

MrKevinWeiss commented Jul 18, 2019 • edited Loading

cladmi commented Jul 18, 2019

MrKevinWeiss commented Jul 18, 2019

fjmolinas commented Jul 18, 2019

fjmolinas commented Jul 18, 2019

fjmolinas commented Jul 18, 2019

MrKevinWeiss commented Jul 18, 2019

cladmi commented Jul 18, 2019

fjmolinas commented Jul 18, 2019

cladmi commented Jul 18, 2019

fjmolinas commented Jul 18, 2019

fjmolinas commented Jul 18, 2019

fjmolinas commented Jul 18, 2019

miri64 commented Jul 18, 2019

smlng commented Jul 19, 2019

smlng commented Jul 19, 2019

MrKevinWeiss commented Jul 19, 2019

cladmi commented Jul 19, 2019

miri64 commented Jul 19, 2019

smlng commented Jul 19, 2019

miri64 commented Jul 19, 2019

MrKevinWeiss commented Jul 19, 2019

MrKevinWeiss commented Jul 8, 2019 •

edited

Loading

fjmolinas commented Jul 8, 2019 •

edited

Loading

MrKevinWeiss commented Jul 9, 2019 •

edited

Loading

miri64 commented Jul 9, 2019 •

edited

Loading

MrKevinWeiss commented Jul 10, 2019 •

edited

Loading

MrKevinWeiss commented Jul 18, 2019 •

edited

Loading