Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Release 2023.04 - RC1 #278

Closed
61 of 86 tasks
jia200x opened this issue Apr 3, 2023 · 12 comments
Closed
61 of 86 tasks

Release 2023.04 - RC1 #278

jia200x opened this issue Apr 3, 2023 · 12 comments

Comments

@jia200x
Copy link
Member

jia200x commented Apr 3, 2023 •
edited by MrKevinWeiss
Loading

This issue lists the status of all tests for the Release Candidate 1 of the 2023.04 release.

Specs tested:
@riot-ci
Copy link

riot-ci commented Apr 3, 2023 •
edited
Loading

Test Report

Task Outcome
✔ 01. Task 03 - Unittests on native separated [tests-ztimer64] PASSED
✔ 03. Task 01 - ICMPv6 multicast echo on native PASSED
✔ 03. Task 02 - ICMPv6 link-local echo on native PASSED
✔ 03. Task 03 - ICMPv6 link-local echo on native (1 hour) PASSED
✔ 03. Task 04 - ICMPv6 stress test on native (1 hour) PASSED
✔ 03. Task 05 - ICMPv6 stress test on native (neighbor cache stress) PASSED
✔ 03. Task 06 - ICMPv6 link-local echo on native (IPv6 fragmentation) PASSED
✔ 04. Task 03 - ICMPv6 echo with large payload PASSED
✔ 04. Task 04 - ICMPv6 echo with iotlab-m3/samr21-xpro 15 minutes PASSED
🟡 04. Task 05 (Experimental) - ICMPv6 multicast echo with samr21-xpro/cc2538 [lille] SKIPPED
🟡 04. Task 06 (Experimental)- ICMPv6 link-local echo with samr21-xpro/cc2538 [lille] SKIPPED
🟡 04. Task 07 (Experimental) - ICMPv6 multicast echo with samr21-xpro/zero + xbee SKIPPED
🟡 04. Task 08 (Experimental) - ICMPv6 echo with samr21-xpro/zero + xbee SKIPPED
✔ 04. Task 09 - ICMPv6 stress test on iotlab-m3 PASSED
✔ 04. Task 10 (Experimental) - ICMPv6 echo with large payload (IPv6 fragmentation) PASSED
✔ 04. Task 11 (Experimental) - ICMPv6 stress test on nrf802154 PASSED
✔ 04. Task 12 (Experimental) - ICMPv6 multicast echo with iotlab-m3/nrf802154 PASSED
✔ 04. Task 13 (Experimental) - ICMPv6 link-local echo with iotlab-m3/nrf802154 PASSED
✔ 05. Task 01 - ICMPv6 echo unicast addresess on native (default route) PASSED
✔ 05. Task 02 - ICMPv6 echo unicast addresess on iotlab-m3 (default route) PASSED
✔ 05. Task 03 - ICMPv6 echo unicast addresess on native (specific route) PASSED
✔ 05. Task 04 - ICMPv6 echo unicast addresess on iotlab-m3 (static route) PASSED
✔ 06. Task 01 - UDP on iotlab-m3 PASSED
✔ 06. Task 02 - UDP on iotlab-m3 (UDP port compression) PASSED
✔ 06. Task 03 - UDP on native (non-existent neighbor) PASSED
✔ 06. Task 04 - UDP on iotlab-m3 (non-existent neighbor) PASSED
✔ 06. Task 05 - Empty UDP on native PASSED
✔ 06. Task 06 - Empty UDP on iotlab-m3 PASSED
✔ 07. Task 01 - ICMPv6 echo on iotlab-m3 with three hops (static route) PASSED
✔ 07. Task 02 - UDP on iotlab-m3 with three hops (static route) PASSED
✔ 07. Task 03 - ICMPv6 echo on iotlab-m3 with three hops (RPL route) PASSED
✔ 07. Task 04 - UDP on iotlab-m3 with three hops (RPL route) PASSED
🟡 07. Task 05 (Experimental) - UDP with large payload on iotlab-m3 with three hops (RPL route) SKIPPED
✔ 08. Task 01 - ICMPv6 echo between native and Linux PASSED
✔ 08. Task 08 - UDP between GNRC and lwIP on iotlab-m3 PASSED
✔ 09. Task 01 - CORD Endpoint PASSED
✔ 09. Task 02 - Confirmable retries [False-0] PASSED
✔ 09. Task 02 - Confirmable retries [True-1] PASSED
✔ 09. Task 03 - Block1 PASSED
✔ 09. Task 04 - Block2 PASSED
✔ 09. Task 05 - Observe registration and notification PASSED
✔ 11. Task 01 - LoRaWAN example PASSED
✔ 11. Task 02 - OTAA join procedure [0] PASSED
✔ 11. Task 02 - OTAA join procedure [3] PASSED
✔ 11. Task 02 - OTAA join procedure [5] PASSED
✔ 11. Task 03 - ABP join procedure [0] PASSED
✔ 11. Task 03 - ABP join procedure [3] PASSED
✔ 11. Task 03 - ABP join procedure [5] PASSED
✔ 11. Task 04 - LoRaWAN device parameters persistence PASSED
✔ 11. Task 05 - GNRC LoRaWAN (Over The Air Activation) [otaa] PASSED
🟡 11. Task 06 - GNRC LoRaWAN (ABP) [abp] SKIPPED

@MrKevinWeiss
Copy link
Contributor

The compile_and_test_for_board.py results in the following issues (will be updated as time goes by):

@MrKevinWeiss
Copy link
Contributor

MrKevinWeiss commented Apr 6, 2023 •
edited
Loading

Task 11 - UDP exchange between iotlab-m3 and Zephyr v2.7.4 -> PASS 
> udp send fe80::dc63:100:712e:9c3b 4242 "RIOT Testing!"
2023-04-06 13:12:06,637 # udp send fe80::dc63:100:712e:9c3b 4242 "RIOT Testing!"
2023-04-06 13:12:06,639 # Success: sent 13 byte(s) to [fe80::dc63:100:712e:9c3b]:4242
> 2023-04-06 13:12:06,652 # PKTDUMP: data received:
2023-04-06 13:12:06,654 # ~~ SNIP  0 - size:  13 byte, type: NETTYPE_UNDEF (0)
2023-04-06 13:12:06,657 # 00000000  52  49  4F  54  20  54  65  73  74  69  6E  67  21
2023-04-06 13:12:06,659 # ~~ SNIP  1 - size:   8 byte, type: NETTYPE_UDP (4)
2023-04-06 13:12:06,660 #    src-port:  4242  dst-port:  4242
2023-04-06 13:12:06,661 #    length: 21  cksum: 0xd706
2023-04-06 13:12:06,668 # ~~ SNIP  2 - size:  40 byte, type: NETTYPE_IPV6 (2)
2023-04-06 13:12:06,670 # traffic class: 0x00 (ECN: 0x0, DSCP: 0x00)
2023-04-06 13:12:06,671 # flow label: 0x00000
2023-04-06 13:12:06,673 # length: 21  next header: 17  hop limit: 64
2023-04-06 13:12:06,675 # source address: fe80::dc63:100:712e:9c3b
2023-04-06 13:12:06,678 # destination address: fe80::a41d:cd21:6be0:1774
2023-04-06 13:12:06,680 # ~~ SNIP  3 - size:  24 byte, type: NETTYPE_NETIF (-1)
2023-04-06 13:12:06,681 # if_pid: 6  rssi: -49  lqi: 255
2023-04-06 13:12:06,682 # flags: 0x0
2023-04-06 13:12:06,684 # src_l2addr: DE:63:01:00:71:2E:9C:3B
2023-04-06 13:12:06,685 # dst_l2addr: A6:1D:CD:21:6B:E0:17:74
2023-04-06 13:12:06,687 # ~~ PKT    -  4 snips, total size:  85 byte

@jia200x
Copy link
Member Author

jia200x commented Apr 6, 2023

Task 08.04: CMPv6 echo between iotlab-m3 and Internet host through Linux with 6LowPAN -> PASS 
2023-04-06 17:01:40,610 # ping 2a00:1450:4005:801::200e
2023-04-06 17:01:40,744 # 12 bytes from 2a00:1450:4005:801::200e: icmp_seq=0 ttl=117 rssi=-66 dBm time=124.123 ms
2023-04-06 17:01:41,754 # 12 bytes from 2a00:1450:4005:801::200e: icmp_seq=1 ttl=117 rssi=-66 dBm time=123.523 ms
2023-04-06 17:01:42,679 # 12 bytes from 2a00:1450:4005:801::200e: icmp_seq=2 ttl=117 rssi=-66 dBm time=38.835 ms
2023-04-06 17:01:42,680 # 
2023-04-06 17:01:42,684 # --- 2a00:1450:4005:801::200e PING statistics ---
2023-04-06 17:01:42,689 # 3 packets transmitted, 3 packets received, 0% packet loss
2023-04-06 17:01:42,694 # round-trip min/avg/max = 38.835/95.493/124.123 ms
Task 08.02 ICMPv6 echo between iotlab-m3 and Linux with 6LowPAN -> PASS 
2023-04-06 17:02:45,087 # ping 2001:67c:254:b0c0::2
2023-04-06 17:02:45,106 # 12 bytes from 2001:67c:254:b0c0::2: icmp_seq=0 ttl=255 rssi=-66 dBm time=11.209 ms
2023-04-06 17:02:46,119 # 12 bytes from 2001:67c:254:b0c0::2: icmp_seq=1 ttl=255 rssi=-66 dBm time=12.730 ms
2023-04-06 17:02:47,128 # 12 bytes from 2001:67c:254:b0c0::2: icmp_seq=2 ttl=255 rssi=-66 dBm time=11.671 ms
2023-04-06 17:02:47,129 # 
2023-04-06 17:02:47,132 # --- 2001:67c:254:b0c0::2 PING statistics ---
2023-04-06 17:02:47,138 # 3 packets transmitted, 3 packets received, 0% packet loss
2023-04-06 17:02:47,142 # round-trip min/avg/max = 11.209/11.870/12.730 ms

@jia200x
Copy link
Member Author

jia200x commented Apr 11, 2023

01. Task #2 - Unittests on native - PASS 
main(): This is RIOT! (Version: 2023.07-devel-HEAD)
Help: Press s to start test, r to print it is ready
READY
s
START
.......................==853316==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases!
..............................................................................................................................................................................................................==853316==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0xfff61000; bottom 0x0825e000; size: 0xf7d03000 (-137351168)
False positive error reports may follow
For details see https://github.com/google/sanitizers/issues/189
.............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
OK (1154 tests)

@jia200x
Copy link
Member Author

jia200x commented Apr 11, 2023

01. Task #4 - Unittests on iotlab-m3 - PASS 
ssh -t $USER@grenoble.iot-lab.info 'socat - tcp:m3-10.grenoble.iot-lab.info:20000' 
READY
s
START
..................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
OK (1154 tests)

@MrKevinWeiss
Copy link
Contributor

It seems none of the 10-icmpv6-error tasks were run automatically. I am finished my vacation and should be able to pick testing back up tomorrow. I will try to run that manually.

@jia200x
Copy link
Member Author

jia200x commented Apr 13, 2023

All 10-icmpv6-error test pass. @miri64 triggered them an hour ago:
https://github.com/RIOT-OS/RIOT/actions/runs/4687899770/jobs/8307765249

For some reason they were not triggered by this RC1 and consequently not reported back

@jia200x
Copy link
Member Author

jia200x commented Apr 14, 2023

I replaced the Contiki test with Contiki-NG (see #280)

@jia200x
Copy link
Member Author

jia200x commented Apr 14, 2023 •
edited
Loading

04-single-hop-6lowpan-icmp: Task #1 - ICMPv6 link-local echo with iotlab-m3 - PASS 
1681481583.268771;m3-14;8 bytes from fe80::fc73:82cc:42b9:b6f9%6: icmp_seq=999 ttl=64 rssi=-46 dBm
1681481583.269018;m3-14;
1681481583.269129;m3-14;--- fe80::fc73:82cc:42b9:b6f9 PING statistics ---
1681481583.284672;m3-14;1000 packets transmitted, 1000 packets received, 0% packet loss

@MrKevinWeiss
Copy link
Contributor

04-task02 seems like it passed just scraping failed.

@MrKevinWeiss
Copy link
Contributor

Closing in favor of #281

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@jia200x @riot-ci @MrKevinWeiss