Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 2023.04 - RC2 #281

Closed
56 of 86 tasks
MrKevinWeiss opened this issue Apr 18, 2023 · 5 comments
Closed
56 of 86 tasks

Release 2023.04 - RC2 #281

MrKevinWeiss opened this issue Apr 18, 2023 · 5 comments

Comments

@MrKevinWeiss
Copy link
Contributor

MrKevinWeiss commented Apr 18, 2023

This issue lists the status of all tests for the Release Candidate 2 of the 2023.04 release.

Specs tested:

@riot-ci
Copy link

riot-ci commented Apr 18, 2023

Test Report

Task Outcome
01. Task 02 - Unittests on native PASSED
01. Task 03 - Unittests on native separated [tests-analog_util] PASSED
01. Task 03 - Unittests on native separated [tests-base64] PASSED
01. Task 03 - Unittests on native separated [tests-bcd] PASSED
01. Task 03 - Unittests on native separated [tests-bhp_event] PASSED
01. Task 03 - Unittests on native separated [tests-bhp_msg] PASSED
01. Task 03 - Unittests on native separated [tests-bitfield] PASSED
01. Task 03 - Unittests on native separated [tests-bloom] PASSED
01. Task 03 - Unittests on native separated [tests-bluetil] PASSED
01. Task 03 - Unittests on native separated [tests-checksum] PASSED
01. Task 03 - Unittests on native separated [tests-chunked_ringbuffer] PASSED
01. Task 03 - Unittests on native separated [tests-clif] PASSED
01. Task 03 - Unittests on native separated [tests-coding] PASSED
01. Task 03 - Unittests on native separated [tests-color] PASSED
01. Task 03 - Unittests on native separated [tests-core] PASSED
01. Task 03 - Unittests on native separated [tests-credman] PASSED
01. Task 03 - Unittests on native separated [tests-div] PASSED
01. Task 03 - Unittests on native separated [tests-dns_cache] PASSED
01. Task 03 - Unittests on native separated [tests-ecc] PASSED
01. Task 03 - Unittests on native separated [tests-fib] PASSED
01. Task 03 - Unittests on native separated [tests-fib_sr] PASSED
01. Task 03 - Unittests on native separated [tests-fmt] PASSED
01. Task 03 - Unittests on native separated [tests-frac] PASSED
01. Task 03 - Unittests on native separated [tests-gcoap] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_ipv6] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_hdr] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_nib] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_mac_internal] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_netif_pktq] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_sixlowpan_frag_vrb] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_udp] PASSED
01. Task 03 - Unittests on native separated [tests-hashes] PASSED
01. Task 03 - Unittests on native separated [tests-ieee802154] PASSED
01. Task 03 - Unittests on native separated [tests-inet_csum] PASSED
01. Task 03 - Unittests on native separated [tests-ipv4_addr] PASSED
01. Task 03 - Unittests on native separated [tests-ipv6_addr] PASSED
01. Task 03 - Unittests on native separated [tests-ipv6_hdr] PASSED
01. Task 03 - Unittests on native separated [tests-kernel_defines] PASSED
01. Task 03 - Unittests on native separated [tests-libc] PASSED
01. Task 03 - Unittests on native separated [tests-luid] PASSED
01. Task 03 - Unittests on native separated [tests-matstat] PASSED
01. Task 03 - Unittests on native separated [tests-mtd] PASSED
01. Task 03 - Unittests on native separated [tests-nanocoap] PASSED
01. Task 03 - Unittests on native separated [tests-nanocoap_cache] PASSED
01. Task 03 - Unittests on native separated [tests-netopt] PASSED
01. Task 03 - Unittests on native separated [tests-netreg] PASSED
01. Task 03 - Unittests on native separated [tests-phydat] PASSED
01. Task 03 - Unittests on native separated [tests-pkt] PASSED
01. Task 03 - Unittests on native separated [tests-pktbuf] PASSED
01. Task 03 - Unittests on native separated [tests-pktqueue] PASSED
01. Task 03 - Unittests on native separated [tests-printf_float] PASSED
01. Task 03 - Unittests on native separated [tests-priority_pktqueue] PASSED
01. Task 03 - Unittests on native separated [tests-rtc] PASSED
01. Task 03 - Unittests on native separated [tests-rtt_rtc] PASSED
01. Task 03 - Unittests on native separated [tests-saul_reg] PASSED
01. Task 03 - Unittests on native separated [tests-scanf_float] PASSED
01. Task 03 - Unittests on native separated [tests-seq] PASSED
01. Task 03 - Unittests on native separated [tests-sht1x] PASSED
01. Task 03 - Unittests on native separated [tests-sixlowpan] PASSED
01. Task 03 - Unittests on native separated [tests-sixlowpan_ctx] PASSED
01. Task 03 - Unittests on native separated [tests-sixlowpan_sfr] PASSED
01. Task 03 - Unittests on native separated [tests-sock_util] PASSED
01. Task 03 - Unittests on native separated [tests-timex] PASSED
01. Task 03 - Unittests on native separated [tests-tsrb] PASSED
01. Task 03 - Unittests on native separated [tests-turo] PASSED
01. Task 03 - Unittests on native separated [tests-uri_parser] PASSED
01. Task 03 - Unittests on native separated [tests-ut_process] PASSED
01. Task 03 - Unittests on native separated [tests-uuid] PASSED
01. Task 03 - Unittests on native separated [tests-vfs] PASSED
01. Task 03 - Unittests on native separated [tests-zptr] PASSED
01. Task 03 - Unittests on native separated [tests-ztimer64] PASSED
01. Task 03 - Unittests on native separated [tests-ztimer] PASSED
01. Task 04 - Unittests on iotlab-m3 PASSED
03. Task 01 - ICMPv6 multicast echo on native PASSED
03. Task 02 - ICMPv6 link-local echo on native PASSED
03. Task 03 - ICMPv6 link-local echo on native (1 hour) PASSED
03. Task 04 - ICMPv6 stress test on native (1 hour) PASSED
03. Task 05 - ICMPv6 stress test on native (neighbor cache stress) PASSED
03. Task 06 - ICMPv6 link-local echo on native (IPv6 fragmentation) PASSED
🔁 04. Task 01 - ICMPv6 link-local echo with iotlab-m3 RERUN
04. Task 03 - ICMPv6 echo with large payload PASSED
04. Task 04 - ICMPv6 echo with iotlab-m3/samr21-xpro 15 minutes PASSED
🟡 04. Task 05 (Experimental) - ICMPv6 multicast echo with samr21-xpro/cc2538 [lille] SKIPPED
🟡 04. Task 06 (Experimental)- ICMPv6 link-local echo with samr21-xpro/cc2538 [lille] SKIPPED
🟡 04. Task 07 (Experimental) - ICMPv6 multicast echo with samr21-xpro/zero + xbee SKIPPED
🟡 04. Task 08 (Experimental) - ICMPv6 echo with samr21-xpro/zero + xbee SKIPPED
04. Task 09 - ICMPv6 stress test on iotlab-m3 PASSED
🟡 04. Task 10 (Experimental) - ICMPv6 echo with large payload (IPv6 fragmentation) SKIPPED
04. Task 11 (Experimental) - ICMPv6 stress test on nrf802154 PASSED
04. Task 12 (Experimental) - ICMPv6 multicast echo with iotlab-m3/nrf802154 PASSED
04. Task 13 (Experimental) - ICMPv6 link-local echo with iotlab-m3/nrf802154 PASSED
05. Task 01 - ICMPv6 echo unicast addresess on native (default route) PASSED
05. Task 02 - ICMPv6 echo unicast addresess on iotlab-m3 (default route) PASSED
05. Task 03 - ICMPv6 echo unicast addresess on native (specific route) PASSED
05. Task 04 - ICMPv6 echo unicast addresess on iotlab-m3 (static route) PASSED
06. Task 01 - UDP on iotlab-m3 PASSED
06. Task 02 - UDP on iotlab-m3 (UDP port compression) PASSED
06. Task 03 - UDP on native (non-existent neighbor) PASSED
06. Task 04 - UDP on iotlab-m3 (non-existent neighbor) PASSED
06. Task 05 - Empty UDP on native PASSED
06. Task 06 - Empty UDP on iotlab-m3 PASSED
07. Task 01 - ICMPv6 echo on iotlab-m3 with three hops (static route) PASSED
07. Task 02 - UDP on iotlab-m3 with three hops (static route) PASSED
07. Task 03 - ICMPv6 echo on iotlab-m3 with three hops (RPL route) PASSED
07. Task 04 - UDP on iotlab-m3 with three hops (RPL route) PASSED
🟡 07. Task 05 (Experimental) - UDP with large payload on iotlab-m3 with three hops (RPL route) SKIPPED
08. Task 01 - ICMPv6 echo between native and Linux PASSED
08. Task 08 - UDP between GNRC and lwIP on iotlab-m3 PASSED
09. Task 01 - CORD Endpoint PASSED
09. Task 02 - Confirmable retries [False-0] PASSED
09. Task 02 - Confirmable retries [True-1] PASSED
09. Task 03 - Block1 PASSED
09. Task 04 - Block2 PASSED
09. Task 05 - Observe registration and notification PASSED
10. Task 01 - Destination unreachable - no route to destination PASSED
10. Task 02 - Destination unreachable - Beyond scope of source address PASSED
10. Task 03 - Destination unreachable - address unreachable (target node address) PASSED
10. Task 04 - Destination unreachable - address unreachable (neighbor cache miss) PASSED
10. Task 05 - Destination unreachable - port unreachable PASSED
10. Task 06 - Destination unreachable - port unreachable (large payload) PASSED
10. Task 07 - Packet too big PASSED
10. Task 08 - Time exceeded - hop limit exceeded in transit PASSED
10. Task 09 - Parameter problem - erroneous header field encountered PASSED
10. Task 10 - IPv6-in-IPv6 encapsulation PASSED
11. Task 01 - LoRaWAN example FAILED
11. Task 02 - OTAA join procedure [0] PASSED
11. Task 02 - OTAA join procedure [3] PASSED
11. Task 02 - OTAA join procedure [5] PASSED
11. Task 03 - ABP join procedure [0] PASSED
11. Task 03 - ABP join procedure [3] PASSED
11. Task 03 - ABP join procedure [5] PASSED
11. Task 04 - LoRaWAN device parameters persistence PASSED
11. Task 05 - GNRC LoRaWAN (Over The Air Activation) [otaa] PASSED
🟡 11. Task 06 - GNRC LoRaWAN (ABP) [abp] SKIPPED

@jia200x
Copy link
Member

jia200x commented Apr 18, 2023

This are the missing test runs from RC1:

08.interop: Task #5 - ICMPv6 echo between iotlab-m3 and Internet host through RIOT border router - PASS
2023-04-18 15:31:27,567 # ping 2001:4860:4860::8844
2023-04-18 15:31:27,625 # 12 bytes from 2001:4860:4860::8844: icmp_seq=0 ttl=116 rssi=-46 dBm time=49.865 ms
2023-04-18 15:31:28,723 # 12 bytes from 2001:4860:4860::8844: icmp_seq=1 ttl=116 rssi=-46 dBm time=135.082 ms
2023-04-18 15:31:29,737 # 12 bytes from 2001:4860:4860::8844: icmp_seq=2 ttl=116 rssi=-46 dBm time=136.834 ms
2023-04-18 15:31:29,738 # 
2023-04-18 15:31:29,742 # --- 2001:4860:4860::8844 PING statistics ---
2023-04-18 15:31:29,747 # 3 packets transmitted, 3 packets received, 0% packet loss
2023-04-18 15:31:29,752 # round-trip min/avg/max = 49.865/107.260/136.834 ms
08.interop: Task #6 - UDP between iotlab-m3 and Internet host through RIOT border router - PASS
socat UDP6-LISTEN:8000,reuseaddr,fork - | xxd
00000000: 0909 0909 0909 0909 0909 0909 0909 0909  ................
00000010: 0909 0909 0909 0909 0909 0909 0909 0909  ................
00000020: 0909 0909 0909 0909 0909 0909 0909 0909  ................
00000030: 0909 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a  ................
00000040: 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a  ................
00000050: 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a  ................
08.interop: Task #7 - UDP between iotlab-m3 and Internet host through RIOT border router (200b payload) - PASS
00000160: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c  ................
00000170: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c  ................
00000180: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c  ................
00000190: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c  ................
000001a0: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c  ................
000001b0: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c  ................
000001c0: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c  ................
000001d0: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c  ................
000001e0: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c  ................
000001f0: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c  ................
00000200: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c  ................
00000210: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c  ................
00000220: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c  ................
00000230: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c  ................
00000240: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c  ................

@jia200x
Copy link
Member

jia200x commented Apr 20, 2023

11.lorawan: Task #6 - GNRC LoRaWAN (ABP) - PASS
applicationID:"2"
applicationName:"ABP_dev"
deviceName:"abo"
devEUI:"6febd34b48df269e"
frequency:868100000
modulation:"LORA"

    bandwidth:125
    spreadingFactor:12
    codeRate:"4/5"
    polarizationInversion:false

adr:false
dr:0
fCnt:0
fPort:1
data:"aG9sYQ=="
objectJSON:""
tags:

        confirmedUplink:false
        devAddr:"01115654"
        publishedAt:"2023-04-20T08:22:03.285481486Z"

@benpicco
Copy link
Contributor

Task #12 - ICMPv6 echo between Border Router with WiFi uplink to named Internet host - PASS
2023-04-21 12:51:01,307 # > ifconfig
2023-04-21 12:51:01,311 # Iface  9  HWaddr: 3C:71:BF:9E:13:FD  Channel: 1 
2023-04-21 12:51:01,315 #           L2-PDU:249  MTU:1280  HL:64  RTR  
2023-04-21 12:51:01,319 #           RTR_ADV  6LO  Source address length: 6
2023-04-21 12:51:01,322 #           Link type: wireless
2023-04-21 12:51:01,327 #           inet6 addr: fe80::3e71:bfff:fe9e:13fd  scope: link  VAL
2023-04-21 12:51:01,334 #           inet6 addr: 2001:9e8:143a:24fa:3e71:bfff:fe9e:13fd  scope: global  VAL
2023-04-21 12:51:01,337 #           inet6 group: ff02::2
2023-04-21 12:51:01,340 #           inet6 group: ff02::1
2023-04-21 12:51:01,343 #           inet6 group: ff02::1:ff9e:13fd
2023-04-21 12:51:01,344 #           
2023-04-21 12:51:01,349 # Iface  10  HWaddr: 3C:71:BF:9E:13:FC  Channel: 1  Link: up 
2023-04-21 12:51:01,353 #           L2-PDU:1500  MTU:1492  HL:255  RTR  
2023-04-21 12:51:01,356 #           Source address length: 6
2023-04-21 12:51:01,359 #           Link type: wireless
2023-04-21 12:51:01,365 #           inet6 addr: fe80::3e71:bfff:fe9e:13fc  scope: link  VAL
2023-04-21 12:51:01,372 #           inet6 addr: 2001:9e8:143a:2400:3e71:bfff:fe9e:13fc  scope: global  VAL
2023-04-21 12:51:01,375 #           inet6 group: ff02::2
2023-04-21 12:51:01,377 #           inet6 group: ff02::1
2023-04-21 12:51:01,381 #           inet6 group: ff02::1:ff9e:13fc
2023-04-21 12:51:01,382 #           

2023-04-21 12:51:04,699 # > ping 2600::
2023-04-21 12:51:04,937 # 12 bytes from 2600::: icmp_seq=0 ttl=51 time=232.741 ms
2023-04-21 12:51:05,858 # 12 bytes from 2600::: icmp_seq=1 ttl=51 time=154.287 ms
2023-04-21 12:51:06,882 # 12 bytes from 2600::: icmp_seq=2 ttl=51 time=178.216 ms
2023-04-21 12:51:06,882 # 
2023-04-21 12:51:06,885 # --- 2600:: PING statistics ---
2023-04-21 12:51:06,890 # 3 packets transmitted, 3 packets received, 0% packet loss
2023-04-21 12:51:06,894 # round-trip min/avg/max = 154.287/188.414/232.741 ms

2023-04-21 12:51:09,651 # > ping riot-os.org
2023-04-21 12:51:09,753 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=0 ttl=58 time=42.622 ms
2023-04-21 12:51:10,753 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=1 ttl=58 time=42.776 ms
2023-04-21 12:51:11,753 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=2 ttl=58 time=42.527 ms
2023-04-21 12:51:11,753 # 
2023-04-21 12:51:11,756 # --- riot-os.org PING statistics ---
2023-04-21 12:51:11,761 # 3 packets transmitted, 3 packets received, 0% packet loss
2023-04-21 12:51:11,765 # round-trip min/avg/max = 42.527/42.641/42.776 ms

Task #13 - ICMPv6 echo between ESP and named Internet host through RIOT BR with 6LowPAN - PASS
2023-04-21 12:51:15,737 # Iface  11  HWaddr: 82:7D:3A:7F:E0:1D  Channel: 1 
2023-04-21 12:51:15,740 #           L2-PDU:249  MTU:1280  HL:64  RTR  
2023-04-21 12:51:15,746 #           RTR_ADV  6LO  Source address length: 6
2023-04-21 12:51:15,748 #           Link type: wireless
2023-04-21 12:51:15,754 #           inet6 addr: fe80::807d:3aff:fe7f:e01d  scope: link  VAL
2023-04-21 12:51:15,762 #           inet6 addr: 2001:9e8:143a:24fa:807d:3aff:fe7f:e01d  scope: global  VAL
2023-04-21 12:51:15,763 #           inet6 group: ff02::2
2023-04-21 12:51:15,765 #           inet6 group: ff02::1
2023-04-21 12:51:15,770 #           inet6 group: ff02::1:ff7f:e01d
2023-04-21 12:51:15,773 #           inet6 group: ff02::1a
2023-04-21 12:51:15,774 #           
2023-04-21 12:51:15,776 #           Statistics for Layer 2
2023-04-21 12:51:15,779 #             RX packets 0  bytes 0
2023-04-21 12:51:15,784 #             TX packets 0 (Multicast: 0)  bytes 450
2023-04-21 12:51:15,787 #             TX succeeded 5 errors 0
2023-04-21 12:51:15,790 #           Statistics for IPv6
2023-04-21 12:51:15,793 #             RX packets 5  bytes 432
2023-04-21 12:51:15,798 #             TX packets 9 (Multicast: 5)  bytes 658
2023-04-21 12:51:15,801 #             TX succeeded 9 errors 0
2023-04-21 12:51:15,801 # 

2023-04-21 12:51:22,980 # > ping 2600::
2023-04-21 12:51:23,171 # 12 bytes from 2600::: icmp_seq=0 ttl=50 time=183.903 ms
2023-04-21 12:51:24,195 # 12 bytes from 2600::: icmp_seq=1 ttl=50 time=208.327 ms
2023-04-21 12:51:25,217 # 12 bytes from 2600::: icmp_seq=2 ttl=50 time=231.953 ms
2023-04-21 12:51:25,218 # 
2023-04-21 12:51:25,220 # --- 2600:: PING statistics ---
2023-04-21 12:51:25,226 # 3 packets transmitted, 3 packets received, 0% packet loss
2023-04-21 12:51:25,231 # round-trip min/avg/max = 183.903/208.061/231.953 ms

2023-04-21 12:51:29,348 # > ping riot-os.org
2023-04-21 12:51:29,418 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=0 ttl=57 time=45.117 ms
2023-04-21 12:51:30,417 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=1 ttl=57 time=44.044 ms
2023-04-21 12:51:31,417 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=2 ttl=57 time=43.621 ms
2023-04-21 12:51:31,417 # 
2023-04-21 12:51:31,420 # --- riot-os.org PING statistics ---
2023-04-21 12:51:31,425 # 3 packets transmitted, 3 packets received, 0% packet loss
2023-04-21 12:51:31,429 # round-trip min/avg/max = 43.621/44.260/45.117 ms
% ping -c3 2001:9e8:143a:24fa:807d:3aff:fe7f:e01d
PING 2001:9e8:143a:24fa:807d:3aff:fe7f:e01d(2001:9e8:143a:24fa:807d:3aff:fe7f:e01d) 56 data bytes
64 bytes from 2001:9e8:143a:24fa:807d:3aff:fe7f:e01d: icmp_seq=1 ttl=63 time=113 ms
64 bytes from 2001:9e8:143a:24fa:807d:3aff:fe7f:e01d: icmp_seq=2 ttl=63 time=108 ms
64 bytes from 2001:9e8:143a:24fa:807d:3aff:fe7f:e01d: icmp_seq=3 ttl=63 time=59.3 ms

--- 2001:9e8:143a:24fa:807d:3aff:fe7f:e01d ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 59.276/93.236/112.523/24.087 ms

@MrKevinWeiss
Copy link
Contributor Author

Closing in favor of #282

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants