Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[github-actions] run Thread 1.1 cert tests for 1.2 build #5547

Merged
merged 2 commits into from Sep 25, 2020

Conversation

simonlingoogle
Copy link
Member

@simonlingoogle simonlingoogle commented Sep 18, 2020

This PR runs Thread 1.1 certification tests with packet verification for 1.2 build because Thread 1.2 certified devices are supposed to be able to pass Thread 1.1 certification first.

Note: changes to test TOPOLOGY:

  • Original: nodes use version=1.1 by default
  • Now: nodes use version according to ENV, except explicitly specified

@size-report
Copy link

size-report bot commented Sep 18, 2020

Size Report of OpenThread

Merging #5547 into master(3820c3b).

name branch text data bss total
ot-cli-ftd_1.1 master 396224 736 72724 469684
#5547 396224 736 72724 469684
+/- 0 0 0 0
ot-cli-mtd_1.1 master 320336 736 64140 385212
#5547 320336 736 64140 385212
+/- 0 0 0 0
ot-ncp-ftd_1.1 master 389712 736 72012 462460
#5547 389712 736 72012 462460
+/- 0 0 0 0
ot-ncp-mtd_1.1 master 317056 736 63428 381220
#5547 317056 736 63428 381220
+/- 0 0 0 0
ot-rcp_1.1 master 63976 636 7512 72124
#5547 63976 636 7512 72124
+/- 0 0 0 0
libopenthread-cli-ftd.a_1.1 master 38867 0 3100 41967
#5547 38867 0 3100 41967
+/- 0 0 0 0
libopenthread-cli-mtd.a_1.1 master 31351 0 3100 34451
#5547 31351 0 3100 34451
+/- 0 0 0 0
libopenthread-ftd.a_1.1 master 194271 4 55020 249295
#5547 194271 4 55020 249295
+/- 0 0 0 0
libopenthread-mtd.a_1.1 master 131793 4 46436 178233
#5547 131793 4 46436 178233
+/- 0 0 0 0
libopenthread-ncp-ftd.a_1.1 master 48044 0 2388 50432
#5547 48044 0 2388 50432
+/- 0 0 0 0
libopenthread-ncp-mtd.a_1.1 master 43236 0 2388 45624
#5547 43236 0 2388 45624
+/- 0 0 0 0
libopenthread-rcp.a_1.1 master 27069 0 1532 28601
#5547 27069 0 1532 28601
+/- 0 0 0 0
libopenthread-radio.a_1.1 master 12398 0 150 12548
#5547 12398 0 150 12548
+/- 0 0 0 0
ot-cli-ftd_1.2 master 417128 736 81412 499276
#5547 417128 736 81412 499276
+/- 0 0 0 0
ot-cli-mtd_1.2 master 329112 736 64332 394180
#5547 329112 736 64332 394180
+/- 0 0 0 0
ot-ncp-ftd_1.2 master 408296 736 80700 489732
#5547 408296 736 80700 489732
+/- 0 0 0 0
ot-ncp-mtd_1.2 master 324936 736 63620 389292
#5547 324936 736 63620 389292
+/- 0 0 0 0
ot-rcp_1.2 master 74732 636 16316 91684
#5547 74732 636 16316 91684
+/- 0 0 0 0
libopenthread-cli-ftd.a_1.2 master 40259 0 3100 43359
#5547 40259 0 3100 43359
+/- 0 0 0 0
libopenthread-cli-mtd.a_1.2 master 31823 0 3100 34923
#5547 31823 0 3100 34923
+/- 0 0 0 0
libopenthread-ftd.a_1.2 master 213550 4 63652 277206
#5547 213550 4 63652 277206
+/- 0 0 0 0
libopenthread-mtd.a_1.2 master 139764 4 46572 186340
#5547 139764 4 46572 186340
+/- 0 0 0 0
libopenthread-ncp-ftd.a_1.2 master 48044 0 2388 50432
#5547 48044 0 2388 50432
+/- 0 0 0 0
libopenthread-ncp-mtd.a_1.2 master 43236 0 2388 45624
#5547 43236 0 2388 45624
+/- 0 0 0 0
libopenthread-rcp.a_1.2 master 27069 0 1532 28601
#5547 27069 0 1532 28601
+/- 0 0 0 0
libopenthread-radio.a_1.2 master 13090 0 150 13240
#5547 13090 0 150 13240
+/- 0 0 0 0

@codecov
Copy link

codecov bot commented Sep 18, 2020

Codecov Report

Merging #5547 into master will decrease coverage by 0.03%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #5547      +/-   ##
==========================================
- Coverage   84.35%   84.31%   -0.04%     
==========================================
  Files         366      366              
  Lines       45728    45766      +38     
==========================================
+ Hits        38574    38589      +15     
- Misses       7154     7177      +23     
Impacted Files Coverage Δ
src/core/mac/data_poll_handler.cpp 84.74% <0.00%> (-5.94%) ⬇️
src/core/utils/channel_manager.cpp 82.22% <0.00%> (-4.45%) ⬇️
src/core/backbone_router/backbone_tmf.cpp 16.66% <0.00%> (-1.52%) ⬇️
src/core/mac/data_poll_sender.cpp 92.82% <0.00%> (-1.44%) ⬇️
src/core/thread/time_sync_service.cpp 96.15% <0.00%> (-1.29%) ⬇️
src/core/thread/mesh_forwarder.cpp 91.79% <0.00%> (-1.15%) ⬇️
src/lib/spinel/radio_spinel_impl.hpp 85.75% <0.00%> (-0.97%) ⬇️
src/core/thread/mesh_forwarder_ftd.cpp 87.56% <0.00%> (-0.51%) ⬇️
src/core/coap/coap.cpp 90.66% <0.00%> (-0.45%) ⬇️
src/core/thread/mle.cpp 87.73% <0.00%> (-0.11%) ⬇️
... and 15 more

@jwhui jwhui merged commit 2daa097 into openthread:master Sep 25, 2020
@simonlingoogle simonlingoogle deleted the cert-1.2 branch September 25, 2020 03:16
simonlingoogle pushed a commit to simonlingoogle/openthread that referenced this pull request Nov 12, 2020
Bug: 170600902

* origin/github/master:
  [indirect-sender] remove existing supervision msg on new msg add (openthread#5638)
  [cmd-parser] remove dependency of <limits> (openthread#5636)
  [docs] update BBB guide formatting (openthread#5637)
  [posix] map address with rtnetlink API on Linux (openthread#5629)
  [expect] refactor common functions (openthread#5634)
  [bootstrap] fix link to clang-format-10 (openthread#5633)
  [thread-cert] set node addr64 to EXTENDED_ADDRESS_BASE + nodeid (openthread#5601)
  [thread-cert] refactor case 9.2.7 using pktverify (openthread#5459)
  [thread-cert] refactor case 5.5.3 using pktverify (openthread#5448)
  [tests] init joiner with different masterkey before start (openthread#5626)
  [cmake] avoid recompiling common sources multiple times (openthread#5623)
  [cmake] replace mbedcrypto with ${OT_MBEDTLS} (openthread#5622)
  [cmake] add build options for FTD, MTD, and RCP (openthread#5622)
  [toranj] add new test-case covering joiner-router behavior (openthread#5621)
  [thread-cert] enhance case 9.2.4 to avoid reverifying coap retransmission packets (openthread#5614)
  [low-power] add cli command macsend for certification (openthread#5573)
  [codecov] disable project coverage threshold (openthread#5631)
  [cli] add cli command to control child supervision (openthread#5620)
  [commissioner] specify src for c/tx (openthread#5625)
  [cmd-parser] adding helper 'ParseAs{Type}' function (openthread#5607)
  [logging] update 'otDump' to use 'ot::String' (openthread#5618)
  [cli] replace 'PRIx64' use (openthread#5615)
  [scan-build] update to clang-tools-10 (openthread#5617)
  [clang-format] update to clang-format-10 (openthread#5616)
  [docs] update BeagleBone setup guide (openthread#5606)
  [script] fix arm-gcc toolchain install on ubuntu (openthread#5613)
  [github-actions] fix expect check (openthread#5610)
  [ip6] use 'Get<Filter>()' (remove unnecessary namespace) (openthread#5605)
  [message] add new flavors of Read/Write/Append/Prepend methods (openthread#5604)
  [cli] add new helper 'ParseIp6Prefix()' (openthread#5603)
  [utils] adding 'LookupTable' class and use it in CLI (openthread#5602)
  [docs] add source for BeagleBone Black guide (openthread#5593)
  [nrf_security] use vanilla mbedtls only for AES (openthread#5596)
  [mlr] send BMLR.ntf on Backbone link (openthread#5388)
  [thread-cert] enhance case 9.2.18 for SED packet order (openthread#5584)
  [cli] do not pass user-controlled input as format string (openthread#5599)
  [github-actions] use docker/setup-buildx-action@v1 (openthread#5600)
  [thread-cert] enhance case 9.2.10 for MED packets order (openthread#5598)
  [thread-cert] enhance case 5.6.6 for potential SED packet out-of-order (openthread#5597)
  [thread-cert] enhance case 9.2.4 (openthread#5590)
  [mle] remove secure data request mode bit (openthread#5560)
  [cli] add 'OutputExtAddress()' helper method (openthread#5591)
  [linked-list] fix spelling for Indicator typename (openthread#5592)
  [cli] style fixes and smaller enhancements (openthread#5581)
  [continuous-integration] fix API change detector (openthread#5589)
  [dua] handle coap error code for DUA.rsp (openthread#5523)
  [scripts] fix test_route_table.py fails by chance (openthread#5580)
  [dua] handle AddressError (openthread#5516)
  [pktverify] verify offline test info (openthread#5525)
  [scripts] fix test_route_table.py (openthread#5558)
  [low-power] implement link metrics - single probe (openthread#5481)
  [codecov] only post coverage check statuses to PRs (openthread#5575)
  [github-actions] fix thread-wireshark missing (openthread#5577)
  [reference-device] send fake ADDR_NTF.ntf (openthread#5537)
  [thread-cert] Thread 1.2 CI with OTBR and Backbone link (openthread#5489)
  [github-actions] run Thread 1.1 cert tests for 1.2 build (openthread#5547)
  [message] add helper macros to free message (on error) (openthread#5555)
  [docs] add style guide for documentation contributions (openthread#5567)
  [script] fix output when no arguments are specified (openthread#5551)
  [thread-cert] add low power case 6_1_07 (openthread#5557)
  [gn] add missing files to BUILD.gn (openthread#5564)
  [style] fix warnings -Wextra-semi (openthread#5566)
  [thread-cert] refactor case 9.2.4 using pktverify (openthread#5412)
Change-Id: I9024ef8b7780db9f28a5815103423ffcdd57a8c3
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants