chore: Publish test results for the Bazel integration and sudo tests #13984

vktng · 2022-09-21T14:43:16Z

Signed-off-by: Krisztián Varga krisztian.varga@tngtech.com

Summary

The test results were not published before for Bazel LTE integ tests, LTE integ test magma-deb and the Sudo python tests workflows. These results are published in the LTE integ tests workflow and make it a lot easier to see the outcome of the tests.
This PR also includes an update for the publish action, from v1.37 to v2.0. This change affects the Federated integ tests, CWF integ tests and LTE integ tests workflows additionally.

Test Plan

CI.
Runs on fork: #13984 (comment)

Additional Information

This change is backwards-breaking

github-actions · 2022-09-21T14:43:29Z

Thanks for opening a PR! 💯

A couple initial guidelines

All commits must be signed off. This is enforced by DCO check.
All PR titles must follow the semantic commits format. This is enforced by Semantic PR.

Howto

Reviews. The "Reviewers" listed for this PR are the Magma maintainers who will shepherd it.
Checks. All required CI checks must pass before merge.
Merge. Once approved and passing CI checks, use the ready2merge label to indicate the maintainers can merge your PR.

More info

Please take a moment to read through the Magma project's

Contributing Conventions for norms around contributed code

If this is your first Magma PR, also consider reading

Developer Onboarding for onboarding as a new Magma developer
Development Workflow for guidance on your first pull request
CI Checks for points of contact for failing or flaky CI checks
GitHub-to-Slack mappings for Magma maintainers for guidance on how to contact maintainers on Slack

github-actions · 2022-09-21T14:44:48Z

dp-workflow

14 tests 14 ✔️ 2m 23s ⏱️
  1 suites   0 💤
  1 files   0 ❌

Results for commit e70ea60.

♻️ This comment has been updated with latest results.

vktng · 2022-09-21T14:47:54Z

Sudo tests: https://github.com/vktng/magma/actions/runs/3098776271/jobs/5017098974
Integration tests: https://github.com/vktng/magma/actions/runs/3098762761/jobs/5017068627

vktng · 2022-09-22T09:06:19Z

Most of the tests removed for quicker results:
Integ tests: https://github.com/vktng/magma/actions/runs/3104174975/jobs/5028343096
Sudo tests: https://github.com/vktng/magma/actions/runs/3104185423/jobs/5028366647

github-actions · 2022-09-22T09:14:10Z

feg-workflow

    2 files 203 suites 40s ⏱️
374 tests 374 ✔️ 0 💤 0 ❌
388 runs 388 ✔️ 0 💤 0 ❌

Results for commit e70ea60.

♻️ This comment has been updated with latest results.

github-actions · 2022-09-22T10:05:26Z

agw-workflow

615 tests 611 ✔️ 3m 48s ⏱️
    2 suites     4 💤
    2 files     0 ❌

Results for commit e70ea60.

♻️ This comment has been updated with latest results.

vktng · 2022-09-22T10:33:28Z

Test run 3:
Bazel integ tests: https://github.com/vktng/magma/actions/runs/3104736796/jobs/5029548884
Debian integ tests: https://github.com/vktng/magma/actions/runs/3104739382/jobs/5029554391
Sudo tests: https://github.com/vktng/magma/actions/runs/3104742197/jobs/5029560642

vktng · 2022-09-22T11:56:30Z

Test run 4:
Bazel integ tests: https://github.com/vktng/magma/actions/runs/3105239651/jobs/5030613085
Debian integ tests: https://github.com/vktng/magma/actions/runs/3105243507/jobs/5030622194
Sudo tests: https://github.com/vktng/magma/actions/runs/3105247764/jobs/5030630943

vktng · 2022-09-22T15:30:00Z

Test run 5:
Bazel integ tests: https://github.com/vktng/magma/actions/runs/3106731167/jobs/5033974877
Debian integ tests: https://github.com/vktng/magma/actions/runs/3106734857/jobs/5033982699
Sudo tests: https://github.com/vktng/magma/actions/runs/3106738096/jobs/5034803885

vktng · 2022-09-22T18:26:24Z

Test run 6:
Bazel integ tests: https://github.com/vktng/magma/actions/runs/3107820566/jobs/5036344939
Debian integ tests: https://github.com/vktng/magma/actions/runs/3107823658/jobs/5036351512
Sudo tests: https://github.com/vktng/magma/actions/runs/3107826667/jobs/5036357649

vktng · 2022-09-23T10:08:04Z

Test run 7 (reverting publish action version back to 1.37):
Bazel integ tests: https://github.com/vktng/magma/actions/runs/3111945040/jobs/5044816730
Debian integ tests: https://github.com/vktng/magma/actions/runs/3111949416/jobs/5044825880
Sudo tests: https://github.com/vktng/magma/actions/runs/3111953544/jobs/5044834744

vktng · 2022-09-23T13:23:10Z

Test run 8 (reverting publish action version back to 2.00, the bug is present in both versions):
LTE integ tests: https://github.com/vktng/magma/actions/runs/3113041627/jobs/5047169848
Bazel integ tests: https://github.com/vktng/magma/actions/runs/3113057894/jobs/5047209358
Debian integ tests: https://github.com/vktng/magma/actions/runs/3113045227/jobs/5047178241
Sudo tests: https://github.com/vktng/magma/actions/runs/3113050150/jobs/5047190980

All in one place summary: https://github.com/vktng/magma/runs/8516421289

.github/workflows/lte-integ-test-bazel.yml

vktng · 2022-09-26T09:45:49Z

Test run 9 (reverting the testing commit, now all of the tests are run):
LTE integ tests: https://github.com/vktng/magma/actions/runs/3126688910/jobs/5072474383
Bazel integ tests: https://github.com/vktng/magma/actions/runs/3126694941/jobs/5072487306
Debian integ tests: https://github.com/vktng/magma/actions/runs/3126698560/jobs/5072495242
Sudo tests: https://github.com/vktng/magma/actions/runs/3126702908/jobs/5072504431
Federated integ tests: https://github.com/vktng/magma/actions/runs/3126707013/jobs/5072513817
CWF integ tests: https://github.com/vktng/magma/actions/runs/3126713819

All in one place summary: https://github.com/vktng/magma/runs/8552252476

vktng · 2022-09-27T10:02:06Z

Test run 10 (removed report_individual_runs = "true"):
LTE integ tests: https://github.com/vktng/magma/actions/runs/3134670991/jobs/5089476796
Bazel integ tests: https://github.com/vktng/magma/actions/runs/3134674804/jobs/5089485295
Debian integ tests: https://github.com/vktng/magma/actions/runs/3134679692/jobs/5089495453
Sudo tests: https://github.com/vktng/magma/actions/runs/3134683154/jobs/5089501962
Federated integ tests: https://github.com/vktng/magma/actions/runs/3134687031/jobs/5089510647
CWF integ tests: https://github.com/vktng/magma/actions/runs/3134691574

All in one place summary: TBD

.github/workflows/federated-integ-test.yml

bazel/scripts/run_integ_tests.sh

…sudo tests Signed-off-by: Krisztián Varga <krisztian.varga@tngtech.com>

nstng

lgtm

…sudo tests (magma#13984) Signed-off-by: Krisztián Varga <krisztian.varga@tngtech.com> Signed-off-by: Krisztián Varga <krisztian.varga@tngtech.com>

vktng added component: ci All updates on CI (Jenkins/CircleCi/Github Action) bazel changes for the Bazelification effort labels Sep 21, 2022

vktng self-assigned this Sep 21, 2022

pull-request-size bot added the size/S Denotes a PR that changes 10-29 lines. label Sep 21, 2022

vktng linked an issue Sep 21, 2022 that may be closed by this pull request

Publish xml test results in LTE integ test bazel workflow #13717

Closed

vktng force-pushed the publish_integ_and_sudo_test_results branch 2 times, most recently from 6b7bf31 to 9d5423b Compare September 22, 2022 09:03

pull-request-size bot added size/L Denotes a Pull Request that changes 100-499 lines. and removed size/S Denotes a PR that changes 10-29 lines. labels Sep 22, 2022

github-actions bot added the component: agw Access gateway-related issue label Sep 22, 2022

vktng force-pushed the publish_integ_and_sudo_test_results branch from 9d5423b to 8e3be74 Compare September 22, 2022 10:30

vktng force-pushed the publish_integ_and_sudo_test_results branch from 8e3be74 to 79b8c72 Compare September 22, 2022 11:53

vktng force-pushed the publish_integ_and_sudo_test_results branch from 79b8c72 to f13dd9c Compare September 22, 2022 15:26

vktng force-pushed the publish_integ_and_sudo_test_results branch from f13dd9c to d48cbb6 Compare September 22, 2022 18:24

vktng mentioned this pull request Sep 23, 2022

Publish xml test results in LTE integ test bazel workflow #13717

Closed

vktng force-pushed the publish_integ_and_sudo_test_results branch from d48cbb6 to a5f1661 Compare September 23, 2022 10:05

vktng force-pushed the publish_integ_and_sudo_test_results branch from a5f1661 to d41bb2e Compare September 23, 2022 13:18

nstng reviewed Sep 26, 2022

View reviewed changes

.github/workflows/lte-integ-test-bazel.yml Outdated Show resolved Hide resolved

nstng reviewed Sep 26, 2022

View reviewed changes

.github/workflows/lte-integ-test-bazel.yml Outdated Show resolved Hide resolved

vktng force-pushed the publish_integ_and_sudo_test_results branch from d41bb2e to b4a570b Compare September 26, 2022 09:27

vktng marked this pull request as ready for review September 26, 2022 17:38

vktng requested a review from a team September 26, 2022 17:38

vktng requested review from a team as code owners September 26, 2022 17:38

vktng requested review from nstng and pshelar September 26, 2022 17:38

ajahl approved these changes Sep 27, 2022

View reviewed changes

vktng force-pushed the publish_integ_and_sudo_test_results branch from b4a570b to 753474a Compare September 27, 2022 09:52

nstng reviewed Sep 27, 2022

View reviewed changes

.github/workflows/federated-integ-test.yml Outdated Show resolved Hide resolved

nstng reviewed Sep 27, 2022

View reviewed changes

bazel/scripts/run_integ_tests.sh Outdated Show resolved Hide resolved

nstng reviewed Sep 27, 2022

View reviewed changes

bazel/scripts/run_integ_tests.sh Show resolved Hide resolved

vktng force-pushed the publish_integ_and_sudo_test_results branch from 753474a to 171f39d Compare September 27, 2022 12:55

chore: Publish test results for the Bazel and Debian integration and …

e70ea60

…sudo tests Signed-off-by: Krisztián Varga <krisztian.varga@tngtech.com>

vktng force-pushed the publish_integ_and_sudo_test_results branch from 171f39d to e70ea60 Compare September 27, 2022 12:56

nstng self-requested a review September 27, 2022 12:59

nstng approved these changes Sep 27, 2022

View reviewed changes

vktng merged commit 9a01c50 into magma:master Sep 27, 2022

nstng mentioned this pull request Sep 28, 2022

fix: boolean arguments in fabric calls are interpreted correctly #14030

Merged

1 task

voisey mentioned this pull request Oct 4, 2022

Publish xml test results in debian LTE integ test workflow #13999

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

chore: Publish test results for the Bazel integration and sudo tests #13984

chore: Publish test results for the Bazel integration and sudo tests #13984

vktng commented Sep 21, 2022 •

edited

github-actions bot commented Sep 21, 2022

github-actions bot commented Sep 21, 2022 •

edited

vktng commented Sep 21, 2022

vktng commented Sep 22, 2022 •

edited

github-actions bot commented Sep 22, 2022 •

edited

github-actions bot commented Sep 22, 2022 •

edited

vktng commented Sep 22, 2022

vktng commented Sep 22, 2022

vktng commented Sep 22, 2022 •

edited

vktng commented Sep 22, 2022

vktng commented Sep 23, 2022

vktng commented Sep 23, 2022 •

edited

vktng commented Sep 26, 2022 •

edited

vktng commented Sep 27, 2022

nstng left a comment

chore: Publish test results for the Bazel integration and sudo tests #13984

chore: Publish test results for the Bazel integration and sudo tests #13984

Conversation

vktng commented Sep 21, 2022 • edited

Summary

Test Plan

Additional Information

github-actions bot commented Sep 21, 2022

Howto

More info

github-actions bot commented Sep 21, 2022 • edited

dp-workflow

vktng commented Sep 21, 2022

vktng commented Sep 22, 2022 • edited

github-actions bot commented Sep 22, 2022 • edited

feg-workflow

github-actions bot commented Sep 22, 2022 • edited

agw-workflow

vktng commented Sep 22, 2022

vktng commented Sep 22, 2022

vktng commented Sep 22, 2022 • edited

vktng commented Sep 22, 2022

vktng commented Sep 23, 2022

vktng commented Sep 23, 2022 • edited

vktng commented Sep 26, 2022 • edited

vktng commented Sep 27, 2022

nstng left a comment

Choose a reason for hiding this comment

vktng commented Sep 21, 2022 •

edited

github-actions bot commented Sep 21, 2022 •

edited

vktng commented Sep 22, 2022 •

edited

github-actions bot commented Sep 22, 2022 •

edited

github-actions bot commented Sep 22, 2022 •

edited

vktng commented Sep 22, 2022 •

edited

vktng commented Sep 23, 2022 •

edited

vktng commented Sep 26, 2022 •

edited