[tests/mclag] Submit mclag testcases according to mclagtest plan #1237

freeman386 · 2019-11-26T09:23:44Z

Description of PR

Summary:
Submit MCLAG testcases according to mclag test plan [Azure/SONiC/pull/422].

It works together with below PRs:

MCLAG feature for SONIC [Azure/sonic-buildimage/pull/2514]

Type of change

[] Bug fix
[] Testbed and Framework(new/improvement)
Test case(new/improvement)

Approach

How did you do it?

mclag test on test_scenario L2

root@sonic-mgmt:/var/root/sonic-mgmt-main/tests# pytest -vvv --disable_loganalyzer --inventory veos --host-pattern all --user admin --testbed vms-t0-mclag-16 --testbed_file testbed.csv   --show-capture=stdout  test_mclag.py                                   
========================================================================================================= test session starts =========================================================================================================
platform linux2 -- Python 2.7.12, pytest-4.6.3, py-1.8.0, pluggy-0.12.0 -- /usr/bin/python
cachedir: .pytest_cache
ansible: 2.0.0.2
rootdir: /var/root/sonic-mgmt-main/tests, inifile: pytest.ini
plugins: repeat-0.8.0, ansible-2.0.2
collected 56 items                                                                                                                                                                                                                    

test_mclag.py::TestCase1_VerifyMclagStatus::test_check_keepalive_link PASSED
test_mclag.py::TestCase1_VerifyMclagStatus::test_check_teamd_system_id PASSED
test_mclag.py::TestCase1_VerifyMclagStatus::test_traffic_between_servers PASSED
test_mclag.py::TestCase1_VerifyMclagStatus::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase2_MclagMemberPortStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase2_MclagMemberPortStatusChange::test_mclag_member_port_down PASSED
test_mclag.py::TestCase2_MclagMemberPortStatusChange::test_mclag_member_port_up PASSED
test_mclag.py::TestCase2_MclagMemberPortStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase3_PeerLinkStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase3_PeerLinkStatusChange::test_peer_link_interface_down PASSED
test_mclag.py::TestCase3_PeerLinkStatusChange::test_syncheck_on_mclag_interface[syncheck0] PASSED
test_mclag.py::TestCase3_PeerLinkStatusChange::test_peer_link_interface_up PASSED
test_mclag.py::TestCase3_PeerLinkStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase4_KeepaliveLinkStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase4_KeepaliveLinkStatusChange::test_keepalive_link_down PASSED
test_mclag.py::TestCase4_KeepaliveLinkStatusChange::test_keepalive_link_up PASSED
test_mclag.py::TestCase4_KeepaliveLinkStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase5_PeerKeepaliveBothStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase5_PeerKeepaliveBothStatusChange::test_peer_keepalive_link_down PASSED
test_mclag.py::TestCase5_PeerKeepaliveBothStatusChange::test_peer_keepalive_link_up PASSED
test_mclag.py::TestCase5_PeerKeepaliveBothStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase6_ActiveDevStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase6_ActiveDevStatusChange::test_active_down PASSED
test_mclag.py::TestCase6_ActiveDevStatusChange::test_active_up PASSED
test_mclag.py::TestCase6_ActiveDevStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase7_StandbyDevStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase7_StandbyDevStatusChange::test_standby_down PASSED
test_mclag.py::TestCase7_StandbyDevStatusChange::test_standby_up PASSED
test_mclag.py::TestCase7_StandbyDevStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase8_ActiveDevWarmreboot::test_traffic_between_servers PASSED
test_mclag.py::TestCase8_ActiveDevWarmreboot::test_traffic_during_warmreboot PASSED
test_mclag.py::TestCase8_ActiveDevWarmreboot::test_syncheck_after_warmreboot[syncheck0] PASSED
test_mclag.py::TestCase9_StandbyDevWarmreboot::test_traffic_between_servers PASSED
test_mclag.py::TestCase9_StandbyDevWarmreboot::test_traffic_during_warmreboot PASSED
test_mclag.py::TestCase9_StandbyDevWarmreboot::test_syncheck_after_warmreboot[syncheck0] PASSED
test_mclag.py::TestCase10_MacFlapping::test_traffic_before_mac_flapping PASSED
test_mclag.py::TestCase10_MacFlapping::test_syncheck_before_mac_flapping[syncheck0] PASSED
test_mclag.py::TestCase10_MacFlapping::test_mac_flapping PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_traffic_between_servers PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_after_mclag_member_port_down PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_after_mclag_member_port_up PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_traffic_between_servers_after_mclag_member_port_up PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_after_traffic_between_servers PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_before_age PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mac_aging_on_peer PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_after_aging PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_relearn_after_mac_age PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_after_relearn PASSED
test_mclag.py::TestCase12_ICCP_CSM::test_active_restart PASSED
test_mclag.py::TestCase12_ICCP_CSM::test_standby_restart PASSED
test_mclag.py::TestCase13_Scaling::test_traffic_between_servers PASSED
test_mclag.py::TestCase13_Scaling::test_mac_arp_sync PASSED
test_mclag.py::TestCase14_CornerTest::test_stop_teamd_on_active PASSED
test_mclag.py::TestCase14_CornerTest::test_start_teamd_on_active PASSED
test_mclag.py::TestCase14_CornerTest::test_stop_teamd_on_standby PASSED
test_mclag.py::TestCase14_CornerTest::test_start_teamd_on_standby PASSED
============================================================================================== 56 passed, 1 warnings in 5459.90 seconds ===============================================================================================

mclag test on test_scenario L3

root@sonic-mgmt:/var/root/sonic-mgmt-main/tests# pytest -vvv --disable_loganalyzer --inventory veos --host-pattern all --user admin --testbed vms-t0-mclag-16 --testbed_file testbed.csv --show-capture=stdout test_mclag_l3.py
========================================================================================================= test session starts =========================================================================================================
platform linux2 -- Python 2.7.12, pytest-4.6.3, py-1.8.0, pluggy-0.12.0 -- /usr/bin/python
cachedir: .pytest_cache
ansible: 2.0.0.2
rootdir: /var/root/sonic-mgmt-main/tests, inifile: pytest.ini
plugins: repeat-0.8.0, ansible-2.0.2
collected 24 items                                                                                                                                                                                                                    

test_mclag_l3.py::TestCase1_VerifyMclagStatus::test_check_keepalive_link PASSED
test_mclag_l3.py::TestCase1_VerifyMclagStatus::test_check_teamd_system_id PASSED
test_mclag_l3.py::TestCase1_VerifyMclagStatus::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase1_VerifyMclagStatus::test_syncheck PASSED
test_mclag_l3.py::TestCase2_MclagMemberPortStatusChange::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase2_MclagMemberPortStatusChange::test_mclag_member_port_down PASSED
test_mclag_l3.py::TestCase2_MclagMemberPortStatusChange::test_mclag_member_port_up PASSED
test_mclag_l3.py::TestCase3_KeepaliveLinkStatusChange::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase3_KeepaliveLinkStatusChange::test_keepalive_link_down PASSED
test_mclag_l3.py::TestCase3_KeepaliveLinkStatusChange::test_keepalive_link_up PASSED
test_mclag_l3.py::TestCase4_ActiveDevStatusChange::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase4_ActiveDevStatusChange::test_active_down PASSED
test_mclag_l3.py::TestCase4_ActiveDevStatusChange::test_active_up PASSED
test_mclag_l3.py::TestCase5_StandbyDevStatusChange::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase5_StandbyDevStatusChange::test_standby_down PASSED
test_mclag_l3.py::TestCase5_StandbyDevStatusChange::test_standby_up PASSED
test_mclag_l3.py::TestCase6_ActiveDevWarmreboot::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase6_ActiveDevWarmreboot::test_traffic_during_warmreboot PASSED
test_mclag_l3.py::TestCase6_ActiveDevWarmreboot::test_syncheck PASSED
test_mclag_l3.py::TestCase7_StandbyDevWarmreboot::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase7_StandbyDevWarmreboot::test_traffic_during_warmreboot PASSED
test_mclag_l3.py::TestCase7_StandbyDevWarmreboot::test_syncheck PASSED
test_mclag_l3.py::TestCase8_Scaling::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase8_Scaling::test_syncheck PASSED

========================================================================================================== warnings summary ===========================================================================================================
test_mclag_l3.py::TestCase1_VerifyMclagStatus::test_check_keepalive_link
  /usr/local/lib/python2.7/dist-packages/pytest_ansible/module_dispatcher/v2.py:70: UserWarning: provided hosts list is empty, only localhost is available
    warnings.warn("provided hosts list is empty, only localhost is available")

-- Docs: https://docs.pytest.org/en/latest/warnings.html
============================================================================================== 24 passed, 1 warnings in 2198.84 seconds ===============================================================================================

Supported testbed topology if it's a new test case?

According test plan, we build mclag topo based on topo-t0, supported for topo_t0-mclag(which has 32 dut ports) and topo_t0-mclag-16(which has 16 dut ports).

Documentation

https://github.com/shine4chen/SONiC/blob/mclag-test-case/doc/mclag_hld/MCLAG-ansible-test-plan.md

add pytest enter point files

msftclas · 2019-11-26T09:23:57Z

All CLA requirements met.

freeman386 · 2019-11-26T09:35:45Z

We will add deploy mclag topo PR to required PRs later

Signed-off-by: Danny Allen <daall@microsoft.com>

…#1237)" (sonic-net#1308) This reverts commit ae1daf3.

freeman386 and others added 5 commits November 26, 2019 15:22

Add files via upload

59c9c18

add pytest enter point files

add mclag topo files based on topo-t0

9b020f0

add mclag pytest files

b702415

link arp_responder files to ansible files

4753680

add mclag topo vars and add module_dir to be called in pytest

17d1404

freeman386 closed this Nov 26, 2019

vadymhlushko-mlnx pushed a commit to vadymhlushko-mlnx/sonic-mgmt that referenced this pull request Mar 15, 2021

[portsorch] Enable port-level buffer drop counters (sonic-net#1237)

ae1daf3

Signed-off-by: Danny Allen <daall@microsoft.com>

vadymhlushko-mlnx pushed a commit to vadymhlushko-mlnx/sonic-mgmt that referenced this pull request Mar 15, 2021

Revert "[portsorch] Enable port-level buffer drop counters (sonic-net…

a3a010a

…#1237)" (sonic-net#1308) This reverts commit ae1daf3.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[tests/mclag] Submit mclag testcases according to mclagtest plan #1237

[tests/mclag] Submit mclag testcases according to mclagtest plan #1237

freeman386 commented Nov 26, 2019

msftclas commented Nov 26, 2019 •

edited

Loading

freeman386 commented Nov 26, 2019

[tests/mclag] Submit mclag testcases according to mclagtest plan #1237

[tests/mclag] Submit mclag testcases according to mclagtest plan #1237

Conversation

freeman386 commented Nov 26, 2019

Description of PR

Type of change

Approach

How did you do it?

Supported testbed topology if it's a new test case?

Documentation

msftclas commented Nov 26, 2019 • edited Loading

freeman386 commented Nov 26, 2019

msftclas commented Nov 26, 2019 •

edited

Loading