Some L2 PTF tests failures

[technobilly]

See below. Thanks.

chris@T1700-vbox-u14:~/sai/SAI-P4-BM/sai_adapter/test/ptf_tests$ sudo ./run_ptf_l2.sh
host_port1 0 1
host_port0 0 0
host_port7 0 7
host_port6 0 6
host_port5 0 5
host_port4 0 4
host_port3 0 3
host_port2 0 2
sail2.L2AccessToAccessVlanTest ...
Sending L2 packet port 1 -> port 2 [access vlan=10])
ok

---

Ran 1 test in 1.938s

OK
sail2.L2TrunkToTrunkVlanTest ...
Sending L2 packet - port 1 -> port 2 [trunk vlan=10])
ok

---

Ran 1 test in 1.048s

OK
sail2.L2AccessToTrunkVlanTest ...
Sending L2 packet - port 1 -> port 2 [trunk vlan=10])
ok

---

Ran 1 test in 0.948s

OK
sail2.L2TrunkToAccessVlanTest ...
Sending L2 packet - port 1 -> port 2 [trunk vlan=10])
FAIL

======================================================================
FAIL: sail2.L2TrunkToAccessVlanTest

Traceback (most recent call last):
File "tests_new/sail2.py", line 206, in runTest
verify_packets(self, exp_pkt, [1])
File "/home/chris/sai/SAI-P4-BM/sai_adapter/test/ptf_tests/ptf/src/ptf/testutils.py", line 2240, in verify_packets
verify_no_other_packets(test, device_number=device_number)
File "/home/chris/sai/SAI-P4-BM/sai_adapter/test/ptf_tests/ptf/src/ptf/testutils.py", line 2217, in verify_no_other_packets
test.assertTrue(rcv_pkt == None, "Unexpected packet on device %d, port %r" % (device_number, rcv_port))
AssertionError: Unexpected packet on device 0, port 0

---

Ran 1 test in 0.840s

FAILED (failures=1)
sail2.L2FloodTest ...
Flood test on ports 1, 2 and 3
FAIL

======================================================================
FAIL: sail2.L2FloodTest

Traceback (most recent call last):
File "tests_new/sail2.py", line 257, in runTest
verify_packets(self, exp_pkt, [1, 2])
File "/home/chris/sai/SAI-P4-BM/sai_adapter/test/ptf_tests/ptf/src/ptf/testutils.py", line 2240, in verify_packets
verify_no_other_packets(test, device_number=device_number)
File "/home/chris/sai/SAI-P4-BM/sai_adapter/test/ptf_tests/ptf/src/ptf/testutils.py", line 2217, in verify_no_other_packets
test.assertTrue(rcv_pkt == None, "Unexpected packet on device %d, port %r" % (device_number, rcv_port))
AssertionError: Unexpected packet on device 0, port 3

---

Ran 1 test in 0.727s

FAILED (failures=1)
sail2.L2LagTest ... FAIL

======================================================================
FAIL: sail2.L2LagTest

Traceback (most recent call last):
File "tests_new/sail2.py", line 333, in runTest
rcv_idx = verify_any_packet_any_port(self, [exp_pkt], [0, 1, 2])
File "/home/chris/sai/SAI-P4-BM/sai_adapter/test/ptf_tests/ptf/src/ptf/testutils.py", line 2337, in verify_any_packet_any_port
verify_no_other_packets(test, device_number=device_number)
File "/home/chris/sai/SAI-P4-BM/sai_adapter/test/ptf_tests/ptf/src/ptf/testutils.py", line 2217, in verify_no_other_packets
test.assertTrue(rcv_pkt == None, "Unexpected packet on device %d, port %r" % (device_number, rcv_port))
AssertionError: Unexpected packet on device 0, port 4

---

Ran 1 test in 0.339s

FAILED (failures=1)
sail2.L2VlanBcastUcastTest ... FAIL

======================================================================
FAIL: sail2.L2VlanBcastUcastTest

Traceback (most recent call last):
File "tests_new/sail2.py", line 433, in runTest
verify_packets(self, bcast_pkt, expected_ports)
File "/home/chris/sai/SAI-P4-BM/sai_adapter/test/ptf_tests/ptf/src/ptf/testutils.py", line 2240, in verify_packets
verify_no_other_packets(test, device_number=device_number)
File "/home/chris/sai/SAI-P4-BM/sai_adapter/test/ptf_tests/ptf/src/ptf/testutils.py", line 2217, in verify_no_other_packets
test.assertTrue(rcv_pkt == None, "Unexpected packet on device %d, port %r" % (device_number, rcv_port))
AssertionError: Unexpected packet on device 0, port 7

---

Ran 1 test in 0.560s

FAILED (failures=1)

---

ATTENTION: SOME TESTS DID NOT PASS!!!

The following tests failed:
L2TrunkToAccessVlanTest, L2FloodTest, L2LagTest, L2VlanBcastUcastTest

---

chris@T1700-vbox-u14:~/sai/SAI-P4-BM/sai_adapter/test/ptf_tests$ sudo ./run_ptf_l3.sh
WARNING: No route found for IPv6 destination :: (no default route?)
/usr/lib/python2.7/dist-packages/pkg_resources.py:1031: UserWarning: /home/chris/.python-eggs is writable by group/others and vulnerable to attack when used with get_resource_filename. Consider a more secure location (set with .set_extraction_path or the PYTHON_EGG_CACHE environment variable).
warnings.warn(msg, UserWarning)
host_port1 0 1
host_port0 0 0
host_port7 0 7
host_port6 0 6
host_port5 0 5
host_port4 0 4
host_port3 0 3
host_port2 0 2
sail3.L3IPv4HostTest ...
Sending packet port 1 -> port 2 (192.168.0.1 -> 10.10.10.1 [id = 101])
ok

---

Ran 1 test in 0.896s

OK

[YonatanPitz]

Hi,
All L2 ptf tests pass for me, I'm pretty sure some mDNS IPv6 packet sent from a daemon to the switch, caused the ptf test to fail. For now, I disabled IPv6 in all veths inside veth_setup.sh and veth_setup_ptf.sh scripts, please try running them again, and see if this fixes the issue.

Thanks,
Yonatan

[technobilly]

Yonatan, I finally got to retest the L2 tests and it passed. I agree the mDNS IPv6 packets were likely the culprit. Thanks, Chris