CI: Conformance Gateway API: TestConformance/HTTPRouteHostnameIntersection

[bimmlerd]

CI failure

Link: https://github.com/cilium/cilium/actions/runs/8173644758/job/22346554961
Sysdump: cilium-sysdump-out-false-experimental.zip

--- FAIL: TestConformance/HTTPRouteHostnameIntersection (47.37s)
        --- FAIL: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames (0.05s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/23_request_to_'very.specific.com/s4'_should_receive_a_404 (15.10s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/24_request_to_'foo.anotherwildcard.io/non-matching-prefix'_should_receive_a_404 (15.10s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/22_request_to_'foo.wildcard.io/s4'_should_receive_a_404 (0.01s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/21_request_to_'anotherwildcard.io/s4'_should_receive_a_404 (0.00s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/16_request_to_'foo.wildcard.io/s3'_should_receive_a_404 (0.00s)
            --- FAIL: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/19_request_to_'bar.anotherwildcard.io/s4'_should_go_to_infra-backend-v1 (30.00s)
            --- FAIL: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/0_request_to_'very.specific.com/s1'_should_go_to_infra-backend-v1 (30.00s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/17_request_to_'very.specific.com/non-matching-prefix'_should_receive_a_404 (0.00s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/12_request_to_'foo.wildcard.io/non-matching-prefix'_should_receive_a_404 (0.00s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/11_request_to_'very.specific.com/s2'_should_receive_a_404 (0.00s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/10_request_to_'wildcard.io/s2'_should_receive_a_404 (0.00s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/9_request_to_'non.matching.com/s2'_should_receive_a_404 (0.00s)
            --- FAIL: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/20_request_to_'foo.bar.anotherwildcard.io/s4'_should_go_to_infra-backend-v1 (30.00s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/4_request_to_'foo.wildcard.io/s1'_should_receive_a_404 (0.00s)
            --- FAIL: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/18_request_to_'foo.anotherwildcard.io/s4'_should_go_to_infra-backend-v1 (30.00s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/5_request_to_'very.specific.com/non-matching-prefix'_should_receive_a_404 (0.00s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/15_request_to_'foo.specific.com/s3'_should_receive_a_404 (0.00s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/2_request_to_'non.matching.com/s1'_should_receive_a_404 (0.00s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/3_request_to_'foo.nonmatchingwildcard.io/s1'_should_receive_a_404 (0.00s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/14_request_to_'non.matching.com/s3'_should_receive_a_404 (0.00s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/7_request_to_'bar.wildcard.io/s2'_should_go_to_infra-backend-v2 (17.05s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/13_request_to_'very.specific.com/s3'_should_go_to_infra-backend-v3 (0.01s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/8_request_to_'foo.bar.wildcard.io/s2'_should_go_to_infra-backend-v2 (17.04s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/6_request_to_'foo.wildcard.io/s2'_should_go_to_infra-backend-v2 (2.01s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_intersect_with_listener_hostnames/1_request_to_'very.specific.com:1234/s1'_should_go_to_infra-backend-v1 (2.01s)
        --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_not_intersect_with_listener_hostnames (0.01s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_not_intersect_with_listener_hostnames/1_request_to_'wildcard.io/s5'_should_receive_a_404 (0.00s)
            --- PASS: TestConformance/HTTPRouteHostnameIntersection/HTTPRoutes_that_do_not_intersect_with_listener_hostnames/0_request_to_'specific.but.wrong.com/s5'_should_receive_a_404 (0.00s)

FAIL
FAIL	github.com/cilium/cilium/operator/pkg/gateway-api	114.910s
FAIL

[sayboras]

This seems new to me, let's me try if I can simulate this issue.

[sayboras]

Seems like the test is fairly stable now after #30686, please refer to the below for more details.

Running TestConformance/HTTPRouteHostnameIntersection for 100 times

$ GATEWAY_API_CONFORMANCE_TESTS=1 go test -count=100  ./operator/pkg/gateway-api --gateway-class cilium --gateway-class cilium --all-features --exempt-features GatewayPort8080,GatewayStaticAddresses,Mesh --cleanup-base-resources=false -test.run "TestConformance/HTTPRouteHostnameIntersection"  
ok      github.com/cilium/cilium/operator/pkg/gateway-api       500.495s

[tommyp1ckles]

Thanks @sayboras 🙏 , I'm assuming we can close this (or do we need some backports?).

[sayboras]

Ah good call out, I have added the backport labels for the mentioned PR.