CI: [Fail] K8sDatapathServicesTest Checks N/S loadbalancing With host policy [It] Tests NodePort

[tommyp1ckles]

CI failure

Link: https://github.com/cilium/cilium/actions/runs/8330407882/job/22795552306
Sysdump: cilium-sysdumps(60).zip

• Failure [286.470 seconds]
K8sDatapathServicesTest
/home/runner/work/cilium/cilium/test/ginkgo-ext/scopes.go:461
  Checks N/S loadbalancing
  /home/runner/work/cilium/cilium/test/ginkgo-ext/scopes.go:461
    With host policy
    /home/runner/work/cilium/cilium/test/ginkgo-ext/scopes.go:461
      Tests NodePort [It]
      /home/runner/work/cilium/cilium/test/ginkgo-ext/scopes.go:515

      Request from kind-control-plane to service tftp://[::ffff:127.0.0.1]:30917/hello failed
      Expected command: kubectl exec -n kube-system log-gatherer-99wbs -- /usr/bin/env bash -c 'fails=""; id=$RANDOM; for i in $(seq 1 10); do if curl -k --path-as-is -s -D /dev/stderr --fail --connect-timeout 5 --max-time 20 tftp://[::ffff:127.0.0.1]:30917/hello -H "User-Agent: cilium-test-$id/$i"; then echo "Test round $id/$i exit code: $?"; else fails=$fails:$id/$i=$?; fi; done; if [ -n "$fails" ]; then echo "failed: $fails"; fi; cnt="${fails//[^:]}"; if [ ${#cnt} -gt 0 ]; then exit 42; fi' 
      To succeed, but it failed:
      Exitcode: 42 
      Err: exit status 42
      Stdout:
       	 
      	 Hostname: testds-hpkd2
      	 
      	 Request Information:
      	 	client_address=10.0.1.227
      	 	client_port=36488
      	 	real path=/hello
      	 	request_scheme=tftp
      	 
      	 Test round 7318/1 exit code: 0
      	 
      	 Hostname: testds-pr9jz
      	 
      	 Request Information:
      	 	client_address=10.0.1.227
      	 	client_port=52591
      	 	real path=/hello
      	 	request_scheme=tftp
      	 
      	 Test round 7318/2 exit code: 0
      	 
      	 Hostname: testds-pr9jz
      	 
      	 Request Information:
      	 	client_address=10.0.1.227
      	 	client_port=55315
      	 	real path=/hello
      	 	request_scheme=tftp
      	 
      	 Test round 7318/3 exit code: 0
      	 
      	 Hostname: testds-pr9jz
      	 
      	 Request Information:
      	 	client_address=10.0.1.227
      	 	client_port=36451
      	 	real path=/hello
      	 	request_scheme=tftp
      	 
      	 Test round 7318/4 exit code: 0
      	 
      	 Hostname: testds-pr9jz
      	 
      	 Request Information:
      	 	client_address=10.0.1.227
      	 	client_port=34246
      	 	real path=/hello
      	 	request_scheme=tftp
      	 
      	 Test round 7318/5 exit code: 0
      	 
      	 Hostname: testds-pr9jz
      	 
      	 Request Information:
      	 	client_address=10.0.1.227
      	 	client_port=35329
      	 	real path=/hello
      	 	request_scheme=tftp
      	 
      	 Test round 7318/6 exit code: 0
      	 
      	 Hostname: testds-hpkd2
      	 
      	 Request Information:
      	 	client_address=10.0.1.227
      	 	client_port=37520
      	 	real path=/hello
      	 	request_scheme=tftp
      	 
      	 Test round 7318/7 exit code: 0
      	 
      	 Hostname: testds-hpkd2
      	 
      	 Request Information:
      	 	client_address=10.0.1.227
      	 	client_port=53390
      	 	real path=/hello
      	 	request_scheme=tftp
      	 
      	 Test round 7318/8 exit code: 0
      	 
      	 Hostname: testds-pr9jz
      	 
      	 Request Information:
      	 	client_address=10.0.1.227
      	 	client_port=50296
      	 	real path=/hello
      	 	request_scheme=tftp
      	 
      	 Test round 7318/10 exit code: 0
      	 failed: :7318/9=71
      	 
      Stderr:
       	 command terminated with exit code 42
      	 

[tommyp1ckles]

Seems somewhat similar to: #30018 but it's happening on main

[giorio94]

Hit on #31781 as well
Link: https://github.com/cilium/cilium/actions/runs/8558031031/job/23451850493

FAIL: Can not connect to service "http://[fc00:c111::4]:32634" from outside cluster (2/10)
Expected command: kubectl exec -n kube-system log-gatherer-m9grq -- curl -k --path-as-is -s -D /dev/stderr --fail --connect-timeout 5 --max-time 20 http://[fc00:c111::4]:32634 -w "time-> DNS: '%{time_namelookup}(%{remote_ip})', Connect: '%{time_connect}',Transfer '%{time_starttransfer}', total '%{time_total}'" 
To succeed, but it failed:
Exitcode: 28 
Err: exit status 28
Stdout:
 	 time-> DNS: '0.000071()', Connect: '0.000000',Transfer '0.000000', total '5.001085'
Stderr:
 	 command terminated with exit code 28
	 

FAIL: Can not connect to service "tftp://[fc00:c111::4]:30426/hello" from outside cluster (2/10)
Expected command: kubectl exec -n kube-system log-gatherer-m9grq -- curl -k --path-as-is -s -D /dev/stderr --fail --connect-timeout 5 --max-time 20 tftp://[fc00:c111::4]:30426/hello -w "time-> DNS: '%{time_namelookup}(%{remote_ip})', Connect: '%{time_connect}',Transfer '%{time_starttransfer}', total '%{time_total}'" 
To succeed, but it failed:
Exitcode: 28 
Err: exit status 28
Stdout:
 	 time-> DNS: '0.000039()', Connect: '0.000065',Transfer '0.000000', total '5.001066'
Stderr:
 	 command terminated with exit code 28

[thorn3r]

Hit on #32403
Workflow: https://github.com/cilium/cilium/actions/runs/8991412541/job/24699098868