CI: v1.12: Suite-k8s-1.20.K8sServicesTest Checks E/W loadbalancing (ClusterIP, NodePort from inside cluster, etc) with L4 policy Tests NodePort with L4 Policy

[YutaroHayakawa]

Test Name

Suite-k8s-1.20.K8sServicesTest Checks E/W loadbalancing (ClusterIP, NodePort from inside cluster, etc) with L4 policy Tests NodePort with L4 Policy

Failure Output

FAIL: Request from testclient-2jng4 pod to service tftp://[fd04::11]:32411/hello failed

Stack Trace

Expected command: kubectl exec -n default testclient-2jng4 -- /bin/bash -c 'fails=""; id=$RANDOM; for i in $(seq 1 10); do if curl --path-as-is -s -D /dev/stderr --fail --connect-timeout 5 --max-time 20 tftp://[fd04::11]:32411/hello -H "User-Agent: cilium-test-$id/$i"; then echo "Test round $id/$i exit code: $?"; else fails=$fails:$id/$i=$?; fi; done; if [ -n "$fails" ]; then echo "failed: $fails"; fi; cnt="${fails//[^:]}"; if [ ${#cnt} -gt 0 ]; then exit 42; fi' 
To succeed, but it failed:
Exitcode: 42 
Err: exit status 42

Standard Output

Stdout:
 	 
	 Hostname: testds-g4wqz
	 
	 Request Information:
	 	client_address=fd04::11
	 	client_port=18413
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 3799/2 exit code: 0
	 
	 Hostname: testds-ts8fl
	 
	 Request Information:
	 	client_address=fd02::175
	 	client_port=45318
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 3799/3 exit code: 0
	 
	 Hostname: testds-g4wqz
	 
	 Request Information:
	 	client_address=fd04::11
	 	client_port=6535
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 3799/4 exit code: 0
	 
	 Hostname: testds-g4wqz
	 
	 Request Information:
	 	client_address=fd04::11
	 	client_port=28647
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 3799/5 exit code: 0
	 
	 Hostname: testds-g4wqz
	 
	 Request Information:
	 	client_address=fd04::11
	 	client_port=54589
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 3799/6 exit code: 0
	 
	 Hostname: testds-ts8fl
	 
	 Request Information:
	 	client_address=fd02::175
	 	client_port=33226
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 3799/7 exit code: 0
	 
	 Hostname: testds-ts8fl
	 
	 Request Information:
	 	client_address=fd02::175
	 	client_port=44629
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 3799/8 exit code: 0
	 
	 Hostname: testds-g4wqz
	 
	 Request Information:
	 	client_address=fd04::11
	 	client_port=57976
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 3799/9 exit code: 0
	 
	 Hostname: testds-ts8fl
	 
	 Request Information:
	 	client_address=fd02::175
	 	client_port=46368
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 3799/10 exit code: 0
	 failed: :3799/1=71

Standard Error

Stderr:
 	 command terminated with exit code 42

Resources

• Jenkins URL: https://jenkins.cilium.io/job/Cilium-PR-K8s-1.20-kernel-4.9/324/testReport/junit/Suite-k8s-1/20/K8sServicesTest_Checks_E_W_loadbalancing__ClusterIP__NodePort_from_inside_cluster__etc__with_L4_policy_Tests_NodePort_with_L4_Policy/
• ZIP file(s): Uploading dcb25ab5_K8sServicesTest_Checks_E-W_loadbalancing_(ClusterIP,_NodePort_from_inside_cluster,_etc)_with_L4_policy_Tests_NodePort_with_L4_Policy.zip…

Anything else?

No response

[pippolo84]

Another hit here

K8sDatapathServicesTest Checks N/S loadbalancing With host policy 
  Tests NodePort

...

FAIL: Request from testclient-hft7g pod to service tftp://[fd00:10:96::3dba]:10069/hello failed
Expected command: kubectl exec -n default testclient-hft7g -- /usr/bin/env bash -c 'fails=""; id=$RANDOM; for i in $(seq 1 10); do if curl --path-as-is -s -D /dev/stderr --fail --connect-timeout 5 --max-time 20 tftp://[fd00:10:96::3dba]:10069/hello -H "User-Agent: cilium-test-$id/$i"; then echo "Test round $id/$i exit code: $?"; else fails=$fails:$id/$i=$?; fi; done; if [ -n "$fails" ]; then echo "failed: $fails"; fi; cnt="${fails//[^:]}"; if [ ${#cnt} -gt 0 ]; then exit 42; fi' 
To succeed, but it failed:
Exitcode: 42 
Err: exit status 42
Stdout:
 	 
	 Hostname: testds-mr27t
	 
	 Request Information:
	 	client_address=fd02::e
	 	client_port=36751
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 314/1 exit code: 0
	 
	 Hostname: testds-mr27t
	 
	 Request Information:
	 	client_address=fd02::e
	 	client_port=45577
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 314/2 exit code: 0
	 
	 Hostname: testds-k8pmk
	 
	 Request Information:
	 	client_address=fd02::e
	 	client_port=55441
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 314/3 exit code: 0
	 
	 Hostname: testds-k8pmk
	 
	 Request Information:
	 	client_address=fd02::e
	 	client_port=46686
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 314/4 exit code: 0
	 
	 Hostname: testds-k8pmk
	 
	 Request Information:
	 	client_address=fd02::e
	 	client_port=57444
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 314/5 exit code: 0
	 
	 Hostname: testds-mr27t
	 
	 Request Information:
	 	client_address=fd02::e
	 	client_port=37049
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 314/6 exit code: 0
	 
	 Hostname: testds-mr27t
	 
	 Request Information:
	 	client_address=fd02::e
	 	client_port=[572](https://github.com/cilium/cilium/actions/runs/7384604202/job/20087890519#step:16:574)57
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 314/7 exit code: 0
	 
	 Hostname: testds-mr27t
	 
	 Request Information:
	 	client_address=fd02::e
	 	client_port=33496
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 314/9 exit code: 0
	 
	 Hostname: testds-mr27t
	 
	 Request Information:
	 	client_address=fd02::e
	 	client_port=45600
	 	real path=/hello
	 	request_scheme=tftp
	 
	 Test round 314/10 exit code: 0
	 failed: :314/8=71
	 
Stderr:
 	 command terminated with exit code 42

Full logs
Sysdump

[github-actions]

This issue has been automatically marked as stale because it has not
had recent activity. It will be closed if no further activity occurs.

[pippolo84]

Another hit from #31157

Jenkins URL: https://jenkins.cilium.io/job/Cilium-PR-K8s-1.23-kernel-4.19/689/testReport/junit/Suite-k8s-1/23/K8sDatapathServicesTest_Checks_E_W_loadbalancing__ClusterIP__NodePort_from_inside_cluster__etc__with_L4_policy_Tests_NodePort_with_L4_Policy/
ZIP file: d00f5ae7_K8sDatapathServicesTest_Checks_E-W_loadbalancing_(ClusterIP,_NodePort_from_inside_cluster,_etc)_with_L4_policy_Tests_NodePort_with_L4_Policy.zip

[tommyp1ckles]

Hit this here: https://github.com/cilium/cilium/actions/runs/8330407882/job/22795552306, seems to be happening more recently.

The return code (failed: :314/8=71) means that curl is returning with error CURLE_TFTP_ILLEGAL.

[github-actions]

This issue has been automatically marked as stale because it has not
had recent activity. It will be closed if no further activity occurs.

[github-actions]

This issue has not seen any activity since it was marked stale.
Closing.