Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cloudhub Start quic server only #5466

Open
SherlockShemol opened this issue Mar 14, 2024 · 5 comments
Open

Cloudhub Start quic server only #5466

SherlockShemol opened this issue Mar 14, 2024 · 5 comments
Labels
kind/question Indicates an issue that is a support question.

Comments

@SherlockShemol
Copy link

SherlockShemol commented Mar 14, 2024

Hello,I want cloudhub to start quic server only, I follow the instruction but I can't find the controller.yaml.Could you please tell me where it is?

@SherlockShemol SherlockShemol added the kind/question Indicates an issue that is a support question. label Mar 14, 2024
@wbc6080
Copy link
Contributor

wbc6080 commented Mar 14, 2024

This article may help you with this question. https://mp.weixin.qq.com/s/P0pG8FoMgZsNcbVargK2gg

@wbc6080
Copy link
Contributor

wbc6080 commented Mar 14, 2024

x123

@SherlockShemol
Copy link
Author

x123

Thank you a lot!

@SherlockShemol
Copy link
Author

x123

I follow the instruction to start quic server only and the edgecore is successfully deployed.But I think the edge side can't communicate with the cloud side because I run kubectl get nodes there is no edge-side node. and the journal at edge side is

Mar 15 10:35:33 myarch edgecore[2060488]: I0315 10:35:33.293769 2060488 watcher.go:200] get storage revision:66352
Mar 15 10:35:33 myarch edgecore[2060488]: E0315 10:35:33.816299 2060488 controller.go:146] "Failed to ensure lease exists, will retry" err="unmarshal mes
sage to lease failed, err: json: cannot unmarshal array into Go value of type client.LeaseResp" interval="7s"
Mar 15 10:35:37 myarch edgecore[2060488]: E0315 10:35:37.365614 2060488 storage.go:200] [metaserver/reststorage] failed to generate application: connecti
on lost between EdgeCore and CloudCore
Mar 15 10:35:37 myarch edgecore[2060488]: E0315 10:35:37.365662 2060488 storage.go:218] [metaserver/reststorage] failed to get a approved application for
 watch(/apis/networking.istio.io/v1alpha3/destinationrules) from cloud application center, connection lost between EdgeCore and CloudCore
Mar 15 10:35:37 myarch edgecore[2060488]: W0315 10:35:37.365686 2060488 watcher.go:93] base storage now only support rev == 0, but get rev == 6036, force
 set to 0!
Mar 15 10:35:37 myarch edgecore[2060488]: I0315 10:35:37.365827 2060488 watcher.go:230] start watching, rev:0
Mar 15 10:35:37 myarch edgecore[2060488]: I0315 10:35:37.365871 2060488 imitator.go:176] networking.istio.io/v1alpha3, Resource=destinationrules,,
Mar 15 10:35:37 myarch edgecore[2060488]: I0315 10:35:37.366152 2060488 watcher.go:200] get storage revision:66352
Mar 15 10:35:39 myarch edgecore[2060488]: E0315 10:35:39.225607 2060488 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContaine
r\" for \"upgrade-ipam\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=upgrade-ipam pod=calico-node-fr2df_kube-system(6b8f5f3a-2ad6-
4593-aa62-475405b51ea2)\"" pod="kube-system/calico-node-fr2df" podUID="6b8f5f3a-2ad6-4593-aa62-475405b51ea2"
Mar 15 10:35:39 myarch edgecore[2060488]: E0315 10:35:39.226405 2060488 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContaine
r\" for \"kube-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.k8s.io/kube-proxy:v1.28.3\\\"\"" pod="kube-system/kube-proxy-mvhht" p
odUID="12f5d503-0cce-44a9-9d0a-ea783ad0e14e"
Mar 15 10:35:40 myarch edgecore[2060488]: E0315 10:35:40.828021 2060488 controller.go:146] "Failed to ensure lease exists, will retry" err="unmarshal mes
sage to lease failed, err: json: cannot unmarshal array into Go value of type client.LeaseResp" interval="7s"
Mar 15 10:35:41 myarch edgecore[2060488]: E0315 10:35:41.236281 2060488 remote_runtime.go:205] "StopPodSandbox from runtime service failed" err="rpc erro
r: code = Unknown desc = failed to destroy network for sandbox \"a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7e9\": plugin type=\"calico
\" failed (delete): failed to find plugin \"calico\" in path [/opt/cni/bin]" podSandboxID="a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7
e9"
Mar 15 10:35:41 myarch edgecore[2060488]: E0315 10:35:41.236343 2060488 kuberuntime_manager.go:1305] "Failed to stop sandbox" podSandboxID={"Type":"conta
inerd","ID":"a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7e9"}
Mar 15 10:35:41 myarch edgecore[2060488]: E0315 10:35:41.236401 2060488 kubelet.go:1851] failed to "KillPodSandbox" for "4b69473d-5044-4fa7-b944-46e11366
11e4" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f
7d8640cfad941e7e9\": plugin type=\"calico\" failed (delete): failed to find plugin \"calico\" in path [/opt/cni/bin]"
Mar 15 10:35:41 myarch edgecore[2060488]: E0315 10:35:41.236435 2060488 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"KillPodSandbo
x\" for \"4b69473d-5044-4fa7-b944-46e1136611e4\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"a
954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7e9\\\": plugin type=\\\"calico\\\" failed (delete): failed to find plugin \\\"calico\\\" in 
path [/opt/cni/bin]\"" pod="kube-system/calico-kube-controllers-558d465845-p52fm" podUID="4b69473d-5044-4fa7-b944-46e1136611e4"
Mar 15 10:35:47 myarch edgecore[2060488]: E0315 10:35:47.840379 2060488 controller.go:146] "Failed to ensure lease exists, will retry" err="unmarshal mes
sage to lease failed, err: json: cannot unmarshal array into Go value of type client.LeaseResp" interval="7s"
Mar 15 10:35:53 myarch edgecore[2060488]: E0315 10:35:53.226135 2060488 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContaine
r\" for \"kube-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.k8s.io/kube-proxy:v1.28.3\\\"\"" pod="kube-system/kube-proxy-mvhht" p
odUID="12f5d503-0cce-44a9-9d0a-ea783ad0e14e"
Mar 15 10:35:54 myarch edgecore[2060488]: E0315 10:35:54.225585 2060488 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContaine
r\" for \"upgrade-ipam\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=upgrade-ipam pod=calico-node-fr2df_kube-system(6b8f5f3a-2ad6-
4593-aa62-475405b51ea2)\"" pod="kube-system/calico-node-fr2df" podUID="6b8f5f3a-2ad6-4593-aa62-475405b51ea2"
Mar 15 10:35:54 myarch edgecore[2060488]: E0315 10:35:54.851274 2060488 controller.go:146] "Failed to ensure lease exists, will retry" err="unmarshal mes
sage to lease failed, err: json: cannot unmarshal array into Go value of type client.LeaseResp" interval="7s"
Mar 15 10:35:55 myarch edgecore[2060488]: E0315 10:35:55.235006 2060488 remote_runtime.go:205] "StopPodSandbox from runtime service failed" err="rpc erro
r: code = Unknown desc = failed to destroy network for sandbox \"a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7e9\": plugin type=\"calico
\" failed (delete): failed to find plugin \"calico\" in path [/opt/cni/bin]" podSandboxID="a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7
e9"
Mar 15 10:35:55 myarch edgecore[2060488]: E0315 10:35:55.235066 2060488 kuberuntime_manager.go:1305] "Failed to stop sandbox" podSandboxID={"Type":"conta
inerd","ID":"a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7e9"}
Mar 15 10:35:55 myarch edgecore[2060488]: E0315 10:35:55.235122 2060488 kubelet.go:1851] failed to "KillPodSandbox" for "4b69473d-5044-4fa7-b944-46e11366
11e4" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f
7d8640cfad941e7e9\": plugin type=\"calico\" failed (delete): failed to find plugin \"calico\" in path [/opt/cni/bin]"
Mar 15 10:35:55 myarch edgecore[2060488]: E0315 10:35:55.235158 2060488 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"KillPodSandbo
x\" for \"4b69473d-5044-4fa7-b944-46e1136611e4\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"a
954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7e9\\\": plugin type=\\\"calico\\\" failed (delete): failed to find plugin \\\"calico\\\" in 
path [/opt/cni/bin]\"" pod="kube-system/calico-kube-controllers-558d465845-p52fm" podUID="4b69473d-5044-4fa7-b944-46e1136611e4"

Does this mean I have to use the calico plugin or am I doing something wrong? Can I use edgemesh to replace CNI plugin in quic condition as here said?

@SherlockShemol
Copy link
Author

Problem solved.
I set the wrong iptable rules.
Before

sudo iptables -I DOCKER-USER 1 ! -i docker0 -o docker0 -p tcp -j ACCEPT -d $(minikube ip) --dport 10001
sudo iptables -t nat -A DOCKER ! -i docker0 -p tcp -j DNAT --dport 10001 --to-destination $(minikube ip):10001

After

sudo iptables -I DOCKER-USER 1 ! -i docker0 -o docker0 -p udp -j ACCEPT -d $(minikube ip) --dport 10001
sudo iptables -t nat -A DOCKER ! -i docker0 -p udp -j DNAT --dport 10001 --to-destination $(minikube ip):10001

UDP ,not TCP.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/question Indicates an issue that is a support question.
Projects
None yet
Development

No branches or pull requests

2 participants