-
Notifications
You must be signed in to change notification settings - Fork 33
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Kubernetes support #1
Comments
If k8s support,I will install orbstack it. |
For now, you can run Kubernetes yourself with kind, k3s, or k3d: https://docs.orbstack.dev/docker/kubernetes |
Download image too slow because #2. It's still a long way to replace Docker Desktop .By the way host network support is wonderful. |
error happens when installing k3s to a Ubuntu machine: |
This comment was marked as spam.
This comment was marked as spam.
@killwing That's normal because OrbStack doesn't use kernel modules. All the necessary modules are built in so k3s should work anyway. If there's actually an error preventing k3s from starting, then please share the full output of |
Thanks, another error is about /dev/vdb1 not found,
|
@killwing Can't reproduce, but it should be fixed in the next version. |
Hi, KIND maintainer here, orbstack seems to have unusual iptables which is breaking KIND for a user and it's unclear how to access the VM to inspect this or indeed exactly how docker is being managed kubernetes-sigs/kind#3171 https://docs.orbstack.dev/architecture seems a bit hand-wavy about VMs and how docker is packaged, from
Would appreciate input from an orbstack maintainer on kubernetes-sigs/kind#3171 EDIT: got here from https://docs.orbstack.dev/docker/kubernetes
(Aside: It seems a bit unreasonable to claim performance improvements on a non-existent feature ...) |
Hey @BenTheElder, really sorry for the trouble. That issue is caused by missing support for I've tested the
Our Docker engine runs in an Alpine container, under a custom container manager. We don't plan to expose the underlying VM. Similarly, we don't have an easy way to enter the Docker engine container because we've found that most of the time people only want that because they're trying to make up for a missing feature that wouldn't work for other reasons. You can do it manually, however: docker run -it --rm --privileged --pid=host --net=host alpine
nsenter -m -u -i -n -p -t 1 Also, to clarify: we're not claiming any performance improvements for Kubernetes, but we've prototyped and experimented with Kubernetes support and preliminary measurements show that it uses less CPU in the background due to some tweaks. Let me know if you have any other concerns. Hope this helps! |
It's possible that there will still be issues with IPVS, however. We haven't enabled IPVS yet because we found that the module increases background CPU usage even if it's unused. We'll prioritize enabling it and fixing the increased CPU usage for v0.7.2. Will update this issue when that's done. |
Thanks for the clarification :-) |
I am not sure it is relevant ticket to comment on, but it seems quite close. The issue I am facing relates to the K3s running inside the OrbStack Docker container. Naturally it is Docker in Docker configuration. While it starts quite well and simple tests pass OK. Running my main (rather huge) project leads to the errors about
|
@prokher The |
@kdrag0n, looking forward for this version when. Thank you. |
We've added IPVS support in OrbStack v0.8.0. @prokher v0.8.0 also includes support for the |
@kdrag0n, awesome! Starting testing... |
excuse me for repeated not so necessary question, but i wasn't able to resist, do you happen to know any estimate that when out of box kubernetes integration will be added to OrbStack? |
As a new user to OrbStack, it would be awesome to have the option to select between |
If you do ship Kubernetes support, please have the option to not do docker-in-docker. Direct pod access from Mac is very useful, and it's is very difficult to get working with docker-in-docker. |
@kdrag0n k3s start failed on ubuntu
k3s start script /usr/local/bin/k3s \
server \
--tls-san apiserver.cluster.local \
--cluster-cidr 10.42.0.0/16 \
--service-cidr 10.43.0.0/16 \
--cluster-init \
--disable servicelb,traefik \
--disable-cloud-controller \
--disable-network-policy \
--disable-helm-controller \
--prefer-bundled-bin \
--kube-proxy-arg "proxy-mode=ipvs" "masquerade-all=true" \
--kube-proxy-arg "metrics-bind-address=0.0.0.0" |
@kdrag0n will OrbStack support multiple K8s clusters? The Docker-in-Docker implementation of minikube facilitates this and I find it particularly useful for running one cluster per supported version of our application stack. I don't have to tear down the K8s configuration, pods, etc. and I don't have to worry about the disparate versions using the same database volumes while needing different schemas respective of the app version. I can also stop all the unused clusters when I am not developing on them. |
@danielfinke Hmm, the plan is currently to support a single cluster that uses a shared Docker engine for more convenient development wrt. images and debugging. Maybe you could open an issue for potential multi-cluster support in the future once this is implemented. |
Perfect - I think this approach makes it much easier to get Rosetta support too ( because you already have it in the mini-VM ) Completely agree with the ease of development benefits of sharing the docker engine, pushing containers separately into Kubernetes specific containerd is an annoying & unnecessary duplication. Not having k8s-in-container-in-orbstack-vm makes it much easier to get the routing right for direct Pod network access - this is a key feature in the industry I work in - most of the software I use will never work with port-forwarding access, and will throw fits at MTU change if a tunnel approach is used Colima gets a lot of this stuff right - it just lacks the polish to be a drop in replacement for Docker Desktop, Orbstack K8s would be the one I'd choose. |
#493 it's seem issue. |
https://github.com/tangkhaiphuong/kubernetes-setup/blob/master/orbstack-k3s-cluster.sh <-- Just sharing setup K3s cluster with 2 master + 3 worker on alma linux on Orbstack 0.16 |
support k8s,i every like orbstack,it's so smart |
Great news: we've launched first-class Kubernetes support in OrbStack 0.17.0!
Docs: https://docs.orbstack.dev/kubernetes |
Well done, Danny! But there is one additional issue to consider - can we expose the k8s services externally? Right now it looks like only the local machine can access them, and I'd like to run orbstack's k8s on my Mac mini and expose services on the LAN for other devices. |
@d0zingcat What types of services? ClusterIP, NodePort, LoadBalancer? Please open a new issue or discussion. |
I apologize for the simplicity of the information I provided. Here's a detailed explanation: The simplest example is using the default command in the application: |
You can locate the Orbstack Settings in the top menu bar (alternatively, use |
@d0zingcat That's intentional for security. The next version will have an option to expose services to other devices on your LAN: https://docs.orbstack.dev/kubernetes/#exposing-ports-to-lan Everyone, please open new issues or discussions for any new feature requests or questions to avoid spamming people subscribed to this issue. Thanks! |
@kdrag0n support multiple nodes ? |
This is about first-class support for Kubernetes.
You can already do it yourself with kind, k3s, or k3d: https://docs.orbstack.dev/docker/kubernetes
The text was updated successfully, but these errors were encountered: