Embedded SQLite migration to ETCD Cluster #9432
-
|
Hi folks, We use vCluster which is an open source tool to manage Virtual Kubernetes clusters, the vCluster hosts inside a namespace of a Host Cluster [i.e EKS Cluster]. We use k3s as our Distro and it's backed up by embedded SQLite. Current K3s version: v1.26.12-k3s1 For using an external datastore need to set the environment variable in K3s configuration for connecting to the DB. Modify the vCluster template as mentioned here. We would like to know what will be the best approach to migrate data from Embedded SQLite to and ETCD Cluster. |
Beta Was this translation helpful? Give feedback.
Replies: 3 comments 10 replies
-
|
This is covered in the docs: |
Beta Was this translation helpful? Give feedback.
-
|
So, it's just that easy by restarting the k3s server with the --cluster-init flag? 👀 Steps:
Questions: |
Beta Was this translation helpful? Give feedback.
-
|
This is for migrating from sqlite to embedded etcd. That is the only supported migration that k3s will do for you. Any other migration between external datastores you will have to manage on your own using 3rd party backup/restore tools. |
Beta Was this translation helpful? Give feedback.
-
|
Hi - i am planning to migrate from single mater to HA setup. I can see it's as simple as adding a What i am planning
From look of it seems not every difficult, but what raise my concern is why no one mentioned it yet? |
Beta Was this translation helpful? Give feedback.
-
|
Migrating from sqlite to embedded etcd is covered in the comment directly above yours. Why are you doing all those extra steps if you just want to go from single node sqlite to ha with embedded etcd? |
Beta Was this translation helpful? Give feedback.
-
|
I want to migrate to external etcd cluster. |
Beta Was this translation helpful? Give feedback.
-
|
We don't support using external etcd. You can, and it should work fine, but we don't support it. That's likely why you don't find any docs or community discussion of doing so. |
Beta Was this translation helpful? Give feedback.
-
|
I am assuming you mean migration to external etcd?
…On Mon, Mar 17, 2025, 10:45 PM Brad Davidson ***@***.***> wrote:
We don't support using external etcd. You can, and it should work fine,
but we don't support it. That's likely why you don't find any docs or
community discussion of doing so.
—
Reply to this email directly, view it on GitHub
<#9432 (reply in thread)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AFZLBLVPQCH2PH2ZEOHGSYD2U37K3AVCNFSM6AAAAABYUHVUICVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTENJSHAZDQNI>
.
You are receiving this because you commented.Message ID:
***@***.***>
|
Beta Was this translation helpful? Give feedback.
-
|
No, i mean external etcd, period. It should work, because that's what upstream uses - but we only test with and officially support kine sqlite/postgres/mysql, and embedded etcd. |
Beta Was this translation helpful? Give feedback.
-
|
Sorry to open new thread, i replied via mail and it automatically do so. Also official documentation do say support for external etcd |
Beta Was this translation helpful? Give feedback.
-
|
I'd have to check with our QA team as to how often that is validated. I know we don't cover it in CI. |
Beta Was this translation helpful? Give feedback.
-
|
I confirmed that it is not something that we cover in our regular CI or QA processes. It was most recently validated in June of 2022: #5859 (comment) Like I said it should work fine, but at the moment I wouldn't recommend it. Why would you want to use external etcd over etcd managed by k3s? |
Beta Was this translation helpful? Give feedback.
-
|
I'm choosing external etcd over k3s-managed etcd primarily due to hardware limitations in my homelab. My setup includes Proxmox server and Couple of Raspberry Pis. External etcd allows me run master nodes on Raspberry Pi without compromising performance. My current single-node k3s setup uses SQLite. To migrate to a high-availability cluster, I must transition through embedded etcd, and external etcd provides a path for that migration, as embedded etcd backups can be restored to external etcd. |
Beta Was this translation helpful? Give feedback.
This is for migrating from sqlite to embedded etcd. That is the only supported migration that k3s will do for you. Any other migration between external datastores you will have to manage on your own using 3rd party backup/restore tools.