-
Notifications
You must be signed in to change notification settings - Fork 581
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
local SCDF on minikube works very slow #5775
Comments
@Setxand What do you mean by 'local deployment best practices'? For running minikube locally or for using the local platform? Keep in mind that when it comes to batch jobs database performance is crucial. If you run minikube locally with a database in the same cluster you are probably going to experience the limits of your local system IO. |
Eks is RDS, DB I use the local one via hosts.docker.local, is it the cause of the slow execution? |
SCDF is connected to this local db as well, but the SCDF works fast, connects, doing migrations, and so on (It's Postgres btw), but then I run composed task locally, it creates the pod for the composed task, then the first one, and when the java app starts , it gets veeeery slowly |
@Setxand |
It's Docker, and the default one, can't say how much, actually I just run "minikube start" and that's it, but I tried to run the docker's k8s, and ejected 8gm in the docker configs, but the jobs were slow, but I guess it's the memory problem, yes, I need to increase the ram there, cause I've asked one guy to run it on the machine with 16 gb on docker-desktop's k8s, and it worked well, thanks |
@Setxand |
@corneil everything is disabled except scdf server and deployer, 'm using bitnami charts, but looks it's almost the same you've got on src/deploy/k8s |
Hey all, it's not actually the bug, but more the ask for the suggestion - I'm running SCDF with bitnami helm chart on minikube k8s kluster, everything work well but the java apps - batch tasks work very slow, I can't figure out what's wrong there, cause the same infra I use on aws eks cluster, and there everything is cool, can you share your local deployment best practices?
The text was updated successfully, but these errors were encountered: