Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bitnami/redis-cluster] node fail after pod restart #15075

Closed
angel-cdo opened this issue Feb 21, 2023 · 9 comments · Fixed by #16674
Closed

[bitnami/redis-cluster] node fail after pod restart #15075

angel-cdo opened this issue Feb 21, 2023 · 9 comments · Fixed by #16674
Assignees
Labels
redis-cluster solved tech-issues The user has a technical issue about an application triage Triage is needed

Comments

@angel-cdo
Copy link

Name and Version

bitnami/redis-cluster-8.3.7

What steps will reproduce the bug?

  1. helm install redis-cluster my-repo/redis-cluster --version 8.3.7 --set usePassword=false --set persistence.enabled=false
  2. wait for install to finish, and check that all pod are ready
  3. delete one pod, which will restart it and get a new IP
  4. pod will not join the cluster and will be in failed state

If I install with version 8.2.7 it will work as expected

Are you using any custom parameters or values?

--set usePassword=false --set persistence.enabled=false

What is the expected behavior?

pod should work fine after restart, just like in older versions

What do you see instead?

pod not joining the redis-cluster

Additional information

No response

@angel-cdo angel-cdo added the tech-issues The user has a technical issue about an application label Feb 21, 2023
@bitnami-bot bitnami-bot added this to Triage in Support Feb 21, 2023
@github-actions github-actions bot added the triage Triage is needed label Feb 21, 2023
@javsalgar javsalgar changed the title redis-cluster node fail after pod restart [bitnami/redis-cluster] node fail after pod restart Feb 21, 2023
@javsalgar
Copy link
Contributor

Hi,

Does the issue happen when enabling the persistence? I think it has to do with the fact that the cluster state is stored in a volume.

@github-actions github-actions bot moved this from Triage to Pending in Support Feb 21, 2023
@angel-cdo
Copy link
Author

angel-cdo commented Feb 21, 2023

Hey

Thanks for the quick reply!
With persistence it does work
I know see that the reason it works with older helm chart version is because it didn't had the persistence flag
So it just doesn't work with persistence disabled

@bitnami-bot bitnami-bot moved this from Pending to Triage in Support Feb 21, 2023
@angel-cdo
Copy link
Author

this #13545 PR adds the option to disable persistence
But it seems that new pods created after cluster was created fail to join

@javsalgar
Copy link
Contributor

@anessi did you see the issue described by @angel-cdo ?

@github-actions github-actions bot moved this from Triage to Pending in Support Feb 22, 2023
@headlessme
Copy link

I've also just run into this issue with a cluster using persistence.enabled=false

@bitnami-bot bitnami-bot moved this from Pending to Triage in Support Feb 28, 2023
@anessi
Copy link
Contributor

anessi commented Mar 1, 2023

I can confirm that there's an issue with the persistence.enabled=false flag. Please also see #4484 (comment) for more details.

There are the following options IMO:

  • Update the scripts so that joining of an existing cluster is supported (see charts/redis-cluster disable persistence #4484 (comment))
  • Remove the feature again as it does not work properly
  • Add a note in the values file and mention the current restrictions that people don't run into this issue

@javsalgar javsalgar moved this from Triage to In progress in Support Mar 1, 2023
@github-actions github-actions bot added in-progress and removed triage Triage is needed labels Mar 1, 2023
@bitnami-bot bitnami-bot assigned jotamartos and unassigned javsalgar Mar 1, 2023
@jotamartos
Copy link
Contributor

Hi,

Thank you for your suggestions. We are going to create a task on our side to improve the initialization process when disabling the persistence in the Bitnami Redis Chart.

Sorry for the inconvenience.

@github-actions github-actions bot moved this from In progress to Pending in Support Mar 3, 2023
@jotamartos jotamartos moved this from Pending to On hold in Support Mar 3, 2023
@github-actions github-actions bot added on-hold Issues or Pull Requests with this label will never be considered stale and removed in-progress labels Mar 3, 2023
@Checksumz
Copy link

I too am seeing an error when persistence.enabled=false .
I have verified that this issue is occurring since chart version 8.3.0, when the flag was introduced.

@bitnami-bot bitnami-bot moved this from On hold to Triage in Support May 17, 2023
@github-actions github-actions bot removed the on-hold Issues or Pull Requests with this label will never be considered stale label May 17, 2023
@github-actions github-actions bot added the triage Triage is needed label May 17, 2023
@bitnami-bot bitnami-bot moved this from Triage to Solved in Support May 17, 2023
@CeliaGMqrz
Copy link
Contributor

Hi, we have just updated the documentation. If you have any suggestions or questions we will be happy to provide feedback.

@github-actions github-actions bot moved this from Solved to Pending in Support May 17, 2023
@fmulero fmulero moved this from Pending to Solved in Support Jun 30, 2023
@github-actions github-actions bot removed this from Solved in Support Jul 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
redis-cluster solved tech-issues The user has a technical issue about an application triage Triage is needed
Projects
None yet
7 participants