Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CBG-2711 add 3 node cluster option to jenkins #6176

Merged
merged 2 commits into from Apr 17, 2023
Merged

CBG-2711 add 3 node cluster option to jenkins #6176

merged 2 commits into from Apr 17, 2023

Conversation

torcolvin
Copy link
Collaborator

create ./integration-test/start_server.sh which allows you to start a cluster in a multinode or a single node setup. The intent is that SG developers could use this to set up clusters but I think I need another PR for this to work on OS X.

When creating a 3 node cluster (MULTI_NODE on jenkins), it will create each bucket with 1 replica.

Questions:

  • Can we change the AMI to include a modern version of docker? This is one of those things that won't work on OS X because this uses docker compose v1 (written in python) and modern docker uses docker compose v2. This can be put off until we update the AMI. I also add jq at runtime if JENKINS_URL is set.
  • Why do we set --volume ${DOCKER_CBS_ROOT_DIR}/cbs:/root --volume ${WORKSPACE_ROOT}:/workspace ? It seems like it is easier to use docker volumes and just do a docker exec -t couchbase /opt/couchbase/bin/cbcollect_info /workspace/cbcollect.zip && docker cp couchbase:/workspace/cbcollect.zip cbcollect.zip to get the file. The only reason to mount the disk seems like would be if we pick up partial files from checks. I can't figure out why we bind mount the /root volume at all.

Ran 6.6.5,7.1.4,7.0.3 with MULTI_NODE on and off for a base DCP test.

@bbrks bbrks self-assigned this Apr 14, 2023
base/main_test_bucket_pool_config.go Outdated Show resolved Hide resolved
jenkins-integration-build.sh Outdated Show resolved Hide resolved
./integration-test/start_server.sh "${COUCHBASE_SERVER_VERSION}"
else
./integration-test/start_server.sh -m "${COUCHBASE_SERVER_VERSION}"
export SG_TEST_BUCKET_NUM_REPLICAS=1
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Num replicas here should be zero, right?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it should be 1 because this is multi-node cluster and we want at least one replica for each bucket?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My bad - read the if backwards.

Should we specify 2 replicas in that case, if we know there are 3 CB Data nodes?

@bbrks bbrks assigned torcolvin and unassigned bbrks Apr 17, 2023
- pull out the grep change from this PR
- parameterize docker-compose (jenkins only)
- allow JENKINS_URL to be unset
@torcolvin torcolvin assigned bbrks and unassigned torcolvin Apr 17, 2023
@torcolvin torcolvin merged commit 84ed3ff into master Apr 17, 2023
24 checks passed
@torcolvin torcolvin deleted the CBG-2711 branch April 17, 2023 15:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants