Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cluster formation DSL - Gradle integration - part 2 #32028

Merged
merged 8 commits into from
Aug 15, 2018

Conversation

alpar-t
Copy link
Contributor

@alpar-t alpar-t commented Jul 13, 2018

Adds the initial cluster formation DSL and integration with Gradle task graph and task life-cycle.
The main purpose of the CI is to exercise this integration and add integration tests for it.
The actual syntax of the DSL will be subject to change ( some things are already changed ),
I don't think it's worth focusing on it much as long as it's not something that drives into a corner.
Keeping it easy to change the DSL is a design goal. I already have local changes that iterate on it.
I think the best time to talk about the DSL syntax is when we actually start using it.

Starting the review with ClusterformationPluginIT.java and buildSrc/src/testKit/clusterformation/build.gradle might make it easier to understand other changes.

@rjernst I will extend the DSL to restrict to specific task types in a future PR.

- This allows to move all  all .java files from .groovy.
- Will prevent eclipse from tangling up in this setup
- make it possible to use Version from Java
```
> Task :plugins:ingest-user-agent:listElasticSearchClusters
Starting cluster: myTestCluster
   * myTestCluster: /home/alpar/work/elastic/elasticsearch/plugins/ingest-user-agent/foo
Asked to unClaimAndStop myTestCluster, since cluster still has 1 claim it will not be stopped

> Task :plugins:ingest-user-agent:testme UP-TO-DATE
Stopping myTestCluster, since no of claims is 0
```

- Meant to auto manage the clusters lifecycle
- Add integration test for cluster formation
@alpar-t alpar-t added the :Delivery/Build Build or test infrastructure label Jul 13, 2018
@alpar-t alpar-t requested review from nik9000 and rjernst July 13, 2018 08:50
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-infra

@alpar-t
Copy link
Contributor Author

alpar-t commented Jul 13, 2018

I don't understand why this diff shows changes already in master. cddb550 is the first commit on the branch, all the others were rebased away and merged to master as part 1. Looking at the diffs locally shows correctly and git push says everything is up to date.

@alpar-t
Copy link
Contributor Author

alpar-t commented Jul 19, 2018

@rjernst @nik9000 would be great if you could take a look, I need the new methods in GradleIntegrationTestCase for other changes. I can break those out of this PR if you think it needs more time to review as a whole.

@alpar-t
Copy link
Contributor Author

alpar-t commented Aug 8, 2018

task whatever {
    useCluster clusters.mycluster
}

@alpar-t alpar-t added the WIP label Aug 10, 2018
@alpar-t alpar-t merged commit e680a64 into elastic:master Aug 15, 2018
alpar-t added a commit that referenced this pull request Aug 15, 2018
jasontedor added a commit that referenced this pull request Aug 15, 2018
* elastic/master:
  Revert "cluster formation DSL - Gradle integration -  part 2 (#32028)" (#32876)
  cluster formation DSL - Gradle integration -  part 2 (#32028)
  Introduce global checkpoint listeners (#32696)
  Move connection profile into connection manager (#32858)
  [ML] Temporarily disabling rolling-upgrade tests
  Use generic AcknowledgedResponse instead of extended classes (#32859)
  [ML] Removing old per-partition normalization code (#32816)
  Use JDK 10 for 6.4 BWC builds (#32866)
  Removed flaky test. Looks like randomisation makes these assertions unreliable.
  [test] mute IndexShardTests.testDocStats
  Introduce the dissect library (#32297)
  Security: remove password hash bootstrap check (#32440)
  Move validation to server for put user requests (#32471)
  [ML] Add high level REST client docs for ML put job endpoint (#32843)
  Test: Fix forbidden uses in test framework (#32824)
  Painless: Change fqn_only to no_import (#32817)
  [test] mute testSearchWithSignificantTermsAgg
  Watcher: Remove unused hipchat render method (#32211)
  Watcher: Remove extraneous auth classes (#32300)
  Watcher: migrate PagerDuty v1 events API to v2 API (#32285)
@mark-vieira mark-vieira added the Team:Delivery Meta label for Delivery team label Nov 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Delivery/Build Build or test infrastructure >non-issue Team:Delivery Meta label for Delivery team v7.0.0-beta1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants