Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[wip] declarative pod specs #3575

Draft
wants to merge 13 commits into
base: master
Choose a base branch
from
+83 −52
Draft

[wip] declarative pod specs #3575

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
aec7226
wip
tasso94 Jul 11, 2023
ded10f4
wip
tasso94 Jul 11, 2023
1152567
wip
tasso94 Jul 11, 2023
4b1faca
wip
tasso94 Jul 11, 2023
37f28ad
wip
tasso94 Jul 11, 2023
04d84b3
wip
tasso94 Jul 11, 2023
5c4ea70
wip
tasso94 Jul 11, 2023
c212b6d
wip
tasso94 Jul 11, 2023
4c59ce5
wip
tasso94 Jul 12, 2023
54f41af
wip
tasso94 Jul 12, 2023
96452db
wip
tasso94 Jul 12, 2023
58b965a
wip
tasso94 Jul 13, 2023
2eeee40
wip
tasso94 Jul 13, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
131 changes: 81 additions & 50 deletions Jenkinsfile
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
// https://github.com/camunda/jenkins-global-shared-library
// https://github.com/camunda/cambpm-jenkins-shared-library
@Library(['camunda-ci', 'cambpm-jenkins-shared-library']) _
@Library(['camunda-ci', 'cambpm-jenkins-shared-library@declarative-pod-specs']) _

def failedStageTypes = []

Expand Down Expand Up @@ -35,45 +35,77 @@ pipeline {
}
steps {
cambpmConditionalRetry([
agentLabel: 'h2_perf32',
podSpec: """
apiVersion: v1
kind: Pod
metadata:
labels:
agent: ap7-ci-build-experiment
spec:
nodeSelector:
cloud.google.com/gke-nodepool: agents-n1-standard-32-netssd-stable
tolerations:
- key: "agents-n1-standard-32-netssd-stable"
operator: "Exists"
effect: "NoSchedule"
containers:
- name: maven
image: maven:3.8.7-eclipse-temurin-17
tty: true
command:
- sleep
args:
- 99d
env:
- name: TZ
value: Europe/Berlin
resources:
limits:
cpu: 3000m
memory: 60Gi
requests:
cpu: 3000m
memory: 60Gi
workingDir: "/home/jenkins/agent"
""",
suppressErrors: false,
runSteps: {
runSteps : {
sh(label: 'GIT: Mark current directory as safe', script: "git config --global --add safe.directory \$PWD")

withVault([vaultSecrets: [
[
path : 'secret/products/cambpm/ci/xlts.dev',
secretValues: [
[envVar: 'XLTS_REGISTRY', vaultKey: 'registry'],
[envVar: 'XLTS_AUTH_TOKEN', vaultKey: 'authToken']]
]]]) {
[
path : 'secret/products/cambpm/ci/xlts.dev',
secretValues: [
[envVar: 'XLTS_REGISTRY', vaultKey: 'registry'],
[envVar: 'XLTS_AUTH_TOKEN', vaultKey: 'authToken']]
]]]) {
cambpmRunMaven('.',
'clean source:jar deploy source:test-jar com.mycila:license-maven-plugin:check -Pdistro,distro-ce,distro-wildfly,distro-webjar,h2-in-memory -DaltStagingDirectory=${WORKSPACE}/staging -DskipRemoteStaging=true',
withCatch: false,
withNpm: true,
// we use JDK 17 to build the artifacts, as it is required for supporting Spring Boot 3
// the compiler source and target is set to JDK 8 in the release parents
jdkVersion: 'jdk-17-latest')
'clean source:jar deploy source:test-jar com.mycila:license-maven-plugin:check -Pdistro,distro-ce,distro-wildfly,distro-webjar,h2-in-memory -DaltStagingDirectory=${WORKSPACE}/staging -DskipRemoteStaging=true',
withCatch: false,
withNpm: true,
jdkVersion: null)
}

// archive all .jar, .pom, .xml, .txt runtime artifacts + required .war/.zip/.tar.gz for EE pipeline
// add a new line for each group of artifacts
cambpmArchiveArtifacts('.m2/org/camunda/**/*-SNAPSHOT/**/*.jar,.m2/org/camunda/**/*-SNAPSHOT/**/*.pom,.m2/org/camunda/**/*-SNAPSHOT/**/*.xml,.m2/org/camunda/**/*-SNAPSHOT/**/*.txt',
'.m2/org/camunda/**/*-SNAPSHOT/**/camunda-webapp*frontend-sources.zip',
'.m2/org/camunda/**/*-SNAPSHOT/**/license-book*.zip',
'.m2/org/camunda/**/*-SNAPSHOT/**/camunda-*-assembly*.tar.gz',
'.m2/org/camunda/**/*-SNAPSHOT/**/camunda-webapp*.war',
'.m2/org/camunda/**/*-SNAPSHOT/**/camunda-engine-rest*.war',
'.m2/org/camunda/**/*-SNAPSHOT/**/camunda-example-invoice*.war',
'.m2/org/camunda/**/*-SNAPSHOT/**/camunda-bpm-run-modules-swaggerui-*-run-swaggerui-license-book-json.json')

'.m2/org/camunda/**/*-SNAPSHOT/**/camunda-webapp*frontend-sources.zip',
'.m2/org/camunda/**/*-SNAPSHOT/**/license-book*.zip',
'.m2/org/camunda/**/*-SNAPSHOT/**/camunda-*-assembly*.tar.gz',
'.m2/org/camunda/**/*-SNAPSHOT/**/camunda-webapp*.war',
'.m2/org/camunda/**/*-SNAPSHOT/**/camunda-engine-rest*.war',
'.m2/org/camunda/**/*-SNAPSHOT/**/camunda-example-invoice*.war',
'.m2/org/camunda/**/*-SNAPSHOT/**/camunda-bpm-run-modules-swaggerui-*-run-swaggerui-license-book-json.json')
cambpmStash("platform-stash-runtime",
".m2/org/camunda/**/*-SNAPSHOT/**",
"**/qa/**,**/*qa*/**,**/*.zip,**/*.tar.gz")
".m2/org/camunda/**/*-SNAPSHOT/**",
"**/qa/**,**/*qa*/**,**/*.zip,**/*.tar.gz")
cambpmStash("platform-stash-archives",
".m2/org/camunda/bpm/**/*-SNAPSHOT/**/*.zip,.m2/org/camunda/bpm/**/*-SNAPSHOT/**/*.tar.gz")
".m2/org/camunda/bpm/**/*-SNAPSHOT/**/*.zip,.m2/org/camunda/bpm/**/*-SNAPSHOT/**/*.tar.gz")
cambpmStash("platform-stash-qa",
".m2/org/camunda/bpm/**/qa/**/*-SNAPSHOT/**,.m2/org/camunda/bpm/**/*qa*/**/*-SNAPSHOT/**",
"**/*.zip,**/*.tar.gz")

".m2/org/camunda/bpm/**/qa/**/*-SNAPSHOT/**,.m2/org/camunda/bpm/**/*qa*/**/*-SNAPSHOT/**",
"**/*.zip,**/*.tar.gz")
script {
if (env.BRANCH_NAME == cambpmDefaultBranch()) {
// CE master triggers EE master
Expand All @@ -82,22 +114,22 @@ pipeline {
} else {
eeMainProjectBranch = params.EE_DOWNSTREAM
}

// JOB_NAME, e.g.: '7.15/cambpm-ce/cambpm-main/PR-1373'
// keep leading slash for the absolute project path
platformVersionDir = "/" + env.JOB_NAME.split('/')[0]
upstreamProjectName = "/" + env.JOB_NAME
upstreamBuildNumber = env.BUILD_NUMBER

if (env.BRANCH_NAME == cambpmDefaultBranch() || cambpmWithLabels('webapp-integration', 'all-as', 'h2', 'websphere', 'weblogic', 'jbosseap', 'run', 'spring-boot', 'e2e')) {
cambpmTriggerDownstream(
platformVersionDir + "/cambpm-ee/" + eeMainProjectBranch,
[string(name: 'UPSTREAM_PROJECT_NAME', value: upstreamProjectName),
string(name: 'UPSTREAM_BUILD_NUMBER', value: upstreamBuildNumber)],
string(name: 'UPSTREAM_BUILD_NUMBER', value: upstreamBuildNumber)],
true, true, true, true
)
}

// the sidetrack pipeline should be triggered on daily,
// or PR builds only, master builds should be excluded.
// The Sidetrack pipeline contains CRDB and Azure DB stages,
Expand All @@ -106,36 +138,35 @@ pipeline {
cambpmTriggerDownstream(
platformVersionDir + "/cambpm-ce/cambpm-sidetrack/${env.BRANCH_NAME}",
[string(name: 'UPSTREAM_PROJECT_NAME', value: upstreamProjectName),
string(name: 'UPSTREAM_BUILD_NUMBER', value: upstreamBuildNumber)]
string(name: 'UPSTREAM_BUILD_NUMBER', value: upstreamBuildNumber)]
)
}

// don't trigger the daily pipeline from a master branch build
// or if a PR has no relevant labels
if (env.BRANCH_NAME != cambpmDefaultBranch() && cambpmWithLabels('default-build', 'jdk', 'rolling-update', 'migration', 'wildfly', 'all-db', 'h2', 'db2', 'mysql', 'oracle', 'mariadb', 'sqlserver', 'postgresql')) {
cambpmTriggerDownstream(
platformVersionDir + "/cambpm-ce/cambpm-daily/${env.BRANCH_NAME}",
[string(name: 'UPSTREAM_PROJECT_NAME', value: upstreamProjectName),
string(name: 'UPSTREAM_BUILD_NUMBER', value: upstreamBuildNumber)]
string(name: 'UPSTREAM_BUILD_NUMBER', value: upstreamBuildNumber)]
)
}

// only execute on version (default) branch (e.g. master, 7.15)
if (env.BRANCH_NAME == cambpmDefaultBranch()) {
cambpmRunMaven('.',
'org.sonatype.plugins:nexus-staging-maven-plugin:deploy-staged -DaltStagingDirectory=${WORKSPACE}/staging -DskipStaging=true',
withCatch: false,
withNpm: true)
'org.sonatype.plugins:nexus-staging-maven-plugin:deploy-staged -DaltStagingDirectory=${WORKSPACE}/staging -DskipStaging=true',
withCatch: false,
withNpm: true)
}
}
},
postFailure: {
postFailure : {
cambpmPublishTestResult()
// archive any heap dumps generated in the target folder
cambpmArchiveArtifacts(false, '**/target/*.hprof')
}
])

}
}
stage('h2 UNIT, engine IT, webapp IT') {
Expand Down Expand Up @@ -223,9 +254,9 @@ pipeline {
cambpmConditionalRetry([
agentLabel: 'postgresql_142',
runSteps: {
cambpmRunMaven('qa/',
'clean install -Pwildfly,postgresql,engine-integration-jakarta',
runtimeStash: true,
cambpmRunMaven('qa/',
'clean install -Pwildfly,postgresql,engine-integration-jakarta',
runtimeStash: true,
archiveStash: true,
// we need to use JDK 17 for WildFly 27+ + Spring 6
jdkVersion: 'jdk-17-latest')
Expand Down Expand Up @@ -268,9 +299,9 @@ pipeline {
cambpmConditionalRetry([
agentLabel: 'postgresql_142',
runSteps: {
cambpmRunMaven('qa/',
'clean install -Pwildfly,postgresql,postgresql-xa,engine-integration-jakarta',
runtimeStash: true,
cambpmRunMaven('qa/',
'clean install -Pwildfly,postgresql,postgresql-xa,engine-integration-jakarta',
runtimeStash: true,
archiveStash: true,
// we need to use JDK 17 for WildFly 27+ + Spring 6
jdkVersion: 'jdk-17-latest')
Expand Down Expand Up @@ -511,7 +542,7 @@ pipeline {
cambpmConditionalRetry([
agentLabel: 'h2',
runSteps: {
cambpmRunMaven('qa/',
cambpmRunMaven('qa/',
'clean install -Pwildfly-domain,h2,engine-integration-jakarta',
runtimeStash: true,
archiveStash: true,
Expand Down
4 changes: 2 additions & 2 deletions parent/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -68,8 +68,8 @@
<version.jakarta-ee-spec>10.0.0</version.jakarta-ee-spec>

<version.eirslett.frontend.maven.plugin>1.12.1</version.eirslett.frontend.maven.plugin>
<version.nodejs>17.9.1</version.nodejs>
<version.npm>8.11.0</version.npm>
<version.nodejs>18.16.1</version.nodejs>
<version.npm>9.5.1</version.npm>

<!-- OSGi bundles properties -->
<camunda.artifact />
Expand Down