ci: use k8s pod template agents #2311

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Closed

v1v wants to merge 18 commits into elastic:main from v1v:feature/test-k8s-in-the-ci

Member

v1v commented Dec 5, 2021 •

edited

Loading

What does this PR do?

PoC with K8s CI Workers

Checklist

Why

Delegate the Agents configuration to the consumers
Faster provisioning.

For instance, the agent is provisioned almost immediately, compared to the 2 minutes average per CI worker

Actions

Cached workspace to speed up builds?
Matrix support for difference openjdk versions


          ci: use k8s pod template agents

725700f

v1v marked this pull request as draft

December 5, 2021 15:12

github-actions bot added the agent-java label

ghost commented Dec 5, 2021 •

edited by ghost

Loading

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Start Time: 2021-12-08T08:39:21.273+0000
Duration: 14 min 51 sec
Commit: 99f2581

Test stats 🧪

Test	Results
Failed	7
Passed	17
Skipped	0
Total	24

Test errors

Expand to view the tests failures

`Tests / Smoke Tests 01 / test[mysql jdbc:tc:mysql:5://hostname/databasename] – co.elastic.apm.agent.jdbc.JdbcDbIT`

Expand to view the error details

 Could not find a valid Docker environment. Please see logs and check configuration

Expand to view the stacktrace

 java.lang.IllegalStateException: Could not find a valid Docker environment. Please see logs and check configuration
	at co.elastic.apm.agent.jdbc.JdbcDbIT.<init>(JdbcDbIT.java:35)

`Tests / Smoke Tests 01 / test[postgresql jdbc:tc:postgresql:9://hostname/databasename] – co.elastic.apm.agent.jdbc.JdbcDbIT`

Expand to view the error details

 Previous attempts to find a Docker environment failed. Will not retry. Please see logs and check configuration

Expand to view the stacktrace

 java.lang.IllegalStateException: Previous attempts to find a Docker environment failed. Will not retry. Please see logs and check configuration
	at co.elastic.apm.agent.jdbc.JdbcDbIT.<init>(JdbcDbIT.java:35)

`Tests / Smoke Tests 01 / test[postgresql jdbc:tc:postgresql:10://hostname/databasename] – co.elastic.apm.agent.jdbc.JdbcDbIT`

Expand to view the error details

 Previous attempts to find a Docker environment failed. Will not retry. Please see logs and check configuration

Expand to view the stacktrace

 java.lang.IllegalStateException: Previous attempts to find a Docker environment failed. Will not retry. Please see logs and check configuration
	at co.elastic.apm.agent.jdbc.JdbcDbIT.<init>(JdbcDbIT.java:35)

`Tests / Smoke Tests 01 / test[mariadb jdbc:tc:mariadb:10://hostname/databasename] – co.elastic.apm.agent.jdbc.JdbcDbIT`

Expand to view the error details

 Previous attempts to find a Docker environment failed. Will not retry. Please see logs and check configuration

Expand to view the stacktrace

 java.lang.IllegalStateException: Previous attempts to find a Docker environment failed. Will not retry. Please see logs and check configuration
	at co.elastic.apm.agent.jdbc.JdbcDbIT.<init>(JdbcDbIT.java:35)

`Tests / Smoke Tests 01 / test[mssql jdbc:tc:sqlserver:2017-CU12://hostname/databasename] – co.elastic.apm.agent.jdbc.JdbcDbIT`

Expand to view the error details

 Previous attempts to find a Docker environment failed. Will not retry. Please see logs and check configuration

Expand to view the stacktrace

 java.lang.IllegalStateException: Previous attempts to find a Docker environment failed. Will not retry. Please see logs and check configuration
	at co.elastic.apm.agent.jdbc.JdbcDbIT.<init>(JdbcDbIT.java:35)

`Tests / Smoke Tests 01 / test[db2 jdbc:tc:db2:11.5.0.0a://hostname/databasename] – co.elastic.apm.agent.jdbc.JdbcDbIT`

Expand to view the error details

 Previous attempts to find a Docker environment failed. Will not retry. Please see logs and check configuration

Expand to view the stacktrace

 java.lang.IllegalStateException: Previous attempts to find a Docker environment failed. Will not retry. Please see logs and check configuration
	at co.elastic.apm.agent.jdbc.JdbcDbIT.<init>(JdbcDbIT.java:35)

`Tests / Smoke Tests 01 / test[oracle jdbc:tc:oracle://hostname/databasename] – co.elastic.apm.agent.jdbc.JdbcDbIT`

Expand to view the error details

 Previous attempts to find a Docker environment failed. Will not retry. Please see logs and check configuration

Expand to view the stacktrace

 java.lang.IllegalStateException: Previous attempts to find a Docker environment failed. Will not retry. Please see logs and check configuration
	at co.elastic.apm.agent.jdbc.JdbcDbIT.<init>(JdbcDbIT.java:35)

Steps errors

Expand to view the steps failures

`Shell Script`

Took 1 min 51 sec . View more details here
Description: ./scripts/jenkins/smoketests-01.sh

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

🤖 GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.
run benchmark tests : Run the benchmark test.
run compatibility tests : Run the JDK Compatibility test.
run integration tests : Run the APM-ITs.
run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

v1v added 6 commits

December 5, 2021 15:33


          Debug

4f79580


          More verbose

e9e6ac8


          Otherwise it clashes with an existing OpenJdkPod in another repository

e470af2


          use debian 11

8ca5d9a


          more debug

f5a2c5f


          trying with mvn3 and jdk11

e17e1d3

v1v force-pushed the feature/test-k8s-in-the-ci branch from 1515460 to e17e1d3 Compare

December 5, 2021 16:20

v1v added 6 commits

December 5, 2021 16:23


          Revert "trying with mvn3 and jdk11"

49e04d8

This reverts commit e17e1d3.


          Revert "use debian 11"

4b4541c

This reverts commit 8ca5d9a.


          Revert "Otherwise it clashes with an existing OpenJdkPod in another r…

1e16467

…epository"

This reverts commit e470af2.


          Use the container step

c3f234f


          Remove debug

5fd959b


          Add next steps

c777625

v1v commented

View reviewed changes

.ci/k8s/OpenJdkPod.yml

    
                  - sleep

                  args:

                  - infinity

              ## TODO: Faster builds with some cached artifacts.

Member Author

v1v Dec 5, 2021

Interesting enough:

vs

v1v added 4 commits

December 5, 2021 16:56


          Prepare the context within the container closure

d4c425d


          Enable matrix support

1b59f0b


          Trying to solve the concurrency issue with the top-level agent and th…

8019abb

…e deleteDir/unstash in parallel stages


          use the right docker tags

700a358

Member Author

v1v commented Dec 7, 2021

@Mergifyio refresh

Contributor

mergify bot commented Dec 7, 2021

refresh

✅ Pull request refreshed

v1v commented

View reviewed changes

Jenkinsfile

    
                      */

                      stage('Smoke Tests 01') {

                        agent { label 'linux && immutable' }

                        agent { kubernetes { yamlFile '.ci/k8s/OpenJdkPod.yml' } }

Member Author

v1v Dec 7, 2021

IIRC, this was the way to ensure the parallel stages don't clash with the workspace when using the top-level k8s definition.

I need to clarify this to be sure this is the right pattern to be used.

Member Author

v1v commented Dec 7, 2021

@Mergifyio update


          Merge branch 'master' into feature/test-k8s-in-the-ci

99f2581

Contributor

mergify bot commented Dec 7, 2021

update

✅ Branch has been successfully updated

v1v mentioned this pull request

ci: k8s agents in the ci #2465

Closed

Contributor

eyalkoren commented Feb 5, 2023

@v1v do we want to proceed with this, or can I close this PR?

Member Author

v1v commented Feb 5, 2023

Closing this issue as we are moving away from Jenkins

v1v closed this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels