Replies: 3 comments 13 replies
-
|
Hello @johnmanko I am not entirely sure what exactly I am looking at as I don't use GitLab CI atm, but it seems to me that by you are telling the CI to actually run that image and run subsequent commands inside it. That is not how our builder image usually operates. You run quarkus app build on some docker capable system and quarkus itself uses docker to run ubi-quarkus-mandrel-builder-image for specific tasks itself, e.g. it runs it to call native-image compiler to package the native executable. So, while setting your CI this way, in general, you want something like:
|
Beta Was this translation helpful? Give feedback.
-
|
@johnmanko do I understand correctly that the Gitlab CI issue is now solved and you are now facing #40805? If so could you please mark this discussion as answered? |
Beta Was this translation helpful? Give feedback.
-
|
@zakkak Not resolved, yet. Issue #40805 outlines a problem building locally, though these are similar. Without the
With the
Both using the build command I figure getting the similar error resolved locally will go a long way to resolving the GitLab error (less factors in play). |
Beta Was this translation helpful? Give feedback.
-
|
I think I accidentally deleted the log I posted earlier. Let me know if there are additional logs you'd like to see. This is from the GitLab build: |
Beta Was this translation helpful? Give feedback.
-
|
Is there a container runtime available in your CI? Because Quarkus will start a container with Testcontainers only if there is one available. |
Beta Was this translation helpful? Give feedback.
-
|
@gsmet Yes, there is a container runtime: Docker/containerd. In fact, our GitLab instance is running in a Docker stack, and it launches the GitLab Runners on the same Docker runtime. All containers used by the project during the build uses the same runtime. I should note that issue #40805 is related specifically to the GitHub repo I created and referenced in that issue. I have another Quarkus project (the "real" project), for which THIS discuss is meant to address (The "test" is a clone of the "real" with renamed files/etc and stripped out endpoints). Oddly, even though the "test" (GitHub) project's local error is the same as this "real" project's GitLab error, the errors occur at different times in the build process. Additionally, there is no Local real project with extension: I'm focusing on the redis error, because that occurs even without the extension in GitLab. |
Beta Was this translation helpful? Give feedback.
-
|
Hi @johnmanko, at our client we build quarkus native image with GitLab using 2 stage. Initially we define the resulting image name in the variable: In the first stage we compile into native Linux executable binary NOTE: We define MAVEN_SETTINGS_XML file in GitLab CI/CD variable settings, and also keep the artifact in $CI_PROJECT_DIR/target/ If The second stage we build the docker image and push it to our docker registry using Docker In Docker (DIND) NOTE: We are using generated Quarkus |
Beta Was this translation helpful? Give feedback.
-
|
@DevEnol Thanks for that. I'll bookmark this and give it a try when ready. Do you have any |
Beta Was this translation helpful? Give feedback.
-
|
@DevEnol I incorporated your suggestions, and got a little further! Never seen an error like the below, though: variables:
MAVEN_CLI_OPTS: "-s .m2/settings.xml --batch-mode --errors --update-snapshots"
MAVEN_OPTS: "-Daether.connector.https.securityMode=insecure"
cache:
paths:
- .m2/repository/
- target
- public
test:
stage: test
image:
name: quay.io/quarkus/ubi-quarkus-mandrel-builder-image:jdk-21
entrypoint:
- ""
services:
- name: redis
alias: redis
script:
- ./mvnw quarkus:remove-extension -Dextensions='quarkus-container-image-docker'
- ./mvnw verify -X -Dquarkus.redis.hosts=redis://redis -Pnative -X
tags:
- quarkus
artifacts:
name: artifacts-build-native
expire_in: 1 days
paths:
- $CI_PROJECT_DIR/target/
only:
- master
- dev
- /^dev-[0-9]+(\.[0-9]+)+/
- /^master-[0-9]+(\.[0-9]+)+/
- tags |
Beta Was this translation helpful? Give feedback.
-
|
@johnmanko We are not using Regarding |
Beta Was this translation helpful? Give feedback.
-
|
@DevEnol Thanks for that. In solving the permissions issue, I jumped into the container while it was running (added a script:
- sleep 5m
- MAVEN_CONFIG="" ./mvnw clean package -Daether.connector.https.securityMode=insecure -s .m2/settings.xml --errors --update-snapshots -Dquarkus.redis.hosts="redis://redis" -Pnative Taking a look at the ownership of the files ( [quarkus@runner-kfkk5xzrr-project-118-concurrent-0 data-service]$ ls -al
total 88
drwxrwxrwx 9 root root 4096 May 29 13:24 .
drwxrwxrwx 4 root root 4096 May 24 22:49 ..
-rw-rw-rw- 1 root root 75 May 24 22:49 .dockerignore
drwxrwxrwx 2 root root 4096 May 24 22:49 docs
drwxrwxrwx 6 root root 4096 May 29 13:24 .git
-rw-rw-rw- 1 root root 461 May 28 13:48 .gitignore
-rw-rw-rw- 1 root root 7626 May 29 13:16 .gitlab-ci.yml
-rw-rw-rw- 1 root root 0 May 29 13:24 LICENSE
drwxrwxrwx 2 root root 4096 May 24 22:49 .m2
drwxrwxrwx 3 root root 4096 May 24 22:49 .mvn
-rwxrwxrwx 1 root root 11289 May 24 22:49 mvnw
-rw-rw-rw- 1 root root 7591 May 24 22:49 mvnw.cmd
-rw-rw-rw- 1 root root 11110 May 28 20:44 pom.xml
-rw-rw-rw- 1 root root 2718 May 27 04:43 README.md
drwxrwxrwx 2 root root 4096 May 28 13:48 redoc
drwxrwxrwx 4 root root 4096 May 24 22:49 src
drwxr-xr-x 10 root root 4096 May 29 13:16 target
[quarkus@runner-kfkk5xzrr-project-118-concurrent-0 data-service]$ ls -al target
total 60
drwxr-xr-x 10 root root 4096 May 29 13:16 .
drwxrwxrwx 9 root root 4096 May 29 13:24 ..
drwxr-xr-x 4 root root 4096 May 29 13:16 classes
drwxr-xr-x 3 root root 4096 May 29 13:16 generated-sources
drwxr-xr-x 3 root root 4096 May 29 13:16 generated-test-sources
drwxr-xr-x 2 root root 4096 May 29 13:16 maven-archiver
drwxr-xr-x 3 root root 4096 May 29 13:16 maven-status
-rw-r--r-- 1 root root 15661 May 29 13:16 data-service-1.0.0-SNAPSHOT.jar
drwxr-xr-x 5 root root 4096 May 29 13:16 quarkus-app
-rw-r--r-- 1 root root 206 May 29 13:16 quarkus-artifact.properties
drwxr-xr-x 2 root root 4096 May 29 13:16 smallrye
drwxr-xr-x 3 root root 4096 May 29 13:16 test-classes
[quarkus@runner-kfkk5xzrr-project-118-concurrent-0 data-service]$ whoami
quarkusI therefore updated the user id of the container in the yaml: image:
name: quay.io/quarkus/ubi-quarkus-mandrel-builder-image:jdk-21
entrypoint:
- ""
docker:
user: rootHere is the latest (notice test:
stage: test
image:
name: quay.io/quarkus/ubi-quarkus-mandrel-builder-image:jdk-21
entrypoint:
- ""
docker:
user: root
services:
- name: redis
alias: redis
- name: docker:dind
alias: docker
command: ["--tls=false"]
variables:
DOCKER_HOST: "tcp://docker:2375"
DOCKER_TLS_CERTDIR: ""
DOCKER_DRIVER: overlay2
script:
- MAVEN_CONFIG="" ./mvnw verify -Daether.connector.https.securityMode=insecure -DskipITs -s .m2/settings.xml --errors --update-snapshots -Dquarkus.redis.hosts="redis://redis" -Dnative
tags:
- quarkus
artifacts:
name: artifacts-build-native
expire_in: 1 days
paths:
- target
cache:
paths:
- target
- public
only:
- master
- dev
- /^dev-[0-9]+(\.[0-9]+)+/
- /^master-[0-9]+(\.[0-9]+)+/
- tagsThe result is that I'm able to build and unit test, but building the native image fails: I even removed the Runner config: Changes to services:
- name: redis
alias: redis
variables:
TESTCONTAINERS_HOST_OVERRIDE: "host.docker.internal"Neither of those methods for making docker available worked. |
Beta Was this translation helpful? Give feedback.
-
|
Success, sort of! Unit tests ( I had to add the following to my I just need to get the docker image stage working and I should be good. @DevEnol Thanks for your help! Your example proved invaluable. I'll update with the final report, and update the example repo with the final configs and README for others. Fingers crossed. |
Beta Was this translation helpful? Give feedback.
-
I'm trying to get my app to build a native container (and push to a Nexus repo in another phase), but the Quarkus builder image I'm using isn't working as expected.
Here is part of my
.gitlab-ci.ymlthat triggers the runner;The runner output and error:
I tried with the following combinations, too, all having their own error variation:
Override entrypoint and use
quarkuscommand (tried with./mvnw, too,):Change image and command:
Anyone get this working, especially with native builds and image push?
Beta Was this translation helpful? Give feedback.
All reactions