New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
release: 0.7.0-alpha.2 #390
release: 0.7.0-alpha.2 #390
Conversation
helm/reana/values.yaml
Outdated
@@ -56,15 +56,15 @@ components: | |||
enabled: true | |||
reana_server: | |||
imagePullPolicy: IfNotPresent | |||
image: reanahub/reana-server:0.7.0-alpha.1 | |||
image: reanahub/reana-server:0.7.0-alpha.2 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
When updating this PR, you can edit NOTES.txt
to put mysecretpassword
back where mypass1234
now is... I had shortened it to fit 80 columns, but the formatting now allows the original value mysecretpassword
that we also use elsewhere... so I think we can put it back.
8f77b72
to
f671c73
Compare
a07719b
to
158329f
Compare
environment: | ||
SHARED_VOLUME_PATH: /var/reana | ||
reana_workflow_engine_cwl: | ||
image: reanahub/reana-workflow-engine-cwl:0.7.0-alpha.1 | ||
reana_workflow_engine_yadage: | ||
image: reanahub/reana-workflow-engine-yadage:0.7.0-alpha.1 | ||
image: reanahub/reana-workflow-engine-yadage:0.7.0-alpha.2 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I see the tag is called 0.7.0a2 instead of 0.7.0-alpha.2
, is this correct? Looks wrong to me.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Git tag is following Python versioning conventions (PEP0440), hence 0.7.0a2
. The produced Docker image is following semantic versioning conventions, hence 0.7.0-alpha.2
. The correspondence is handled by reana-dev
...
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actually, what Marco points to is the Docker tag (see here) which is wrongly following PEP440. Did you release "manually" or did you use reana-dev
? if so we might have a bug around here?
reana/reana/reana_dev/release.py
Lines 119 to 120 in e0a29b6
if parse_pep440_version(current_tag): | |
docker_tag = translate_pep440_to_semver2(current_tag) |
I've recently released RJC using reana-dev
and it correctly got the semver version...
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Fixed.
Hmm, it looks like it must have been manual, but I don't seem to have any entrance at all about tagging 0.7.0a2
in my shell history... Moreover alpha.1 was released well before... So I don't recall what happened. Let's see next time.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
... ah, I might know how it happened:
$ cd reana-server
$ git checkout maint-0.7
$ reana-dev docker-build -c . -t auto
reana-dev docker-build -c . -t auto
[2020-09-25T16:13:46] reana-server: git describe --tags
[2020-09-25T16:13:46] reana-server: docker build -t reanahub/reana-server:0.7.0a3 .
^C
Aborted!
I must have used -t auto
probably... I'll create an issue.
158329f
to
dcee31f
Compare
dcee31f
to
6ac05f2
Compare
@@ -5,18 +5,18 @@ finalise its configuration. | |||
|
|||
1. Initialise the database: | |||
|
|||
$ kubectl exec deployment/reana-server -c rest-api -- \ | |||
$ kubectl -n {{ .Release.Namespace }} exec deployment/{{ .Release.Name }}-server -c rest-api -- \ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I have tested various combinations of specifying release namespace and release name, and pushed some fixes so that printed instructions would be copy-paste-able to work out of the box.
I have also amended scripts/create-admin-user.sh
and friends accordingly.
However, some observations: when using
$ helm install helm/reana --wait --generate-name
NAME: reana-1601457612
...
The things don't work, because the pods are created like this:
$ kubectl get pods
NAME READY STATUS RESTARTS AGE
reana-1601457-cache-57ccbd4644-jgfcw 1/1 Running 0 72s
reana-1601457-db-5f5cdd4d85-xjtcz 1/1 Running 0 72s
reana-1601457-message-broker-96f547668-77x8p 1/1 Running 0 72s
reana-1601457-server-555589bdfd-c7hg7 2/2 Running 0 72s
reana-1601457-ui-675dd98f65-m6xkr 1/1 Running 0 72s
reana-1601457-workflow-controller-78b67dd89b-2bnhs 2/2 Running 0 72s
reana-1601457612-traefik-7cf64f9d88-rhrnz 1/1 Running 0 72s
Note that only traefik respects the generated name; the others are "cut".
(2) Using a name like "reana", "myreana" or "reanadev" works well, but using a name like "xyzzy" generates troubles too, as "-reana" is being appended to infrastructure pods:
$ kubectl get pods
NAME READY STATUS RESTARTS AGE
xyzzy-reana-cache-567465756b-kgmsv 1/1 Running 0 119s
xyzzy-reana-db-5c5879d79f-n6ff9 1/1 Running 0 119s
xyzzy-reana-message-broker-55bc649d74-8nbdw 1/1 Running 0 119s
xyzzy-reana-server-669cf6b988-x7lw7 2/2 Running 0 119s
xyzzy-reana-ui-8669c86f5f-pf5tg 1/1 Running 0 119s
xyzzy-reana-workflow-controller-7998dff758-kh94h 2/2 Running 0 119s
xyzzy-traefik-687fb5c4c9-rd296 1/1 Running 0 119s
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
... to be compared to "good" situations like:
$ kubectl get pods
NAME READY STATUS RESTARTS AGE
reananew-cache-5759888787-l4v9h 1/1 Running 0 19m
reananew-db-79f7bfdb5d-lb9d5 1/1 Running 0 19m
reananew-message-broker-5759645bdc-xln8h 1/1 Running 0 19m
reananew-server-565874b4b7-s58jb 2/2 Running 0 19m
reananew-traefik-747ff4b6df-2mgf7 1/1 Running 0 19m
reananew-ui-5dbc478766-bpwdx 1/1 Running 0 19m
reananew-workflow-controller-6785d47659-rnbsq 2/2 Running 0 19m
The only thing in the helm install ...
command that changed was the wanted name.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Note that only traefik respects the generated name; the others are "cut".
We had to truncate the name because of this. The solution here would be changing the prefix for dependencies, to use the same as REANA, working on it.
(2) Using a name like "reana", "myreana" or "reanadev" works well, but using a name like "xyzzy" generates troubles too, as "-reana" is being appended to infrastructure pods:
This was a conscious decision in the past: if the application name is not contained in the name chosen by the user, the -reana-
suffix is added. If we are ok with xyz
as valid component prefix (e.g. xyz-cache-5759888787-l4v9h
) I can remove the suffix logic.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Some thoughts on this:
-
Let's not do too deep code changes in the alpha release times indeed... So:
-
if we need to truncate names (yeah, sha1s can be loooong), then let's document that people should use release names shorter than N characters. (I mean document somewhere visibly in
docs.reana.io
.) -
Ideally, when people would do
helm install myverylongnamethatcannnotbeused ...
, it would be perfect if helm replied "Sorry cannot use such a long name" if there was ever a way?!
-
-
Requiring "reana-" prefix might be understandable, but "contains" seems a bit arbitrary, giving people choice append? prepend? I'd say if we don't need
reana
, then let's remove it, and allow users to use whatever they think fit. Somebody might want to name their reana instance in non-reana way, after all.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
if we need to truncate names (yeah, sha1s can be loooong), then let's document that people should use release names shorter than N characters. (I mean document somewhere visibly in docs.reana.io.)
Added in reanahub/docs.reana.io#62. As a long term solution we could look at relying on labels
to store the UUID and component_type
(see our component naming scheme). We already use labels to store the workflow run mode so it should be easy.
Ideally, when people would do helm install myverylongnamethatcannnotbeused ..., it would be perfect if helm replied "Sorry cannot use such a long name" if there was ever a way?!
I couldn't find a way of doing this.
but "contains" seems a bit arbitrary, giving people choice append? prepend?
Fixed. Just to give some background on this; the "contains" approach is used by most of Helm based projects (see here) that's the reason we went for it.
c82b7c4
to
6722747
Compare
Amends `NOTES.txt` to issue exact commands needed to run in case user sets a deployment name and/or deploys in another namespace. Amends deployment scripts accordingly. Signed-off-by: Tibor Šimko <tibor.simko@cern.ch>
6722747
to
6480a73
Compare
6480a73
to
547b167
Compare
547b167
to
3a74995
Compare
chore(reana-ui/master): release 0.9.4 build(reana-ui/package): update yarn.lock (reanahub#399) build(reana-ui/package): require jsroot<7.6.0 (reanahub#399) ci(reana-ui/commitlint): allow release commit style (reanahub#400) docs(reana-ui/authors): complete list of contributors (reanahub#396) ci(reana-ui/shellcheck): exclude node_modules from the analyzed paths (reanahub#387) fix(reana-ui/progress): update failed workflows duration using finish time (reanahub#387) feat(reana-ui/footer): link privacy notice to configured URL (reanahub#393) refactor(reana-ui/docs): move from reST to Markdown (reanahub#391) ci(reana-ui/commitlint): check for the presence of concrete PR number (reanahub#390) ci(reana-ui/shellcheck): fix exit code propagation (reanahub#390) fix(reana-ui/launcher): remove dollar sign in generated Markdown (reanahub#389) ci(reana-ui/release-please): update version in package.json and Dockerfile (reanahub#385) ci(reana-ui/release-please): switch to `simple` release strategy (reanahub#383) fix(reana-ui/router): show 404 page for invalid URLs (reanahub#382) ci(reana-ui/release-please): initial configuration (reanahub#380) ci(reana-ui/commitlint): addition of commit message linter (reanahub#380) chore(reana-message-broker/master): release 0.9.3 ci(reana-message-broker/commitlint): allow release commit style (reanahub#67) docs(reana-message-broker/authors): complete list of contributors (reanahub#66) refactor(reana-message-broker/docs): move from reST to Markdown (reanahub#65) ci(reana-message-broker/commitlint): check for the presence of concrete PR number (reanahub#64) ci(reana-message-broker/shellcheck): fix exit code propagation (reanahub#64) ci(reana-message-broker/release-please): update version in Dockerfile (reanahub#63) fix(reana-message-broker/startup): handle signals for graceful shutdown (reanahub#59) ci(reana-message-broker/release-please): initial configuration (reanahub#60) ci(reana-message-broker/commitlint): addition of commit message linter (reanahub#60) chore(reana-server/master): release 0.9.3 build(reana-server/python): bump all required packages as of 2024-03-04 (reanahub#674) build(reana-server/python): bump shared REANA packages as of 2024-03-04 (reanahub#674) build(reana-server/python): bump shared modules (reanahub#676) ci(reana-server/commitlint): allow release commit style (reanahub#675) docs(reana-server/authors): complete list of contributors (reanahub#673) ci(reana-server/pytest): move to PostgreSQL 14.10 (reanahub#672) refactor(reana-server/docs): move from reST to Markdown (reanahub#671) style(reana-server/black): format with black v24 (reanahub#670) ci(reana-server/commitlint): check for the presence of concrete PR number (reanahub#669) ci(reana-server/shellcheck): fix exit code propagation (reanahub#669) ci(reana-server/release-please): update version in Dockerfile/OpenAPI specs (reanahub#668) build(reana-server/docker): non-editable submodules in "latest" mode (reanahub#656) build(reana-server/deps): pin invenio-userprofiles to 1.2.4 (reanahub#665) ci(reana-server/release-please): initial configuration (reanahub#665) ci(reana-server/commitlint): addition of commit message linter (reanahub#665) chore(reana-workflow-controller/master): release 0.9.3 build(reana-workflow-controller/python): bump all required packages as of 2024-03-04 (reanahub#574) build(reana-workflow-controller/python): bump shared REANA packages as of 2024-03-04 (reanahub#574) feat(reana-workflow-controller/manager): increase termination period of run-batch pods (reanahub#572) ci(reana-workflow-controller/commitlint): allow release commit style (reanahub#575) feat(reana-workflow-controller/manager): pass custom env variables to job controller (reanahub#571) feat(reana-workflow-controller/manager): pass custom env variables to workflow engines (reanahub#571) docs(reana-workflow-controller/authors): complete list of contributors (reanahub#570) ci(reana-workflow-controller/pytest): move to PostgreSQL 14.10 (reanahub#568) fix(reana-workflow-controller/manager): use valid group name when calling `groupadd` (reanahub#566) refactor(reana-workflow-controller/docs): move from reST to Markdown (reanahub#567) fix(reana-workflow-controller/stop): store engine logs of stopped workflow (reanahub#563) fix(reana-workflow-controller/manager): graceful shutdown of job-controller (reanahub#559) feat(reana-workflow-controller/manager): call shutdown endpoint before workflow stop (reanahub#559) refactor(reana-workflow-controller/consumer): do not update status of jobs (reanahub#559) style(reana-workflow-controller/black): format with black v24 (reanahub#564) ci(reana-workflow-controller/commitlint): check for the presence of concrete PR number (reanahub#562) ci(reana-workflow-controller/shellcheck): fix exit code propagation (reanahub#562) ci(reana-workflow-controller/release-please): update version in Dockerfile/OpenAPI specs (reanahub#558) build(reana-workflow-controller/docker): non-editable submodules in "latest" mode (reanahub#551) ci(reana-workflow-controller/release-please): initial configuration (reanahub#555) ci(reana-workflow-controller/commitlint): addition of commit message linter (reanahub#555) chore(reana-job-controller/master): release 0.9.3 build(reana-job-controller/python): bump all required packages as of 2024-03-04 (reanahub#442) build(reana-job-controller/python): bump shared REANA packages as of 2024-03-04 (reanahub#442) ci(reana-job-controller/commitlint): allow release commit style (reanahub#443) build(reana-job-controller/certificates): update expired CERN Grid CA certificate (reanahub#440) fix(reana-job-controller/database): limit the number of open database connections (reanahub#437) docs(reana-job-controller/authors): complete list of contributors (reanahub#434) perf(reana-job-controller/cache): avoid caching jobs when the cache is disabled (reanahub#435) ci(reana-job-controller/pytest): move to PostgreSQL 14.10 (reanahub#429) refactor(reana-job-controller/docs): move from reST to Markdown (reanahub#428) ci(reana-job-controller/commitlint): check for the presence of concrete PR number (reanahub#425) ci(reana-job-controller/shellcheck): fix exit code propagation (reanahub#425) feat(reana-job-controller/shutdown): stop all running jobs before stopping workflow (reanahub#423) refactor(reana-job-controller/monitor): move fetching of logs to job-manager (reanahub#423) refactor(reana-job-controller/db): set job status also in the main database (reanahub#423) refactor(reana-job-controller/monitor): centralise logs and status updates (reanahub#423) style(reana-job-controller/black): format with black v24 (reanahub#426) ci(reana-job-controller/release-please): update version in Dockerfile/OpenAPI specs (reanahub#421) build(reana-job-controller/docker): non-editable submodules in "latest" mode (reanahub#416) ci(reana-job-controller/release-please): initial configuration (reanahub#417) ci(reana-job-controller/commitlint): addition of commit message linter (reanahub#417) chore(reana-workflow-engine-cwl/master): release 0.9.3 build(reana-workflow-engine-cwl/python): bump all required packages as of 2024-03-04 (reanahub#267) build(reana-workflow-engine-cwl/python): bump shared REANA packages as of 2024-03-04 (reanahub#267) docs(reana-workflow-engine-cwl/conformance-tests): update CWL conformance test badges (reanahub#264) ci(reana-workflow-engine-cwl/commitlint): allow release commit style (reanahub#268) docs(reana-workflow-engine-cwl/authors): complete list of contributors (reanahub#266) refactor(reana-workflow-engine-cwl/docs): move from reST to Markdown (reanahub#263) fix(reana-workflow-engine-cwl/progress): handle stopped jobs (reanahub#260) ci(reana-workflow-engine-cwl/commitlint): check for the presence of concrete PR number (reanahub#262) ci(reana-workflow-engine-cwl/shellcheck): fix exit code propagation (reanahub#262) build(reana-workflow-engine-cwl/docker): install correct extras of reana-commons submodule (reanahub#261) ci(reana-workflow-engine-cwl/release-please): update version in Dockerfile (reanahub#259) build(reana-workflow-engine-cwl/docker): non-editable submodules in "latest" mode (reanahub#255) ci(reana-workflow-engine-cwl/release-please): initial configuration (reanahub#256) ci(reana-workflow-engine-cwl/commitlint): addition of commit message linter (reanahub#256) chore(reana-workflow-engine-serial/master): release 0.9.3 build(reana-workflow-engine-serial/python): bump all required packages as of 2024-03-04 (reanahub#200) build(reana-workflow-engine-serial/python): bump shared REANA packages as of 2024-03-04 (reanahub#200) ci(reana-workflow-engine-serial/commitlint): allow release commit style (reanahub#201) docs(reana-workflow-engine-serial/authors): complete list of contributors (reanahub#199) refactor(reana-workflow-engine-serial/docs): move from reST to Markdown (reanahub#198) fix(reana-workflow-engine-serial/progress): handle stopped jobs (reanahub#195) ci(reana-workflow-engine-serial/commitlint): check for the presence of concrete PR number (reanahub#197) ci(reana-workflow-engine-serial/shellcheck): fix exit code propagation (reanahub#197) build(reana-workflow-engine-serial/docker): install correct extras of reana-commons submodule (reanahub#196) ci(reana-workflow-engine-serial/release-please): update version in Dockerfile (reanahub#194) build(reana-workflow-engine-serial/docker): non-editable submodules in "latest" mode (reanahub#190) ci(reana-workflow-engine-serial/release-please): initial configuration (reanahub#191) ci(reana-workflow-engine-serial/commitlint): addition of commit message linter (reanahub#191) chore(reana-workflow-engine-yadage/master): release 0.9.4 build(reana-workflow-engine-yadage/python): bump all required packages as of 2024-03-04 (reanahub#261) build(reana-workflow-engine-yadage/python): bump shared REANA packages as of 2024-03-04 (reanahub#261) ci(reana-workflow-engine-yadage/commitlint): allow release commit style (reanahub#262) docs(reana-workflow-engine-yadage/authors): complete list of contributors (reanahub#260) refactor(reana-workflow-engine-yadage/docs): move from reST to Markdown (reanahub#259) fix(reana-workflow-engine-yadage/progress): correctly handle running and stopped jobs (reanahub#258) ci(reana-workflow-engine-yadage/commitlint): check for the presence of concrete PR number (reanahub#257) ci(reana-workflow-engine-yadage/shellcheck): fix exit code propagation (reanahub#257) build(reana-workflow-engine-yadage/docker): install correct extras of reana-commons submodule (reanahub#256) ci(reana-workflow-engine-yadage/release-please): update version in Dockerfile (reanahub#254) build(reana-workflow-engine-yadage/docker): non-editable submodules in "latest" mode (reanahub#249) ci(reana-workflow-engine-yadage/release-please): initial configuration (reanahub#251) ci(reana-workflow-engine-yadage/commitlint): addition of commit message linter (reanahub#251) chore(reana-workflow-engine-snakemake/master): release 0.9.3 build(reana-workflow-engine-snakemake/python): bump all required packages as of 2024-03-04 (reanahub#85) build(reana-workflow-engine-snakemake/python): bump shared REANA packages as of 2024-03-04 (reanahub#85) ci(reana-workflow-engine-snakemake/commitlint): allow release commit style (reanahub#86) feat(reana-workflow-engine-snakemake/config): get max number of parallel jobs from env vars (reanahub#84) feat(reana-workflow-engine-snakemake/executor): upgrade to Snakemake v7.32.4 (reanahub#81) docs(reana-workflow-engine-snakemake/authors): complete list of contributors (reanahub#83) refactor(reana-workflow-engine-snakemake/docs): move from reST to Markdown (reanahub#82) fix(reana-workflow-engine-snakemake/progress): handle stopped jobs (reanahub#78) ci(reana-workflow-engine-snakemake/commitlint): check for the presence of concrete PR number (reanahub#80) ci(reana-workflow-engine-snakemake/shellcheck): fix exit code propagation (reanahub#80) build(reana-workflow-engine-snakemake/docker): install correct extras of reana-commons submodule (reanahub#79) ci(reana-workflow-engine-snakemake/release-please): update version in Dockerfile (reanahub#77) build(reana-workflow-engine-snakemake/docker): non-editable submodules in "latest" mode (reanahub#73) ci(reana-workflow-engine-snakemake/release-please): initial configuration (reanahub#74) ci(reana-workflow-engine-snakemake/commitlint): addition of commit message linter (reanahub#74)
No description provided.