Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

release: 0.7.0-alpha.2 #390

Merged
merged 5 commits into from Oct 5, 2020

Conversation

diegodelemos
Copy link
Member

No description provided.

@diegodelemos diegodelemos self-assigned this Sep 2, 2020
@diegodelemos diegodelemos added this to In work in v0.7.0 Sep 2, 2020
@@ -56,15 +56,15 @@ components:
enabled: true
reana_server:
imagePullPolicy: IfNotPresent
image: reanahub/reana-server:0.7.0-alpha.1
image: reanahub/reana-server:0.7.0-alpha.2
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When updating this PR, you can edit NOTES.txt to put mysecretpassword back where mypass1234 now is... I had shortened it to fit 80 columns, but the formatting now allows the original value mysecretpassword that we also use elsewhere... so I think we can put it back.

@diegodelemos diegodelemos marked this pull request as ready for review September 22, 2020 08:45
@diegodelemos diegodelemos moved this from In work to In review in v0.7.0 Sep 22, 2020
@diegodelemos diegodelemos force-pushed the release-0.7.0-alpha.2 branch 2 times, most recently from a07719b to 158329f Compare September 23, 2020 12:42
environment:
SHARED_VOLUME_PATH: /var/reana
reana_workflow_engine_cwl:
image: reanahub/reana-workflow-engine-cwl:0.7.0-alpha.1
reana_workflow_engine_yadage:
image: reanahub/reana-workflow-engine-yadage:0.7.0-alpha.1
image: reanahub/reana-workflow-engine-yadage:0.7.0-alpha.2
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see the tag is called 0.7.0a2 instead of 0.7.0-alpha.2, is this correct? Looks wrong to me.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Git tag is following Python versioning conventions (PEP0440), hence 0.7.0a2. The produced Docker image is following semantic versioning conventions, hence 0.7.0-alpha.2. The correspondence is handled by reana-dev...

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually, what Marco points to is the Docker tag (see here) which is wrongly following PEP440. Did you release "manually" or did you use reana-dev? if so we might have a bug around here?

if parse_pep440_version(current_tag):
docker_tag = translate_pep440_to_semver2(current_tag)

I've recently released RJC using reana-dev and it correctly got the semver version...

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed.

Hmm, it looks like it must have been manual, but I don't seem to have any entrance at all about tagging 0.7.0a2 in my shell history... Moreover alpha.1 was released well before... So I don't recall what happened. Let's see next time.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

... ah, I might know how it happened:

$ cd reana-server
$ git checkout maint-0.7
$ reana-dev docker-build -c . -t auto
reana-dev docker-build -c . -t auto
[2020-09-25T16:13:46] reana-server: git describe --tags
[2020-09-25T16:13:46] reana-server: docker build -t reanahub/reana-server:0.7.0a3 .
^C
Aborted!

I must have used -t auto probably... I'll create an issue.

@@ -5,18 +5,18 @@ finalise its configuration.

1. Initialise the database:

$ kubectl exec deployment/reana-server -c rest-api -- \
$ kubectl -n {{ .Release.Namespace }} exec deployment/{{ .Release.Name }}-server -c rest-api -- \
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have tested various combinations of specifying release namespace and release name, and pushed some fixes so that printed instructions would be copy-paste-able to work out of the box.

I have also amended scripts/create-admin-user.sh and friends accordingly.

However, some observations: when using

$ helm install helm/reana --wait --generate-name
NAME: reana-1601457612
...

The things don't work, because the pods are created like this:

$ kubectl get pods
NAME                                                 READY   STATUS    RESTARTS   AGE
reana-1601457-cache-57ccbd4644-jgfcw                 1/1     Running   0          72s
reana-1601457-db-5f5cdd4d85-xjtcz                    1/1     Running   0          72s
reana-1601457-message-broker-96f547668-77x8p         1/1     Running   0          72s
reana-1601457-server-555589bdfd-c7hg7                2/2     Running   0          72s
reana-1601457-ui-675dd98f65-m6xkr                    1/1     Running   0          72s
reana-1601457-workflow-controller-78b67dd89b-2bnhs   2/2     Running   0          72s
reana-1601457612-traefik-7cf64f9d88-rhrnz            1/1     Running   0          72s

Note that only traefik respects the generated name; the others are "cut".

(2) Using a name like "reana", "myreana" or "reanadev" works well, but using a name like "xyzzy" generates troubles too, as "-reana" is being appended to infrastructure pods:

$ kubectl get pods
NAME                                               READY   STATUS    RESTARTS   AGE
xyzzy-reana-cache-567465756b-kgmsv                 1/1     Running   0          119s
xyzzy-reana-db-5c5879d79f-n6ff9                    1/1     Running   0          119s
xyzzy-reana-message-broker-55bc649d74-8nbdw        1/1     Running   0          119s
xyzzy-reana-server-669cf6b988-x7lw7                2/2     Running   0          119s
xyzzy-reana-ui-8669c86f5f-pf5tg                    1/1     Running   0          119s
xyzzy-reana-workflow-controller-7998dff758-kh94h   2/2     Running   0          119s
xyzzy-traefik-687fb5c4c9-rd296                     1/1     Running   0          119s

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

... to be compared to "good" situations like:

$ kubectl get pods
NAME                                            READY   STATUS    RESTARTS   AGE
reananew-cache-5759888787-l4v9h                 1/1     Running   0          19m
reananew-db-79f7bfdb5d-lb9d5                    1/1     Running   0          19m
reananew-message-broker-5759645bdc-xln8h        1/1     Running   0          19m
reananew-server-565874b4b7-s58jb                2/2     Running   0          19m
reananew-traefik-747ff4b6df-2mgf7               1/1     Running   0          19m
reananew-ui-5dbc478766-bpwdx                    1/1     Running   0          19m
reananew-workflow-controller-6785d47659-rnbsq   2/2     Running   0          19m

The only thing in the helm install ... command that changed was the wanted name.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note that only traefik respects the generated name; the others are "cut".

We had to truncate the name because of this. The solution here would be changing the prefix for dependencies, to use the same as REANA, working on it.

(2) Using a name like "reana", "myreana" or "reanadev" works well, but using a name like "xyzzy" generates troubles too, as "-reana" is being appended to infrastructure pods:

This was a conscious decision in the past: if the application name is not contained in the name chosen by the user, the -reana- suffix is added. If we are ok with xyz as valid component prefix (e.g. xyz-cache-5759888787-l4v9h) I can remove the suffix logic.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some thoughts on this:

  • Let's not do too deep code changes in the alpha release times indeed... So:

    • if we need to truncate names (yeah, sha1s can be loooong), then let's document that people should use release names shorter than N characters. (I mean document somewhere visibly in docs.reana.io.)

    • Ideally, when people would do helm install myverylongnamethatcannnotbeused ..., it would be perfect if helm replied "Sorry cannot use such a long name" if there was ever a way?!

  • Requiring "reana-" prefix might be understandable, but "contains" seems a bit arbitrary, giving people choice append? prepend? I'd say if we don't need reana, then let's remove it, and allow users to use whatever they think fit. Somebody might want to name their reana instance in non-reana way, after all.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if we need to truncate names (yeah, sha1s can be loooong), then let's document that people should use release names shorter than N characters. (I mean document somewhere visibly in docs.reana.io.)

Added in reanahub/docs.reana.io#62. As a long term solution we could look at relying on labels to store the UUID and component_type (see our component naming scheme). We already use labels to store the workflow run mode so it should be easy.

Ideally, when people would do helm install myverylongnamethatcannnotbeused ..., it would be perfect if helm replied "Sorry cannot use such a long name" if there was ever a way?!

I couldn't find a way of doing this.

but "contains" seems a bit arbitrary, giving people choice append? prepend?

Fixed. Just to give some background on this; the "contains" approach is used by most of Helm based projects (see here) that's the reason we went for it.

@diegodelemos diegodelemos force-pushed the release-0.7.0-alpha.2 branch 4 times, most recently from c82b7c4 to 6722747 Compare October 5, 2020 11:41
Diego Rodriguez and others added 4 commits October 5, 2020 14:27
Amends `NOTES.txt` to issue exact commands needed to run in case user
sets a deployment name and/or deploys in another namespace.

Amends deployment scripts accordingly.

Signed-off-by: Tibor Šimko <tibor.simko@cern.ch>
@tiborsimko tiborsimko merged commit 3a74995 into reanahub:master Oct 5, 2020
v0.7.0 automation moved this from In review to Done Oct 5, 2020
mdonadoni added a commit to mdonadoni/reana that referenced this pull request Mar 5, 2024
chore(reana-ui/master): release 0.9.4

build(reana-ui/package): update yarn.lock (reanahub#399)

build(reana-ui/package): require jsroot<7.6.0 (reanahub#399)

ci(reana-ui/commitlint): allow release commit style (reanahub#400)

docs(reana-ui/authors): complete list of contributors (reanahub#396)

ci(reana-ui/shellcheck): exclude node_modules from the analyzed paths (reanahub#387)

fix(reana-ui/progress): update failed workflows duration using finish time (reanahub#387)

feat(reana-ui/footer): link privacy notice to configured URL (reanahub#393)

refactor(reana-ui/docs): move from reST to Markdown (reanahub#391)

ci(reana-ui/commitlint): check for the presence of concrete PR number (reanahub#390)

ci(reana-ui/shellcheck): fix exit code propagation (reanahub#390)

fix(reana-ui/launcher): remove dollar sign in generated Markdown (reanahub#389)

ci(reana-ui/release-please): update version in package.json and Dockerfile (reanahub#385)

ci(reana-ui/release-please): switch to `simple` release strategy (reanahub#383)

fix(reana-ui/router): show 404 page for invalid URLs (reanahub#382)

ci(reana-ui/release-please): initial configuration (reanahub#380)

ci(reana-ui/commitlint): addition of commit message linter (reanahub#380)

chore(reana-message-broker/master): release 0.9.3

ci(reana-message-broker/commitlint): allow release commit style (reanahub#67)

docs(reana-message-broker/authors): complete list of contributors (reanahub#66)

refactor(reana-message-broker/docs): move from reST to Markdown (reanahub#65)

ci(reana-message-broker/commitlint): check for the presence of concrete PR number (reanahub#64)

ci(reana-message-broker/shellcheck): fix exit code propagation (reanahub#64)

ci(reana-message-broker/release-please): update version in Dockerfile (reanahub#63)

fix(reana-message-broker/startup): handle signals for graceful shutdown (reanahub#59)

ci(reana-message-broker/release-please): initial configuration (reanahub#60)

ci(reana-message-broker/commitlint): addition of commit message linter (reanahub#60)

chore(reana-server/master): release 0.9.3

build(reana-server/python): bump all required packages as of 2024-03-04 (reanahub#674)

build(reana-server/python): bump shared REANA packages as of 2024-03-04 (reanahub#674)

build(reana-server/python): bump shared modules (reanahub#676)

ci(reana-server/commitlint): allow release commit style (reanahub#675)

docs(reana-server/authors): complete list of contributors (reanahub#673)

ci(reana-server/pytest): move to PostgreSQL 14.10 (reanahub#672)

refactor(reana-server/docs): move from reST to Markdown (reanahub#671)

style(reana-server/black): format with black v24 (reanahub#670)

ci(reana-server/commitlint): check for the presence of concrete PR number (reanahub#669)

ci(reana-server/shellcheck): fix exit code propagation (reanahub#669)

ci(reana-server/release-please): update version in Dockerfile/OpenAPI specs (reanahub#668)

build(reana-server/docker): non-editable submodules in "latest" mode (reanahub#656)

build(reana-server/deps): pin invenio-userprofiles to 1.2.4 (reanahub#665)

ci(reana-server/release-please): initial configuration (reanahub#665)

ci(reana-server/commitlint): addition of commit message linter (reanahub#665)

chore(reana-workflow-controller/master): release 0.9.3

build(reana-workflow-controller/python): bump all required packages as of 2024-03-04 (reanahub#574)

build(reana-workflow-controller/python): bump shared REANA packages as of 2024-03-04 (reanahub#574)

feat(reana-workflow-controller/manager): increase termination period of run-batch pods (reanahub#572)

ci(reana-workflow-controller/commitlint): allow release commit style (reanahub#575)

feat(reana-workflow-controller/manager): pass custom env variables to job controller (reanahub#571)

feat(reana-workflow-controller/manager): pass custom env variables to workflow engines (reanahub#571)

docs(reana-workflow-controller/authors): complete list of contributors (reanahub#570)

ci(reana-workflow-controller/pytest): move to PostgreSQL 14.10 (reanahub#568)

fix(reana-workflow-controller/manager): use valid group name when calling `groupadd` (reanahub#566)

refactor(reana-workflow-controller/docs): move from reST to Markdown (reanahub#567)

fix(reana-workflow-controller/stop): store engine logs of stopped workflow (reanahub#563)

fix(reana-workflow-controller/manager): graceful shutdown of job-controller (reanahub#559)

feat(reana-workflow-controller/manager): call shutdown endpoint before workflow stop (reanahub#559)

refactor(reana-workflow-controller/consumer): do not update status of jobs (reanahub#559)

style(reana-workflow-controller/black): format with black v24 (reanahub#564)

ci(reana-workflow-controller/commitlint): check for the presence of concrete PR number (reanahub#562)

ci(reana-workflow-controller/shellcheck): fix exit code propagation (reanahub#562)

ci(reana-workflow-controller/release-please): update version in Dockerfile/OpenAPI specs (reanahub#558)

build(reana-workflow-controller/docker): non-editable submodules in "latest" mode (reanahub#551)

ci(reana-workflow-controller/release-please): initial configuration (reanahub#555)

ci(reana-workflow-controller/commitlint): addition of commit message linter (reanahub#555)

chore(reana-job-controller/master): release 0.9.3

build(reana-job-controller/python): bump all required packages as of 2024-03-04 (reanahub#442)

build(reana-job-controller/python): bump shared REANA packages as of 2024-03-04 (reanahub#442)

ci(reana-job-controller/commitlint): allow release commit style (reanahub#443)

build(reana-job-controller/certificates): update expired CERN Grid CA certificate (reanahub#440)

fix(reana-job-controller/database): limit the number of open database connections (reanahub#437)

docs(reana-job-controller/authors): complete list of contributors (reanahub#434)

perf(reana-job-controller/cache): avoid caching jobs when the cache is disabled (reanahub#435)

ci(reana-job-controller/pytest): move to PostgreSQL 14.10 (reanahub#429)

refactor(reana-job-controller/docs): move from reST to Markdown (reanahub#428)

ci(reana-job-controller/commitlint): check for the presence of concrete PR number (reanahub#425)

ci(reana-job-controller/shellcheck): fix exit code propagation (reanahub#425)

feat(reana-job-controller/shutdown): stop all running jobs before stopping workflow (reanahub#423)

refactor(reana-job-controller/monitor): move fetching of logs to job-manager (reanahub#423)

refactor(reana-job-controller/db): set job status also in the main database (reanahub#423)

refactor(reana-job-controller/monitor): centralise logs and status updates (reanahub#423)

style(reana-job-controller/black): format with black v24 (reanahub#426)

ci(reana-job-controller/release-please): update version in Dockerfile/OpenAPI specs (reanahub#421)

build(reana-job-controller/docker): non-editable submodules in "latest" mode (reanahub#416)

ci(reana-job-controller/release-please): initial configuration (reanahub#417)

ci(reana-job-controller/commitlint): addition of commit message linter (reanahub#417)

chore(reana-workflow-engine-cwl/master): release 0.9.3

build(reana-workflow-engine-cwl/python): bump all required packages as of 2024-03-04 (reanahub#267)

build(reana-workflow-engine-cwl/python): bump shared REANA packages as of 2024-03-04 (reanahub#267)

docs(reana-workflow-engine-cwl/conformance-tests): update CWL conformance test badges (reanahub#264)

ci(reana-workflow-engine-cwl/commitlint): allow release commit style (reanahub#268)

docs(reana-workflow-engine-cwl/authors): complete list of contributors (reanahub#266)

refactor(reana-workflow-engine-cwl/docs): move from reST to Markdown (reanahub#263)

fix(reana-workflow-engine-cwl/progress): handle stopped jobs (reanahub#260)

ci(reana-workflow-engine-cwl/commitlint): check for the presence of concrete PR number (reanahub#262)

ci(reana-workflow-engine-cwl/shellcheck): fix exit code propagation (reanahub#262)

build(reana-workflow-engine-cwl/docker): install correct extras of reana-commons submodule (reanahub#261)

ci(reana-workflow-engine-cwl/release-please): update version in Dockerfile (reanahub#259)

build(reana-workflow-engine-cwl/docker): non-editable submodules in "latest" mode (reanahub#255)

ci(reana-workflow-engine-cwl/release-please): initial configuration (reanahub#256)

ci(reana-workflow-engine-cwl/commitlint): addition of commit message linter (reanahub#256)

chore(reana-workflow-engine-serial/master): release 0.9.3

build(reana-workflow-engine-serial/python): bump all required packages as of 2024-03-04 (reanahub#200)

build(reana-workflow-engine-serial/python): bump shared REANA packages as of 2024-03-04 (reanahub#200)

ci(reana-workflow-engine-serial/commitlint): allow release commit style (reanahub#201)

docs(reana-workflow-engine-serial/authors): complete list of contributors (reanahub#199)

refactor(reana-workflow-engine-serial/docs): move from reST to Markdown (reanahub#198)

fix(reana-workflow-engine-serial/progress): handle stopped jobs (reanahub#195)

ci(reana-workflow-engine-serial/commitlint): check for the presence of concrete PR number (reanahub#197)

ci(reana-workflow-engine-serial/shellcheck): fix exit code propagation (reanahub#197)

build(reana-workflow-engine-serial/docker): install correct extras of reana-commons submodule (reanahub#196)

ci(reana-workflow-engine-serial/release-please): update version in Dockerfile (reanahub#194)

build(reana-workflow-engine-serial/docker): non-editable submodules in "latest" mode (reanahub#190)

ci(reana-workflow-engine-serial/release-please): initial configuration (reanahub#191)

ci(reana-workflow-engine-serial/commitlint): addition of commit message linter (reanahub#191)

chore(reana-workflow-engine-yadage/master): release 0.9.4

build(reana-workflow-engine-yadage/python): bump all required packages as of 2024-03-04 (reanahub#261)

build(reana-workflow-engine-yadage/python): bump shared REANA packages as of 2024-03-04 (reanahub#261)

ci(reana-workflow-engine-yadage/commitlint): allow release commit style (reanahub#262)

docs(reana-workflow-engine-yadage/authors): complete list of contributors (reanahub#260)

refactor(reana-workflow-engine-yadage/docs): move from reST to Markdown (reanahub#259)

fix(reana-workflow-engine-yadage/progress): correctly handle running and stopped jobs (reanahub#258)

ci(reana-workflow-engine-yadage/commitlint): check for the presence of concrete PR number (reanahub#257)

ci(reana-workflow-engine-yadage/shellcheck): fix exit code propagation (reanahub#257)

build(reana-workflow-engine-yadage/docker): install correct extras of reana-commons submodule (reanahub#256)

ci(reana-workflow-engine-yadage/release-please): update version in Dockerfile (reanahub#254)

build(reana-workflow-engine-yadage/docker): non-editable submodules in "latest" mode (reanahub#249)

ci(reana-workflow-engine-yadage/release-please): initial configuration (reanahub#251)

ci(reana-workflow-engine-yadage/commitlint): addition of commit message linter (reanahub#251)

chore(reana-workflow-engine-snakemake/master): release 0.9.3

build(reana-workflow-engine-snakemake/python): bump all required packages as of 2024-03-04 (reanahub#85)

build(reana-workflow-engine-snakemake/python): bump shared REANA packages as of 2024-03-04 (reanahub#85)

ci(reana-workflow-engine-snakemake/commitlint): allow release commit style (reanahub#86)

feat(reana-workflow-engine-snakemake/config): get max number of parallel jobs from env vars (reanahub#84)

feat(reana-workflow-engine-snakemake/executor): upgrade to Snakemake v7.32.4 (reanahub#81)

docs(reana-workflow-engine-snakemake/authors): complete list of contributors (reanahub#83)

refactor(reana-workflow-engine-snakemake/docs): move from reST to Markdown (reanahub#82)

fix(reana-workflow-engine-snakemake/progress): handle stopped jobs (reanahub#78)

ci(reana-workflow-engine-snakemake/commitlint): check for the presence of concrete PR number (reanahub#80)

ci(reana-workflow-engine-snakemake/shellcheck): fix exit code propagation (reanahub#80)

build(reana-workflow-engine-snakemake/docker): install correct extras of reana-commons submodule (reanahub#79)

ci(reana-workflow-engine-snakemake/release-please): update version in Dockerfile (reanahub#77)

build(reana-workflow-engine-snakemake/docker): non-editable submodules in "latest" mode (reanahub#73)

ci(reana-workflow-engine-snakemake/release-please): initial configuration (reanahub#74)

ci(reana-workflow-engine-snakemake/commitlint): addition of commit message linter (reanahub#74)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
v0.7.0
  
Done
Development

Successfully merging this pull request may close these issues.

None yet

3 participants