Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[RELEASE] Release 3.14 #7126

Closed
29 of 33 tasks
lpalashevski opened this issue Nov 22, 2022 · 9 comments
Closed
29 of 33 tasks

[RELEASE] Release 3.14 #7126

lpalashevski opened this issue Nov 22, 2022 · 9 comments
Assignees
@planetf1 @lpalashevski
Labels
release Work to create a new releae

Comments

@lpalashevski
Copy link
Contributor

lpalashevski commented Nov 22, 2022 •
edited
Loading

Work Plan

Create release x.y :

Prior to the release work

  • slack post advising of upcoming release & linking to issue
  • advance warning in developer/community call
  • final agreement to start branch in team call & identification of outstanding issues
  • Agree required updates/versions for additional repos including egeria-ui, egeria-reactui, connectors etc

Branching & Correcting versions

  • Create branch
  • Reassign any issues not being worked on to the next release
  • Update version for main (ie x.y-SNAPSHOT > x.y+1-SNAPSHOT)
  • Update version for branch (ie x.y-SNAPSHOT -> x.y)

Final updates to the release

  • Ensure any remaining fixes are merged into branch (and vice-versa to main)

Pre-release security check

  • Execute manual sonatype lift scan on release branch from and communicate findings (needs more formal process in future)

Generate a release image for testing

  • Start Release pipeline manually to generate container image

Updating the Helm Charts (egeria-charts repo)

  • checker correct container images are on docker.io & quay.io (these are built by the 'merge' build of a release)
  • update image versions for helm charts egeria-charts repo (using -prerelease for chart version)
    • check/update the strimzi chart versions
    • check/update the kafka version used for the strimzi CR in each chart
    • check/update the current jupyter lab version & generate a new docker container in egeria-jupyter
    • update the jupyter lab version in the charts

Final tests

  • Check swagger doc renders (no regressions)
  • Verify odpi-egeria-lab chart (pods active/ready)
  • Verify egeria-base chart (pods active/ready)
  • Check notebooks (config, start, data catalog at a minimum)
  • Check polymer UI (only possible to check it runs and run UI lab)
  • Check React UI (rex, tex, glossary author). Some of the steps descibed here
  • CTS - graph
  • CTS - inmemory

Final Docs

  • Update release notes in egeria-docs

Final build and publish

  • Check if the Release pipeline rlease artifacts are shown in staging repo in OSS Repository Manager
  • 'close' staging repo & Validate artifacts ok (number, structure, validations) on oss.sonatype.org
  • Create final github releases for egeria (add link to egeria docs)
  • Close repo on oss.sonatype.org (once updated) for egeria, release
  • Check 'release' repo on oss.sonatype.org has artifacts
  • Update final versions of egeria-charts to release ie x.y
  • Publish that release is now shipped via slack #egeria-announce
  • Post on egeria-annouce mailing list
  • Additional posts to social media
  • Communicate to other repo owners ie for connectors so that they can be rebuilt/shipped as needed (Egeria Dev Projects etc.)

Get Ready for next release

  • Open Release Issue for next release
@lpalashevski lpalashevski added the release Work to create a new releae label Nov 22, 2022
@lpalashevski lpalashevski mentioned this issue Nov 22, 2022
Closed
31 tasks
@planetf1
Copy link
Member

For 3.14 I suggest we include the new UI.
The charts have been refactored and tested to work with this under odpi/egeria-charts#211
However I require an updated egeria-ui container to be able to merge, since a build fix was required in the ui dockerfile
When done I can merge the above as an initial pre-release

@lpalashevski lpalashevski pinned this issue Dec 8, 2022
@planetf1
Copy link
Member

planetf1 commented Dec 10, 2022 •
edited
Loading

Graph CTS

CTS is failing in the same way version 4 did -> #7148
cc: @lpalashevski @mandy-chessell

In-memory CTS

Successful (full profile to be added once issues with graph resolved & retested)

@planetf1
Copy link
Member

Sonatype lift scan for 3.14 -> https://lift.sonatype.com/results/github.com/odpi/egeria/01GKYMQDAGN7FTW9HHHYCV0FVY

@lpalashevski
Copy link
Contributor Author

lpalashevski commented Dec 12, 2022 •
edited
Loading

Following labs pass the functional testing:

  • /ui-labs/ui-asset-search.ipynb
  • /asset-management/building-a-data-catalog.ipynb
  • /asset-management/open-lineage.ipynb

Environment:

  • MacOSx Monterey 12.6.1 Apple M1 Pro
  • Local Rancher Desktop v1.6.2, Kubernetes v1.25.0
  • Chart: odpi-egeria-lab version: 3.14.0-prerelease.0 with gitTagForNotebooks: "main"

@planetf1
Copy link
Member

I am testing the remaining notebooks & found a few issues. I will complete testing and fix - and suggest these get tagged for the release

@planetf1
Copy link
Member

PR for jupyter notebook fixes -> odpi/egeria-jupyter-notebooks#39

@davidradl davidradl unpinned this issue Dec 13, 2022
@planetf1
Copy link
Member

planetf1 commented Dec 20, 2022 •
edited
Loading

CTS tested clean following fixes.

Graph;

             Metadata sharing MANDATORY_PROFILE    CONFORMANT_FULL_SUPPORT [  71657 /      0 ]
             Reference copies  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [   8528 /      0 ]
         Metadata maintenance  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [  14126 /      0 ]
                Dynamic types  OPTIONAL_PROFILE             UNKNOWN_STATUS [      0 /      0 ]
                Graph queries  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [    528 /      0 ]
            Historical search  OPTIONAL_PROFILE      CONFORMANT_NO_SUPPORT [    530 /      0 ]
               Entity proxies  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [   2759 /      0 ]
      Soft-delete and restore  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [   2592 /      0 ]
               Undo an update  OPTIONAL_PROFILE      CONFORMANT_NO_SUPPORT [    406 /      0 ]
          Reidentify instance  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [   2650 /      0 ]
              Retype instance  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [  16365 /      0 ]
              Rehome instance  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [   1590 /      0 ]
                Entity search  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [  62878 /      0 ]
          Relationship search  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [   8255 /      0 ]
       Entity advanced search  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [  44800 /      0 ]
 Relationship advanced search  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [   9312 /      0 ]

PASS [246976/0]

InMem:

             Metadata sharing MANDATORY_PROFILE    CONFORMANT_FULL_SUPPORT [  71657 /      0 ]
             Reference copies  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [   8528 /      0 ]
         Metadata maintenance  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [  14063 /      0 ]
                Dynamic types  OPTIONAL_PROFILE             UNKNOWN_STATUS [      0 /      0 ]
                Graph queries  OPTIONAL_PROFILE CONFORMANT_PARTIAL_SUPPORT [    186 /      0 ]
            Historical search  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [    530 /      0 ]
               Entity proxies  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [   2759 /      0 ]
      Soft-delete and restore  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [   2592 /      0 ]
               Undo an update  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [   1218 /      0 ]
          Reidentify instance  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [   2650 /      0 ]
              Retype instance  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [  16365 /      0 ]
              Rehome instance  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [   1590 /      0 ]
                Entity search  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [  60752 /      0 ]
          Relationship search  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [   8238 /      0 ]
       Entity advanced search  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [  40576 /      0 ]
 Relationship advanced search  OPTIONAL_PROFILE    CONFORMANT_FULL_SUPPORT [   9280 /      0 ]

PASS [240984/0]

@lpalashevski lpalashevski pinned this issue Dec 21, 2022
@planetf1
Copy link
Member

Retested CTS after new version of kafka in charts - all passed as above

@lpalashevski
Copy link
Contributor Author

This release is now complete. Next release 3.15 is planned for January/February 2023. #7258

@planetf1 planetf1 unpinned this issue Jan 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@planetf1 planetf1

@lpalashevski lpalashevski

Labels
release Work to create a new releae
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@planetf1 @lpalashevski