Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Helm release v13.1.0 #2528

Closed
46 tasks done
elnyry-sam-k opened this issue Oct 1, 2021 · 14 comments
Closed
46 tasks done

Helm release v13.1.0 #2528

elnyry-sam-k opened this issue Oct 1, 2021 · 14 comments
Assignees
Labels
oss-core This is an issue - story or epic related to a feature on a Mojaloop core service or related to it story
Milestone

Comments

@elnyry-sam-k
Copy link
Member

elnyry-sam-k commented Oct 1, 2021

Goal:

As a ML OSS Code base maintainer

I want to validate and make the release v13.1.0 that is successfully validated by the Golden path tests

so that Community members can take and use a version of Mojaloop Switch services bundle that is tested and contains the latest features enhancements and bug fixes added in PI-15/PI-16.

Acceptance Criteria:

  • Helm RC v13.1.0 is validated on Moja2 to achieve 100% result with TTK GoldenPath collection
  • Helm RC v13.1.0 is validated with PISP provisioning and test collections (TTK) with 100%
  • QA (Golden path) on deployments done on AWS Moja2 environment is done
  • Bugs are logged based on observations, failures
  • Bugs logged are fixed if critical to make subsequent releases in individual services (or Helm)
  • All the changes needed for supporting v13.1.0 of Helm are done
  • Helm v13.1.0 is released and release notes published
  • Test cases v13.1.0 is published (TTK)
  • TTK tests run successfully as Post-Hook jobs and Tests

Complexity: Medium - Involves all core and supporting services

Uncertainty: Low (no new features, enhancements, only two fixes)


Tasks:

  • Initial PR with changes for v13.1.0
    • Initial PR review
    • Deploy, validate, fix issues, redeploy
    • With stable deployment test Golden path
  • Validate PISP test provisioning and test collections (TTK)
  • Identify issues with QA Scripts if any - fix them and retest
    • Update tests for v1.1 patch notification scenarios
  • Identify Bugs, log them
  • Fix bugs logged if critical
  • Deploy, validate on AWS Moja2
  • Validate with TTK GP collection
  • TTK test-cases repo v13.1.0 is published
  • Validate upgrade scenario (to v13.1.0) from v13.0.2
  • Release notes for helm v13.1.0 drafted
  • Update release notes with Upgrade Strategy Guide link
  • Helm v13.1.0 released
  • Review deployment guide documentation to ensure its up-to-date
  • Deployment of released Helm v13.1.0 on Moja2
    • Helm v13.1.0 is deployed on Moja2 successfully
    • Validation using Golden path regression tests etc on Moja2
      • TTK GP collection
      • TTK Bulk collection
      • TTK TP collection
      • TTK Cron-job
    • Validation using CGS Golden path regression tests etc on Moja2
  • Deployment of released Helm v13.1.0 on Moja1
    • Helm v13.1.0 is deployed on Moja1 successfully
    • Validation using Golden path regression tests etc on Moja1
      • TTK GP collection
      • TTK Bulk collection
      • TTK TP collection
    • Validation using CGS Golden path regression tests etc on Moja1

Done

  • Acceptance Criteria pass
  • Designs are up-to date
  • TTK Tests pass
  • Code Style & Coverage meets standards

Pull Requests:

See release notes for the full list: https://github.com/mojaloop/helm/blob/v13.1.0/.changelog/release-v13.1.0.md

Issues:

See release notes for the full list: https://github.com/mojaloop/helm/blob/v13.1.0/.changelog/release-v13.1.0.md

Follow-up:

  • N/A

Dependencies:

  • N/A

Accountability:

@elnyry-sam-k elnyry-sam-k added story oss-core This is an issue - story or epic related to a feature on a Mojaloop core service or related to it labels Oct 1, 2021
@elnyry-sam-k elnyry-sam-k added this to the Sprint 15.5 milestone Oct 1, 2021
@mdebarros mdebarros self-assigned this Oct 1, 2021
@tdaly61
Copy link

tdaly61 commented Oct 5, 2021

so @elnyry-sam-k @mdebarros : Do I understand this correctly, what you want me to do pretty much comes down to testing ML 13.0.3 in mini-loop and make sure all the GP tests work with the TTK ?

@elnyry-sam-k
Copy link
Member Author

Blocked on #2537, #2530 , #2535, #2534

@lewisdaly
Copy link
Contributor

@mdebarros @elnyry-sam-k how do I go about helping with the Third Party stuff? #2533 is now in review, with a PR to update the deployment guide

@elnyry-sam-k
Copy link
Member Author

Thanks @lewisdaly ; once we get started on this story, will need your support to ensure 3ppi services are deployed correctly and we can correctly use the 3p provisioning and test collections to get 100% pass-rate :-)..

We want to include #2530 , #2556 in 13.1.0, so you can say this is blocked on those. those are prioritized as next items.. if you have bandwidth, can you help us with #2556 ? :-)

@lewisdaly
Copy link
Contributor

I may be able to - where is most of the work? In the ml-api-adapter and central-ledger I guess?

@elnyry-sam-k
Copy link
Member Author

elnyry-sam-k commented Nov 4, 2021

Yes thats correct @lewisdaly ; we can have a quick chat (in one of the meetings) about that when you're ready..

@lewisdaly
Copy link
Contributor

Sure. I'll try and be on the sprint status check in today and we can discuss at the end of that maybe.

@elnyry-sam-k elnyry-sam-k added this to the Sprint 16.2 milestone Nov 11, 2021
@elnyry-sam-k elnyry-sam-k modified the milestones: Sprint 16.2, Sprint 16.3 Nov 29, 2021
mdebarros added a commit to mojaloop/helm that referenced this issue Jan 5, 2022
Story: mojaloop/project#2528
View change-log: https://github.com/mojaloop/helm/blob/release/v13.1.0/.changelog/release-v13.1.0.md

**NOTE: This PR merge is for a candidate release.**

1. If you want to see the changes/features are to be included, consult the  [v13.1.0 Release Report](https://github.com/mojaloop/project/issues#workspaces/mojaloop-ref-arch-59edee71d1407922110cf083/reports/release?release=Z2lkOi8vcmFwdG9yL1JlbGVhc2UvNjYzODQ).
2. Final release is blocked by the following missing feature: mojaloop/project#2556
@elnyry-sam-k elnyry-sam-k modified the milestones: Sprint 16.3, Sprint 16.5 Jan 6, 2022
mdebarros added a commit to mojaloop/helm that referenced this issue Jan 6, 2022
Fixes for candidates release for mojaloop/project#2528
- changed bulk tests to disabled by default 
- fixed bad TTK-Test-Case path
- updated release notes to clarify renaming of helm test jobs in breaking change section
@elnyry-sam-k elnyry-sam-k modified the milestones: Sprint 16.5, Sprint 17.1 Feb 1, 2022
@elnyry-sam-k
Copy link
Member Author

Blocked on #2660

@mdebarros
Copy link
Member

Moja2 test results:

Golden-path: https://mojaloop-oss-qa-results.s3.us-west-2.amazonaws.com/ttk-tests/reports/TTK-Assertion-Report-multi-2022-03-14T15%3A41%3A16.818Z.html
Bulk: https://mojaloop-oss-qa-results.s3.us-west-2.amazonaws.com/ttk-tests/reports/TTK-Assertion-Report-multi-2022-03-14T15%3A41%3A53.292Z.html
Thirdparty: https://mojaloop-oss-qa-results.s3.us-west-2.amazonaws.com/ttk-tests/reports/TTK-Assertion-Report-multi-2022-03-14T15%3A42%3A32.808Z.html

Default tests passed:

  • default install (gp, bulk, tp) of v13.1.0-13299.d9e9fe1
  • default upgrade from v13.0.1 to v13.1.0-13299.d9e9fe1 (gp, bulk, tp)

@mdebarros
Copy link
Member

mdebarros commented Mar 15, 2022

Moja1 Test Results

Environment: moja1.test.mojaloop.live

Notes: Environment was upgraded from v13.01 to v13.0.2 and v13.1.0, each version was tested prior to upgrade.

Testing Toolkit Report
Test Result: PASSED
Test Suite: GP Tests
Environment: moja1.test.mojaloop.live
Total assertions: 2535
Passed assertions: 2535
Failed assertions: 0
Total requests: 577
Total test cases: 128
Passed percentage: 100.00%
Started time: Mon, 14 Mar 2022 16:58:41 GMT
Completed time: Mon, 14 Mar 2022 17:01:46 GMT
Runtime duration: 184989 ms

View Report

Testing Toolkit Report
Test Result: PASSED
Test Suite: Bulk Tests
Environment: moja1.test.mojaloop.live
Total assertions: 183
Passed assertions: 183
Failed assertions: 0
Total requests: 17
Total test cases: 4
Passed percentage: 100.00%
Started time: Mon, 14 Mar 2022 17:01:59 GMT
Completed time: Mon, 14 Mar 2022 17:02:23 GMT
Runtime duration: 24035 ms

View Report

esting Toolkit Report
Test Result: PASSED
Test Suite: Thirdparty Tests
Environment: moja1.test.mojaloop.live
Total assertions: 21
Passed assertions: 21
Failed assertions: 0
Total requests: 20
Total test cases: 8
Passed percentage: 100.00%
Started time: Mon, 14 Mar 2022 17:03:08 GMT
Completed time: Mon, 14 Mar 2022 17:03:13 GMT
Runtime duration: 4627 ms

View Report - link missing due to misconfiguration on moja1 values config. Slack Announcement

Testing Toolkit Report
Test Result: PASSED
Test Suite: GP CronJob
Environment: moja1.test.mojaloop.live
Total assertions: 2535
Passed assertions: 2535
Failed assertions: 0
Total requests: 577
Total test cases: 128
Passed percentage: 100.00%
Started time: Tue, 15 Mar 2022 08:00:12 GMT
Completed time: Tue, 15 Mar 2022 08:03:17 GMT
Runtime duration: 185249 ms

View Report

@mdebarros
Copy link
Member

mdebarros commented Mar 15, 2022

Moja 2 Test Results

Environment: moja2.test.mojaloop.live

Notes: Straight deployment to v13.1.0

Testing Toolkit Report
Test Result: PASSED
Test Suite: GP Tests
Environment: moja2.test.mojaloop.live
Total assertions: 2535
Passed assertions: 2535
Failed assertions: 0
Total requests: 577
Total test cases: 128
Passed percentage: 100.00%
Started time: Mon, 14 Mar 2022 16:06:49 GMT
Completed time: Mon, 14 Mar 2022 16:10:02 GMT
Runtime duration: 192703 ms

View Report

Testing Toolkit Report
Test Result: PASSED
Test Suite: Bulk Tests
Environment: moja2.test.mojaloop.live
Total assertions: 183
Passed assertions: 183
Failed assertions: 0
Total requests: 17
Total test cases: 4
Passed percentage: 100.00%
Started time: Mon, 14 Mar 2022 16:10:17 GMT
Completed time: Mon, 14 Mar 2022 16:10:41 GMT
Runtime duration: 23972 ms

View Report

Testing Toolkit Report
Test Result: PASSED
Test Suite: Thirdparty Tests
Environment: moja2.test.mojaloop.live
Total assertions: 21
Passed assertions: 21
Failed assertions: 0
Total requests: 20
Total test cases: 8
Passed percentage: 100.00%
Started time: Mon, 14 Mar 2022 16:11:41 GMT
Completed time: Mon, 14 Mar 2022 16:11:46 GMT
Runtime duration: 4593 ms

View Report

@mdebarros
Copy link
Member

Other manual tests carried out:

  1. Default install of v13.1.0, with 100% pass for GP, Bulk and TP verification tests
  2. Default install of v13.0.2 upgraded to v13.1.0, with 100% pass for GP, Bulk and TP verification tests

@mdebarros
Copy link
Member

@elnyry-sam-k I think we can close this.

@elnyry-sam-k
Copy link
Member Author

This is awesome! Thanks @mdebarros

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
oss-core This is an issue - story or epic related to a feature on a Mojaloop core service or related to it story
Projects
None yet
Development

No branches or pull requests

5 participants