Release Test Plan 1.4.3

Issues targeted for this release - List of Github issues

QAs: Chris, Yang, Roger, Khushboo

Testing Version: v1.4.3-rc1, 1.4.3-rc2

e2e Pipelines

✅ - Analyze test result of SLES on 1.4.x (AMD) - Chris

v1.4.3-rc1: 4 failures

v1.4.3-rc2: 2 failures

✅ - Analyze test result of SLES on 1.4.x (ARM) - Chris

v1.4.3-rc1: 2 failures

v1.4.3-rc2: 3 failures

✅ - Analyze upgrade test result of SLES on 1.4.x (AMD) - Yang

v1.4.3-rc1: 4 failures

v1.4.3-rc2: 2 failures

✅ - Analyze upgrade test result of SLES on 1.4.x (ARM) - Yang

v1.4.3-rc1: 4 failures

v1.4.3-rc2: 3 failures

✅ - Analyze two stage test result of SLES on 1.4.x (AMD) 1.2.6 → 1.3.3 → 1.4.3-rc - Roger

v1.4.3-rc1: 6 failures

v1.4.3-rc2: 2 failures

✅ - Analyze two stage test result of SLES on 1.4.x (ARM) 1.2.6 → 1.3.3 → 1.4.3-rc - Roger

v1.4.3-rc1: 6 failures

v1.4.3-rc2: 2 failures

Non-e2e Pipelines

✅ - Benchmark (compare with 1.4.1) - Yang

v1.4.3-rc1 ✅

v1.4.3-rc2 ✅

✅ - Air-Gap (manifest, helm chart) - Chris

v1.4.3-rc1 manifest, chart ✅

v1.4.3-rc2 manifest, chart ✅

✅ - Vulnerability scanning - Roger

v1.4.3-rc1: 71 HIGH, 0 CRITICAL

v1.4.3-rc2: 67 HIGH, 0 CRITICAL

✅ - Negative Testing - Roger

v1.4.3-rc1

Manual Testing

HA:

✅ - Replica Rebuilding - Roger, Nitendra

v1.4.3-rc1 ✅

v1.4.3-rc2 ✅

✅ - Recurring job interruption - Khushboo

Interrupting a recurring backup job with whole cluster down

✅ - HA Volume Migration - Yang

v1.4.3-rc1 ✅

Node not ready:

✅ - Entire cluster down - Khushboo

v1.4.3-rc1

✅ - Node drain and deletion test - Chris

v1.4.3-rc1

✅ - Single replica node down - Chris

v1.4.3-rc1

Uninstall:

✅ - Uninstallation Checks - Yang, Nitendra

v1.4.3-rc1 ✅

v1.4.3-rc2 ✅

Upgrade:

✅ - Kubernetes upgrade test - Chris

from v1.26.6+k3s1 to v1.27.3+k3s1, from v1.25.10+rke2r1 to v1.26.5+rke2r1 ✅

v1.4.3-rc1 ✅

v1.4.3-rc2 (Check volume restore after upgrade) ✅

✅ - Longhorn upgrade test - Yang

from v1.3.3 to v1.4.3-rc1, from v1.4.2 to v1.4.3-rc1 ✅

from v1.3.3 to v1.4.3-rc2, from v1.4.2 to v1.4.3-rc2 ✅

v1.4.3-rc2 (Check volume restore after upgrade)

Chart Testing

✅ - v2.7.x Rancher - Khushboo, Roger

   Prereq: Set Concurrent Automatic Engine Upgrade Per Node Limit to 0
   Test steps:
   1. Fresh installation
   2. Uninstallation
   3. Upgrade from v1.3.3
   4. Upgrade from v1.4.2

v2.7.5 Rancher + v1.4.3

✅ - Longhorn Chart - Roger

   Prereq: Set Concurrent Automatic Engine Upgrade Per Node Limit to greater than 0
   Test steps:
   1. Fresh installation
   2. Uninstallation
   3. Upgrade from v1.3.3
   4. Upgrade from v1.4.2

✅ - RC1

✅ - RC2