Test module upgrades

[cmwylie19]

Describe what should be investigated or refactored

As part of our testing story of the e2e tests on modules, we need to add an upgrade test and upgrade the Kubernetes manifests.

relates to #368

We need to consider the people who are in prod and want to upgrade without down time.

Links to any relevant code

      WARNING  Unable to complete helm chart install/upgrade, waiting 10 seconds and trying again: cannot
 patch "pepr-uds-core" with kind Deployment: Deployment.apps "pepr-uds-core" is invalid:
 spec.selector: Invalid value:
 v1.LabelSelector{MatchLabels:map[string]string{"app":"pepr-uds-core",
 "pepr.dev/controller":"admission"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}:
 field is immutable && cannot patch "pepr-uds-core-watcher" with kind Deployment:
 Deployment.apps "pepr-uds-core-watcher" is invalid: spec.selector: Invalid value:
 v1.LabelSelector{MatchLabels:map[string]string{"app":"pepr-uds-core-watcher",
 "pepr.dev/controller":"watcher"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}:
 field is immutable

Additional context

Add any other context or screenshots about the technical debt here.