feat: translate gateway ports to proxied tasks

[hamidzr]

Ticket

https://hpe-aiatscale.atlassian.net/issues/RM-271

Description

Test Plan

Checklist

• Changes have been manually QA'd
• User-facing API changes need the "User-facing API Change" label.
• Release notes should be added as a separate file under docs/release-notes/.
  See Release Note for details.
• Licenses should be included for new code which was copied and/or modified from any external code.

[codecov]

Codecov Report

Attention: Patch coverage is 57.84314% with 86 lines in your changes are missing coverage. Please review.

Project coverage is 40.74%. Comparing base (bc80a2a) to head (afe848c).

Additional details and impacted files

@@                        Coverage Diff                        @@
##           notebook_proxy_feature_branch    #9398      +/-   ##
=================================================================
- Coverage                          46.49%   40.74%   -5.76%     
=================================================================
  Files                                743      665      -78     
  Lines                             106596    77679   -28917     
  Branches                            2405        0    -2405     
=================================================================
- Hits                               49567    31652   -17915     
+ Misses                             56834    46027   -10807     
+ Partials                             195        0     -195     

Flag	Coverage Δ
harness	37.94% <ø> (-26.14%)	⬇️
web	?

Flags with carried forward coverage won't be shown. Click here to find out more.

Files	Coverage Δ
master/internal/rm/kubernetesrm/gateway_spec.go	100.00% <100.00%> (ø)
master/internal/rm/kubernetesrm/request_queue.go	85.71% <100.00%> (ø)
master/internal/task/allocation.go	76.39% <100.00%> (ø)
master/internal/rm/kubernetesrm/spec.go	76.34% <98.21%> (ø)
master/internal/rm/kubernetesrm/request_workers.go	81.14% <78.57%> (ø)
master/internal/rm/kubernetesrm/pods.go	20.86% <0.00%> (ø)
master/internal/rm/kubernetesrm/gateway_service.go	56.71% <50.00%> (ø)
master/internal/rm/kubernetesrm/pod.go	74.20% <30.18%> (ø)

... and 1150 files with indirect coverage changes

[NicholasBlaskey]

do we need a specific kubernetes version?

[hamidzr]

this is a version i've been running locally and I think the lowest we want to support as well. I think it'd be a good idea to have CI run the oldest version as well wdy think

[NicholasBlaskey]

totally agree.

We need some way for updating it as new versions come out since previously it would just fall out of date then the tests would fail so we unpinned the version.

[NicholasBlaskey]

nice job. I think this is a good start for reattach.

[hamidzr]

I've seen some priority setting integ tests fail here inconsistently. I also see it in the target branch (ignoring it for this PR)

diff --git a/master/Makefile b/master/Makefile
index 8514e7067c..7dc869195b 100644
--- a/master/Makefile
+++ b/master/Makefile
@@ -195,7 +195,7 @@ test-intg: export DET_INTEGRATION_POSTGRES_URL ?= postgres://postgres:postgres@l
 test-intg: export DET_INTEGRATION_ES_HOST ?= localhost
 test-intg: export DET_INTEGRATION_ES_PORT ?= 9200
 test-intg: build/mock_gen.stamp
-	gotestsum --junitfile test-intg.junit.xml -- -tags=integration -race -coverprofile=coverage.out -covermode atomic -cover ./...
+	gotestsum --junitfile test-intg.junit.xml -- -count=1 -tags=integration -race -coverprofile=coverage.out -covermode atomic -cover ./internal/rm/kubernetesrm -run SetGroupPrio
 
 .PHONY: pre-package
 pre-package: