feat: load balancer class support

[wondersd]

What type of PR is this?

fix: fixes stuck controller when loadBalancerClass mutators exist and use of loadBalancerClass when mutators do not exist

What this PR does / why we need it:

updates EP CR to include ability to specify Service.spec.loadBalancerClass

Which issue(s) this PR fixes:

Fixes #1793

Think this includes everything. My go is not well practiced so may be off. Still working on setting up for e2e test

[arkodg]

hi @wondersd , thanks for raising a PR for this feature.
the PR looks good, but it looks like EG will have issues when a service has been created/deployed and user updates the EnvoyProxy spec with this new field, and EG will be unable to set this field since it cannot be mutated ?

[wondersd]

@arkodg Yes that is correct. Assuming the user modifies it via a mutator on creation or otherwise deletes/recreates the service, the only presented option here would be to allow syncing what EG expects to reality.

It could be possible to update EG to destroy the Service to force sync this field to what EG expects. I figured this was out-of-scope and should have some more thought as it would guarantee cause downtime and would cascade into resource provisioning/de-provisioning. With just being able to alter what EG expects we can at least sync EGs exceptions with the reality.

[arkodg]

sure, once this PR is merged, can you raise a follow up issue to handle the mutate case which will probably need a delete + create

[codecov]

Codecov Report

Merging #1840 (633194a) into main (3999cdd) will increase coverage by 0.02%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main    #1840      +/-   ##
==========================================
+ Coverage   65.16%   65.19%   +0.02%     
==========================================
  Files          86       86              
  Lines       12469    12472       +3     
==========================================
+ Hits         8126     8131       +5     
+ Misses       3825     3823       -2     
  Partials      518      518              

Files Changed	Coverage Δ
...frastructure/kubernetes/proxy/resource_provider.go	86.39% <100.00%> (ø)
...tructure/kubernetes/ratelimit/resource_provider.go	97.20% <100.00%> (+0.03%)	⬆️
...nal/infrastructure/kubernetes/resource/resource.go	96.29% <100.00%> (+0.06%)	⬆️

... and 1 file with indirect coverage changes

[arkodg]

LGTM thanks !
ptal @qicz