Containerize e2e tests for training operator conformance

[nagar-ajay]

What this PR does / why we need it:

• This PR contains the changes required for training operator conformance test.
• Added Dockerfile.conformance docker file to build container which contains test required for conformance.
• Added publish-conformance-images.yaml github action to publish conformance test docker image as part of CI.
• pass resources parameter to each container as it is required if the containers running in the namespace have resourceQuotaSpec specified. For conformance namespace, we're specifying resourceQuotaSpec
  https://github.com/kubeflow/kubeflow/blob/master/conformance/1.5/setup.yaml#L24-L28
• Testing:
  • Tested updated test on local.
  • Created docker container using Dockerfile.conformance file, ran it on a Kubernetes cluster and verified the test logs.

Which issue(s) this PR fixes (optional, in Fixes #<issue number>, #<issue number>, ... format, will close the issue(s) when PR gets merged):
Fixes #

Checklist:

• Docs included if any changes are user facing

[coveralls]

Pull Request Test Coverage Report for Build 4461944776

• 0 of 0 changed or added relevant lines in 0 files are covered.
• 2 unchanged lines in 1 file lost coverage.
• Overall coverage remained the same at 39.411%

---

Files with Coverage Reduction	New Missed Lines	%
pkg/controller.v1/mpi/mpijob_controller.go	2	76.79%

Totals
Change from base Build 4434655960:	0.0%
Covered Lines:	2730
Relevant Lines:	6927

---

💛 - Coveralls

[tenzen-y]

@nagar-ajay Thank you for creating this PR!

Created docker container using Dockerfile.conformance file, ran it on a Kubernetes cluster and verified the test logs.

Can you include that manifest in the training operator repo as with https://github.com/kubeflow/kubeflow/blob/edd87a489ad092d9fafd1658b5bd704b72633ebc/conformance/1.5/kfp-conformance.yaml?

[nagar-ajay]

Can you include that manifest in the training operator repo as with https://github.com/kubeflow/kubeflow/blob/edd87a489ad092d9fafd1658b5bd704b72633ebc/conformance/1.5/kfp-conformance.yaml?

Yes, I'll add that. That PR will also include changes to Makefile.

[tenzen-y]

Yes, I'll add that. That PR will also include changes to Makefile.

Does that mean you will add manifests in another PR?
If so, I'm ok.

[nagar-ajay]

Does that mean you will add manifests in another PR? If so, I'm ok.

Yes, I'll create another PR.

[tenzen-y]

@nagar-ajay Thanks!
/lgtm
/assign @johnugeorge

[johnugeorge]

Great work @nagar-ajay

/approve

[google-oss-prow]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: johnugeorge, nagar-ajay

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [johnugeorge]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment