Add unit test for Job Controller for panic when PodFailurePolicy is used on 1.28

[mimowo]

What type of PR is this?

/kind cleanup

What this PR does / why we need it:

Which issue(s) this PR fixes:

Part of #122235

Special notes for your reviewer:

This PR demonstrates the scenario which is problematic on 1.28, which does not contain the fix yet: #121147.

This PR tests on github CI the new test when the fix is reverted: #122262
Here is the failure: https://prow.k8s.io/view/gs/kubernetes-jenkins/pr-logs/pull/122262/pull-kubernetes-unit/1734157708581408768

Does this PR introduce a user-facing change?

NONE

Additional documentation e.g., KEPs (Kubernetes Enhancement Proposals), usage docs, etc.:

[k8s-ci-robot]

Please note that we're already in Test Freeze for the release-1.29 branch. This means every merged PR will be automatically fast-forwarded via the periodic ci-fast-forward job to the release branch of the upcoming v1.29.0 release.

Fast forwards are scheduled to happen every 6 hours, whereas the most recent run was: Mon Dec 11 04:18:32 UTC 2023.

[mimowo]

/assign @kannon92
/cc @alculquicondor

[kannon92]

/triage accepted
/priority important-soon

/lgtm

[k8s-ci-robot]

LGTM label has been added.

Git tree hash: 3319d034e2f5355537e416c7bb8250e62e3d77a8

[alculquicondor]

/approve

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: alculquicondor, mimowo

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• pkg/controller/job/OWNERS [alculquicondor]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[mimowo]

@soltysh can we get the 1.29 milestone for it, so that it can merge and be cherry-picked along with #122267

[soltysh]

@soltysh can we get the 1.29 milestone for it, so that it can merge and be cherry-picked along with #122267

We're only hours before the final release, so I think it can't land. Let's merge this into master as soon as it opens up.

[soltysh]

If necessary we can just backport afterwards