Append node e2e logs to file where possible

[ehashman]

Functionality added in systemd 240:
https://github.com/systemd/systemd/blob/1977d1477f635057a87c0a5a59fc5d4e0b8ed6ec/NEWS#L3919-L3921

What type of PR is this?

/kind cleanup
/sig node

What this PR does / why we need it:

If the version of systemd supports it, appends to the kubelet log file rather than writing directly to it. This ensures that if the kubelet is restarted during the node e2e tests, we keep all the logs from that run prior to restart. This is especially important for serial tests which may have multiple restarts.

I tested this locally using the command

make test-e2e-node FOCUS="should correctly account for terminated pods after restart" SKIP="\[Flaky\]|\[Benchmark\]|\[NodeSpecialFeature:.+\]|\[NodeSpecialFeature\]|\[NodeAlphaFeature:.+\]|\[NodeAlphaFeature\]|\[NodeFeature:Eviction\]" PARALLELISM=1 'TEST_ARGS=--feature-gates=DynamicKubeletConfig=true,LocalStorageCapacityIsolation=true --kubelet-flags="--cgroup-driver=systemd --cgroups-per-qos=true --cgroup-root=/ --fail-swap-on=false"'

and saw that logs were present reflecting two kubelet starts.

Which issue(s) this PR fixes:

Fixes #106359 (comment)

Special notes for your reviewer:

/assign @aojea
/cc @endocrimes

I'm sorry that the code here would literally look better if written in Perl

Does this PR introduce a user-facing change?

NONE

Additional documentation e.g., KEPs (Kubernetes Enhancement Proposals), usage docs, etc.:

[k8s-ci-robot]

@ehashman: This issue is currently awaiting triage.

If a SIG or subproject determines this is a relevant issue, they will accept it by applying the triage/accepted label and provide further guidance.

The triage/accepted label can be added by org members by writing /triage accepted in a comment.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[endocrimes]

/lgtm

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ehashman, endocrimes

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• test/e2e_node/OWNERS [ehashman]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[ehashman]

Sniff test: kubelet logs still writing okay on https://storage.googleapis.com/kubernetes-jenkins/pr-logs/pull/106362/pull-kubernetes-node-e2e-containerd/1458877205076512768/artifacts/tmp-node-e2e-26e92de7-ubuntu-gke-2004-1-20-v20211111/kubelet.log

[aojea]

❤️