WIP: add docker validation test

[liangchenye]

The docker validation test including:

1. conformance test
2. performance test
3. docker unique test (restart docker on upgrade for example)
   Since the docker unique testing affects other container test, for example, list/status.
   I think we cannot test them simultaneously in docker validation test.
   So I'll test 1~3 one by one.

[conformance test]
In current e2e-node test, we already have very solid code to setup k8s environment.
I think we can just reuse them, but will be more parameters (like test on a certain GCE?)
(docker-validation-test.sh is modifies from e2e-node-test.sh)

[performance test]
I'm not sure how to integrate with @Random-Liu 's work .

[docker unique test]
I add a 'restart' testcase in this PR. It works good in my docker version..

@dchen1107 @Random-Liu

---

This change is

[Random-Liu]

@liangchenye Nice!

[dchen1107]

This won't work on systemd node, right?

[liangchenye]

Yes, I will add more checking codes to the 'start' function.

[liangchenye]

@Random-Liu I add your helpers code and one of your case.
Just as we discussed today, I'll submit small case(code) first.

@dchen1107 I update previous limitation code by supporting both 'init/systemd'.
(get reference from https://github.com/autotest/autotest-docker/blob/master/dockertest/docker_daemon.py )

I'll remove the 'WIP' and ask for a review once the jenkins integration is done.

[liangchenye]

@Random-Liu I add 4 cases: start/start-in-parallel/list/list-in-parallel.
Each measurement has 10 containers and runs related operation twice.
The output is like this:

• [MEASUREMENT]
start:
  Fastest Time: 3.920s
  Slowest Time: 3.936s
  Average Time: 3.928s ± 0.008s

start parallelly:
  Fastest Time: 0.692s
  Slowest Time: 0.886s
  Average Time: 0.789s ± 0.097s

list:
  Fastest Time: 0.154s
  Slowest Time: 0.158s
  Average Time: 0.156s ± 0.002s

list parallelly:
  Fastest Time: 0.132s
  Slowest Time: 0.134s
  Average Time: 0.133s ± 0.001s

[Random-Liu]

@k8s-bot test this issue #IGNORE.

[Random-Liu]

FAILED ./hack/../hack/verify-boilerplate.sh 1s

You need to run hack/verify-boilerplate.sh to verify boilerplate and add boilerplate accordingly.

[k8s-github-robot]

@liangchenye PR needs rebase

[k8s-bot]

GCE e2e build/test passed for commit e0a66fd.

• Test Results
• Build Log
• Test Artifacts
• Internal Jenkins Results

[dchen1107]

ping ...

@liangchenye any updates on this pr?

[dchen1107]

ping ...

[k8s-bot]

Can one of the admins verify that this patch is reasonable to test? If so, please reply "ok to test".
(Note: "add to whitelist" is no longer supported. Please update configurations in kubernetes/test-infra/jenkins/job-configs/kubernetes-jenkins-pull instead.)

This message will repeat several times in short succession due to jenkinsci/ghprb-plugin#292. Sorry.

[k8s-github-robot]

This PR hasn't been active in 90 days. Closing this PR. Please reopen if you would like to work towards merging this change, if/when the PR is ready for the next round of review.

cc @Random-Liu @liangchenye

You can add 'keep-open' label to prevent this from happening again, or add a comment to keep it open another 90 days