[ftr] add support for docker services

[spalger]

Talked with @nchaulet about #61699 and I think this would be an interesting way to solve it, adding a dockerServers config to the functional test runner that would allow launching any number of servers along side the functional tests.

Provided by this feature:

• pull+run a container every time the tests are run
• route logs into the standard logging infrastructure (including junit reports)
• ensure the container stays up until tests complete
• fail tests if container dies
• bind a single port from the container to the machine
• expose the URL of the service via a service
• mechanism to delay test startup while service initializes
• cleanup of container

Not provided by this feature:

• only using containers optionally, so that we don't add docker as a dependency for the repo
• ensuring that multiple containers are not trying to bind to the same port across parallel executions of the FTR

DOCS

[spalger]

Example of what happens when port number isn't unique: https://kibana-ci.elastic.co/job/elastic+kibana+pipeline-pull-request/37391/execution/node/216/log/

(expanded error message fe54cbe)

[nchaulet]

Hi @spalger, I am curious on how this POC went and if it's something we can push further?

[kibanamachine]

💔 Build Failed

• continuous-integration/kibana-ci/pull-request
• Commit: e59d7e8
• Pipeline Steps (look for red circles / failed steps)
• Interpreting CI Failures

Failed CI Steps

• Setup Build Environment and Dependencies
• Setup Build Environment and Dependencies
• Setup Build Environment and Dependencies
• Setup Build Environment and Dependencies
• Setup Build Environment and Dependencies
• Setup Build Environment and Dependencies
• Setup Build Environment and Dependencies
• Setup Build Environment and Dependencies

History

• 💔 Build #48363 failed bb5efde
• 💔 Build #37594 failed 36cd65a
• 💔 Build #37591 failed 359e5c0
• 💔 Build #37404 failed f41eee4
• 💔 Build #37382 failed 6d6a0a8

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

[skh]

I've opened spalger#34 with a few suggestions, and a working test.

[spalger]

Moving this PR to a feature branch and starting a second PR for the ingest test implementation