Add --path option for loading system benchmark scenarios from elsewhere

[chrisberkhout]

Currently, a system benchmark run started from the package root as follows:

elastic-package benchmark system --benchmark logs-benchmark

Will load the scenario defined in:

<package root>/_dev/benchmark/system/logs-benchmark.yml

This PR allows loading system benchmark scenarios from elsewhere on the filesystem by adding a --path option to the elastic-package benchmark system command.

This system benchmark run:

elastic-package benchmark system --benchmark logs-benchmark --path /tmp/scenariodirectory

Will load the scenario defined in:

/tmp/scenariodirectory/logs-benchmark.yml

The change includes loading other related files correctly, including from the deploy/ subdirectory.

Related issues

• Related [benchmarking] Support loading scenarios from remote repositories #1317

[chrisberkhout]

/test

[jsoriano]

👍

[jsoriano]

There is a CI failure in benchmark tests, could it be related to this change?

[chrisberkhout]

/test

[elasticmachine]

💚 Build Succeeded

• Buildkite Build
• Commit: 9ce9111

History

• 💔 Build #2073 failed aee2b29
• 💔 Build #2065 failed aee2b29
• 💚 Build #2057 succeeded e23935d
• 💔 Build #2051 failed e23935d

cc @chrisberkhout

[chrisberkhout]

There is a CI failure in benchmark tests, could it be related to this change?

The last change exposed an earlier issue. Now fixed.

[jsoriano]

LGTM 👍