Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Require pyyaml for elastic/security #345

Merged

Conversation

dliappis
Copy link
Contributor

This commit fixes rally-tracks-compat in CI tests.

Background:

The elastic/security track (in events_emitter.py) imports yaml, but it doesn't explicitly depend on it in track.json (and neither does Rally require it).

So far things worked because pyyaml was required in the older version
(0.0.3) of Geneve but recently1 a new version (0.1.1) got
released that removed the pyyaml dependency2 (under the good
geneve uses ruamel.yaml).

Since then, we have rally-tracks-compat failures3:

Running command: [esrally race --track="elastic/security" --challenge="index-alert-source-events" --track-repository="/var/lib/jenkins/workspace/elastic+rally+pull-request+rally-tracks-compat/.rally/benchmarks/tracks/rally-tracks-compat" --track-revision="master" --configuration-name="pytest" --enable-assertions --kill-running-processes --on-error="abort" --pipeline="benchmark-only" --target-hosts="127.0.0.1:19200" --test-mode --track-params="number_of_replicas:0"]
12:14:02 FAILED                                                                   [ 97%]

12:15:01 [ERROR] Cannot race. Error in load generator [0]
12:15:01 	No module named 'yaml'

Footnotes

  1. https://github.com/elastic/geneve/tags

  2. https://github.com/elastic/geneve/commit/1f8304ff44b9707c315def34c2ca4b72f00ba9fe

  3. https://elasticsearch-ci.elastic.co/job/elastic+rally+pull-request+rally-tracks-compat/160/console

This commit fixes `rally-tracks-compat` in CI tests.

Background:

The elastic/security track (in `events_emitter.py`) imports `yaml`, but
it doesn't explicitly depend on it in `track.json` (and neither does
Rally require it).

 So far things worked because `pyyaml` was required in the older version
 (`0.0.3`) of Geneve but recently[^1] a new version (`0.1.1`) got
 released that removed the `pyyaml` dependency[^2] (under the good
 `geneve` uses `ruamel.yaml`).

 Since then, we have `rally-tracks-compat` failures[^3]:

 ```
 Running command: [esrally race --track="elastic/security" --challenge="index-alert-source-events" --track-repository="/var/lib/jenkins/workspace/elastic+rally+pull-request+rally-tracks-compat/.rally/benchmarks/tracks/rally-tracks-compat" --track-revision="master" --configuration-name="pytest" --enable-assertions --kill-running-processes --on-error="abort" --pipeline="benchmark-only" --target-hosts="127.0.0.1:19200" --test-mode --track-params="number_of_replicas:0"]
 12:14:02 FAILED                                                                   [ 97%]

 12:15:01 [ERROR] Cannot race. Error in load generator [0]
 12:15:01 	No module named 'yaml'
 ```

 [^1]: https://github.com/elastic/geneve/tags
 [^2]: elastic/geneve@1f8304f
 [^3]: https://elasticsearch-ci.elastic.co/job/elastic+rally+pull-request+rally-tracks-compat/160/console
@dliappis dliappis merged commit 09cba27 into elastic:master Nov 17, 2022
dliappis added a commit that referenced this pull request Nov 17, 2022
This commit fixes `rally-tracks-compat` in CI tests.

Background:

The elastic/security track (in `events_emitter.py`) imports `yaml`, but
it doesn't explicitly depend on it in `track.json` (and neither does
Rally require it).

 So far things worked because `pyyaml` was required in the older version
 (`0.0.3`) of Geneve but recently[^1] a new version (`0.1.1`) got
 released that removed the `pyyaml` dependency[^2] (under the hood
 `geneve` uses `ruamel.yaml`).

 Since then, we have `rally-tracks-compat` failures[^3]:

 ```
 Running command: [esrally race --track="elastic/security" --challenge="index-alert-source-events" --track-repository="/var/lib/jenkins/workspace/elastic+rally+pull-request+rally-tracks-compat/.rally/benchmarks/tracks/rally-tracks-compat" --track-revision="master" --configuration-name="pytest" --enable-assertions --kill-running-processes --on-error="abort" --pipeline="benchmark-only" --target-hosts="127.0.0.1:19200" --test-mode --track-params="number_of_replicas:0"]
 12:14:02 FAILED                                                                   [ 97%]

 12:15:01 [ERROR] Cannot race. Error in load generator [0]
 12:15:01 	No module named 'yaml'
 ```

 [^1]: https://github.com/elastic/geneve/tags
 [^2]: elastic/geneve@1f8304f
 [^3]: https://elasticsearch-ci.elastic.co/job/elastic+rally+pull-request+rally-tracks-compat/160/console
dliappis added a commit that referenced this pull request Nov 17, 2022
This commit fixes `rally-tracks-compat` in CI tests.

Background:

The elastic/security track (in `events_emitter.py`) imports `yaml`, but
it doesn't explicitly depend on it in `track.json` (and neither does
Rally require it).

 So far things worked because `pyyaml` was required in the older version
 (`0.0.3`) of Geneve but recently[^1] a new version (`0.1.1`) got
 released that removed the `pyyaml` dependency[^2] (under the hood
 `geneve` uses `ruamel.yaml`).

 Since then, we have `rally-tracks-compat` failures[^3]:

 ```
 Running command: [esrally race --track="elastic/security" --challenge="index-alert-source-events" --track-repository="/var/lib/jenkins/workspace/elastic+rally+pull-request+rally-tracks-compat/.rally/benchmarks/tracks/rally-tracks-compat" --track-revision="master" --configuration-name="pytest" --enable-assertions --kill-running-processes --on-error="abort" --pipeline="benchmark-only" --target-hosts="127.0.0.1:19200" --test-mode --track-params="number_of_replicas:0"]
 12:14:02 FAILED                                                                   [ 97%]

 12:15:01 [ERROR] Cannot race. Error in load generator [0]
 12:15:01 	No module named 'yaml'
 ```

 [^1]: https://github.com/elastic/geneve/tags
 [^2]: elastic/geneve@1f8304f
 [^3]: https://elasticsearch-ci.elastic.co/job/elastic+rally+pull-request+rally-tracks-compat/160/console
@dliappis
Copy link
Contributor Author

Backported:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants