Skip to content

Make run-test-suite.py handle crashes properly#3512

Merged
rerobika merged 1 commit intojerryscript-project:masterfrom
ossy-szeged:fix-run-test-suite
Jan 15, 2020
Merged

Make run-test-suite.py handle crashes properly#3512
rerobika merged 1 commit intojerryscript-project:masterfrom
ossy-szeged:fix-run-test-suite

Conversation

@ossy-szeged
Copy link
Copy Markdown
Contributor

Changes:

  • Crashing jerry / jerry-snapshot is always "FAIL",
    only the 1 return code is accepted as expected fail.
  • "FAIL (XPASS)" string is only used if the test marked
    as expected fail, but the return code is 0.
  • Simple "FAIL" string is used if the test marked as expected
    fail, but the return code is not 0 or 1. (crash)

JerryScript-DCO-1.0-Signed-off-by: Csaba Osztrogonác oszi@inf.u-szeged.hu

@ossy-szeged
Copy link
Copy Markdown
Contributor Author

Note: It is a regression, the old sh runner worked properly, but I missed to add crash handling to the new python runner. We realized this bug after #3498.

CI will be red now, can be landed after #3498 is fixed.

Copy link
Copy Markdown
Contributor

@galpeter galpeter left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

Changes:
- Crashing jerry / jerry-snapshot is always "FAIL",
only the 1 return code is accepted as expected fail.
- "FAIL (XPASS)" string is only used if the test marked
as expected fail, but the return code is 0.
- Simple "FAIL" string is used if the test marked as expected
fail, but the return code is not 0 or 1. (crash)

JerryScript-DCO-1.0-Signed-off-by: Csaba Osztrogonác oszi@inf.u-szeged.hu
@rerobika rerobika added the tools Related to the tooling scripts label Jan 15, 2020
Copy link
Copy Markdown
Member

@rerobika rerobika left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@rerobika rerobika merged commit e3decff into jerryscript-project:master Jan 15, 2020
@ossy-szeged ossy-szeged deleted the fix-run-test-suite branch March 9, 2020 10:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tools Related to the tooling scripts

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants