Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add e2e and move tests to tests/ directory #403

Merged
merged 7 commits into from Jun 8, 2019

Conversation

Projects
None yet
2 participants
@MatthewMerrill
Copy link
Contributor

commented Jun 6, 2019

Tests are defined by a subdirectory of tests/e2e/ containing a test.sh and expected.txt. After tests are run the output can be analyzed in e2e_out/.

Example of failed test (changed a number in the test file):

### Running Test: fpu              ###
!!! Failed: fpu
1,5d0
< 16.12
< -15.88
< 1.92
< 0.01
< 133.33
6a2,6
> -15.87
> 2.08
> 0.01
> 123.08
> 16.14
### Running Test: hello            ###
### Passed: 1/2 (50.00%)           ###

Example of all passes:

### Running Test: fpu              ###
### Running Test: hello            ###
### Passed: 2/2 (100.00%)          ###

Exit code is 1 if any test failed, so this can be integrated into travis testing.

@MatthewMerrill MatthewMerrill force-pushed the MatthewMerrill:e2e branch from 3e120fb to ba23637 Jun 7, 2019

@MatthewMerrill

This comment has been minimized.

Copy link
Contributor Author

commented Jun 7, 2019

added meson stuffs

@tbodt

This comment has been minimized.

Copy link
Owner

commented Jun 7, 2019

Just one last thing, can you put the e2e.bash script in the tests/e2e directory?

@MatthewMerrill

This comment has been minimized.

Copy link
Contributor Author

commented Jun 7, 2019

Done

Have travis use meson test
 - script sets up test file system
 - add -y flag to auto-accept setup prompt
 - change travis script to use meson test

@MatthewMerrill MatthewMerrill force-pushed the MatthewMerrill:e2e branch from bf1aedf to f7c00d1 Jun 7, 2019

@tbodt

This comment has been minimized.

Copy link
Owner

commented Jun 8, 2019

The travis build is still failing. Could you disable the tests on interpreter mode? After that I'm ready to merge.

@MatthewMerrill MatthewMerrill force-pushed the MatthewMerrill:e2e branch 3 times, most recently from 39549da to 1fb7b2f Jun 8, 2019

@MatthewMerrill MatthewMerrill force-pushed the MatthewMerrill:e2e branch from 1fb7b2f to 8e64a58 Jun 8, 2019

@MatthewMerrill

This comment has been minimized.

Copy link
Contributor Author

commented Jun 8, 2019

Passing now :fortnite_default_dance:

@tbodt tbodt merged commit 7b2016c into tbodt:master Jun 8, 2019

1 check passed

continuous-integration/travis-ci/pr The Travis CI build passed
Details

@MatthewMerrill MatthewMerrill deleted the MatthewMerrill:e2e branch Jun 8, 2019

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.