Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unify and simplify the test harness. #204

Merged
merged 2 commits into from Apr 30, 2018

Conversation

@dvander
Copy link
Member

dvander commented Apr 30, 2018

The test harness was too complicated. We had two versions, one for spcomp1 tests, and one for the
shell. In addition they were invoked by a weird script generated by the build, based on templates,
with separate templates for Windows and Mac/Linux. There's no need for any of this.

The new harness is much simpler. It scans an objdir for spcomp/spshell binaries (since we could
have dual-arch builds), scans for tests, and then runs a complete testing matrix. It now supports
per-folder manifests as well.

This setup will make it easier to add new configurations and even run tests in parallel.

dvander added 2 commits Apr 29, 2018
The test harness was too complicated. We had two versions, one for spcomp1 tests, and one for the
shell. In addition they were invoked by a weird script generated by the build, based on templates,
with separate templates for Windows and Mac/Linux. There's no need for any of this.

The new harness is much simpler. It scans an objdir for spcomp/spshell binaries (since we could
have dual-arch builds), scans for tests, and then runs a complete testing matrix. It now supports
per-folder manifests as well.

This setup will make it easier to add new configurations and even run tests in parallel.
@dvander dvander merged commit beb51be into master Apr 30, 2018
2 checks passed
2 checks passed
continuous-integration/appveyor/pr AppVeyor build succeeded
Details
continuous-integration/travis-ci/pr The Travis CI build passed
Details
@dvander dvander deleted the redo-testing branch Apr 30, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
1 participant
You can’t perform that action at this time.