Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a part of ghc testsuite as a unit test #132

Merged
merged 43 commits into from May 22, 2019

Conversation

@TerrorJack
Copy link
Member

commented May 22, 2019

This PR implements asterius:ghc-testsuite, which is a tasty-driver to run the single-module compile_and_run ghc testsuite. For each single test, we use the inline-js runner to run main, then compare the stdout/stderr against existing files.

TerrorJack and others added 13 commits May 16, 2019
The output from running Tasty using HSpec is super noisy, and the prints to stdout are completely garbled when using the parallel runner. So, we store all the intermediate outputs in an in-memory buffer, which we write to a CSV file at the end of the test run.

We also provide helper python scripts to format the CSV file into ASCII tables.

Both the CSV file and the ASCII table are stored as build artifacts on circle for debugging

We implement  a custom tasty ingredient to perform the logic for this logging and saving to disk.

We also provide a timeout to tasty on the CircleCI run, because some of the tests mysteriously time out. There is no explanation so far as to why they time out. More deubugging is required.
@TerrorJack TerrorJack merged commit 643b736 into master May 22, 2019
1 check passed
1 check passed
build Workflow: build
Details
@TerrorJack TerrorJack deleted the wip-ghc-testsuite branch May 26, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants
You can’t perform that action at this time.