Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve tests and testing infrastructure #151

Closed
AntonioND opened this issue Apr 2, 2017 · 6 comments
Closed

Improve tests and testing infrastructure #151

AntonioND opened this issue Apr 2, 2017 · 6 comments
Labels
enhancement Typically new features; lesser priority than bugs tests This affects the test suite

Comments

@AntonioND
Copy link
Member

AntonioND commented Apr 2, 2017

The current way of doing regression tests is quite crude, it has to be improved. Also, there are not enough tests, there are many things of the toolchain that aren't tested and could potentially break.

@AntonioND AntonioND changed the title Improve testing infraestructure Improve tests and testing infrastructure Jan 27, 2018
@AntonioND AntonioND added enhancement Typically new features; lesser priority than bugs tests This affects the test suite labels Apr 2, 2018
@AntonioND
Copy link
Member Author

@AntonioND
Copy link
Member Author

I think that ideally the CI scripts should run all tests individually (maybe each test can be in a folder) and it could keep track of the number of passing/failed tests, for example.

@ISSOtm ISSOtm added good first issue New to the codebase? You can help no problem! hacktoberfest labels Sep 20, 2020
@AntonioND AntonioND removed the good first issue New to the codebase? You can help no problem! label Nov 19, 2022
@AntonioND
Copy link
Member Author

I think this can be closed now...

@ISSOtm
Copy link
Member

ISSOtm commented Mar 17, 2023

I don't know, the infrastructure is still kind of crude—the amount of failed tests is not reported, and their output tends to be drowned in the reports of passing tests.

@AntonioND
Copy link
Member Author

I used to think that bash wasn't the right language here, but now I think it actually makes sense because of how much the output is compared to reference data in files. At most, you could replace it by some python scripts, I guess.

@ISSOtm
Copy link
Member

ISSOtm commented Mar 17, 2023

That much I agree with, though for rsgbds I think I will instead make a test runner in Rust that walks through all of the test cases.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Typically new features; lesser priority than bugs tests This affects the test suite
Projects
None yet
Development

No branches or pull requests

3 participants