Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add pytest suite for seal5 #96

Open
PhilippvK opened this issue May 31, 2024 · 2 comments
Open

Add pytest suite for seal5 #96

PhilippvK opened this issue May 31, 2024 · 2 comments
Milestone

Comments

@PhilippvK
Copy link
Contributor

No description provided.

@PhilippvK PhilippvK added this to the v0.4.0 milestone May 31, 2024
@jokap11
Copy link

jokap11 commented Jun 11, 2024

In which direction should this go?

  • Smoke tests?
  • Functional
  • -Wall ...

@PhilippvK
Copy link
Contributor Author

@jokap11 sorry for the late response.

here I would like to focus on the Python-only tests (aka no LLVM compilation involved)

these are the test levels that are appropriate:

  1. First, minimal unit tests should be added for verifying small helper/utility functions used in the codebase.
  2. Next we can add integration tests for testing specific submodules/components (such as transforms/backends) independently (using dummy inputs and comparing the resulting metamodel or generated patches with the expected output)
  3. Finally there are more complex test-cases which involve more than one component or include running multiple steps in the seal5 flow. I am not planning to add specific tests cases for these as they should (hopefully) show up in the end-to-end examples based on real-world inputs.

I hope this answers your question. I think to get this started we should start with the ones which are very simple (aka level 1). We should probably also add coverage support to see which files/functions lack proper testing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants