Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Track test configuration in test results #93

Open
loganek opened this issue Oct 2, 2023 · 0 comments
Open

Track test configuration in test results #93

loganek opened this issue Oct 2, 2023 · 0 comments

Comments

@loganek
Copy link
Collaborator

loganek commented Oct 2, 2023

Some of the tests are configurable and therefore support for some of the features might be "hidden" because the test will pass, even though the feature isn't supported (e.g. https://github.com/WebAssembly/wasi-testsuite/blob/main/tests/rust/src/config.rs#L16). We should have a way to indicate whether a specific feature is supported for a given runtime on a specific operating system. Two options come to my mind:

  • add the configuration to the test result itself
  • split it into two tests and let runtimes skip tests that are not expected to work

Both approaches have pros and cons so I'm open for any suggestions from the community.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant