Navigation Menu

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improving robustness/flexibility in testing #132

Open
ashesh2512 opened this issue May 30, 2018 · 1 comment
Open

Improving robustness/flexibility in testing #132

ashesh2512 opened this issue May 30, 2018 · 1 comment

Comments

@ashesh2512
Copy link
Contributor

There are a couple of changes I would like to propose to the current approach for regression testing in OpenFast:

  1. Currently regression tests in OpenFast check every entry in the binary out file. As a result we also check for very small values which may not be meaningful from an engineering standpoint. This approach requires anyone using OpenFast to have the exact hardware/software setup as the machine on which these results were generated. This hinders our attempt at truly being open-source. Consequently I propose not checking for post-processed variables which are irrelevant for a given regression test (e.g. RootFxr and RootFzr in bd_curved_beam).

  2. There is a need for a more sophisticated and flexible test environment. Currently we test for every single entry in the binary out file. There are some tests that produce thousands of lines of output data and testing for every single one of them seems to be an overkill, and also a waste of time as the number of tests continue to increase. I foresee this being resolved via an additional file where the developer may specify various variables and the corresponding time steps at which they should be checked.

@rafmudaf
Copy link
Collaborator

rafmudaf commented Jun 8, 2018

@ashesh2512 can we make this issue "Improving robustness/flexibility in testing" in general? I have some thoughts on improvements to the work flow for development and testing which lie outside regression tests.

@ashesh2512 ashesh2512 changed the title Improving robustness/flexibility of regression testing Improving robustness/flexibility in testing Jun 8, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants