Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration testing for sample restraint #54

Closed
eirrgang opened this issue Apr 29, 2018 · 3 comments
Closed

Integration testing for sample restraint #54

eirrgang opened this issue Apr 29, 2018 · 3 comments
Assignees
Labels

Comments

@eirrgang
Copy link
Collaborator

Currently, integration testing for the sample_restraint code is done manually. We should add sample_restraint testing to the gmxapi Travis-CI builds.

@eirrgang eirrgang added the bug label Jun 20, 2018
@eirrgang eirrgang self-assigned this Jun 20, 2018
@eirrgang
Copy link
Collaborator Author

We now run the sample_restraint tests as part of each gmxapi CI build, but they are not blocking failures and the tests are incomplete. Moreover, a lot of the integration testing is dependent on the relationship between gromacs-gmxapi and sample_restraint, so at the moment, appropriate testing needs to be triggered manually.

@eirrgang
Copy link
Collaborator Author

begun in #143 but not passing yet. Can't make it a condition of success until tagging gromacs-gmxapi 0.0.6 as a stable base version to build against. Reference kassonlab/gromacs-gmxapi#29

@eirrgang
Copy link
Collaborator Author

eirrgang commented Jul 19, 2018

Proposed test matrices and testing logic

Continuous integration testing should be performed in all three repositories. Different test matrices are appropriate for different combinations of proposed changes and different dependency chains.

Note that new or updated branches are their own CI "target." Pull requests have a target branch according to which branch they are proposing to merge into.

For each repository, all branch targets should test against the master branches and tagged releases (as defined at the time of the branch update). Incompatibilities should either be fixed or clearly documented, and changes suggested for dependent repositories. Development branches may be aware of more recently tagged releases in the other repositories.

For each repository, the devel branch targets should additionally be tested against the devel branches of the other repositories. This will minimize divergent development to a single PR or less.

Dependencies

gromacs-gmxapi does not depend on gmxapi or sample_restraint

gmxapi depends on gromacs-gmxapi

sample_restraint depends on gromacs-gmxapi for functionality, but depends on gmxapi for testing (that's okay) and some API specification (which should eventually move to the gromacs side of things).

eirrgang added a commit to eirrgang/gmxapi that referenced this issue Jul 19, 2018
* Clean up caching, build stages, and cross-repo compatibility testing.
* Move some complexity into supporting scripts.
* Switch to "python" language CI builds for better matrix management.
* Improve build step behavior.

partially resolves kassonlab#54
eirrgang added a commit to eirrgang/gmxapi that referenced this issue Jul 19, 2018
* Clean up caching, build stages, and cross-repo compatibility testing.
* Move some complexity into supporting scripts.
* Switch to "python" language CI builds for better matrix management.
* Improve build step behavior.

partially resolves kassonlab#54
eirrgang added a commit to eirrgang/gmxapi that referenced this issue Jul 19, 2018
* Clean up caching, build stages, and cross-repo compatibility testing.
* Move some complexity into supporting scripts.
* Switch to "python" language CI builds for better matrix management.
* Improve build step behavior.

partially resolves kassonlab#54
eirrgang added a commit to eirrgang/gmxapi that referenced this issue Jul 19, 2018
* Clean up caching, build stages, and cross-repo compatibility testing.
* Move some complexity into supporting scripts.
* Switch to "python" language CI builds for better matrix management.
* Improve build step behavior.

partially resolves kassonlab#54
eirrgang added a commit to eirrgang/gmxapi that referenced this issue Jul 19, 2018
* Clean up caching, build stages, and cross-repo compatibility testing.
* Move some complexity into supporting scripts.
* Switch to "python" language CI builds for better matrix management.
* Improve build step behavior.

partially resolves kassonlab#54
eirrgang added a commit to eirrgang/gmxapi that referenced this issue Jul 19, 2018
* Clean up caching, build stages, and cross-repo compatibility testing.
* Move some complexity into supporting scripts.
* Switch to "python" language CI builds for better matrix management.
* Improve build step behavior.

partially resolves kassonlab#54
eirrgang added a commit to eirrgang/gmxapi that referenced this issue Jul 19, 2018
* Clean up caching, build stages, and cross-repo compatibility testing.
* Move some complexity into supporting scripts.
* Switch to "python" language CI builds for better matrix management.
* Improve build step behavior.

partially resolves kassonlab#54
eirrgang added a commit to eirrgang/gmxapi that referenced this issue Jul 19, 2018
* Clean up caching, build stages, and cross-repo compatibility testing.
* Move some complexity into supporting scripts.
* Switch to "python" language CI builds for better matrix management.
* Improve build step behavior.

partially resolves kassonlab#54
eirrgang added a commit to eirrgang/gmxapi that referenced this issue Jul 19, 2018
* Clean up caching, build stages, and cross-repo compatibility testing.
* Move some complexity into supporting scripts.
* Switch to "python" language CI builds for better matrix management.
* Improve build step behavior.

partially resolves kassonlab#54
eirrgang added a commit to eirrgang/gmxapi that referenced this issue Jul 19, 2018
* Clean up caching, build stages, and cross-repo compatibility testing.
* Move some complexity into supporting scripts.
* Switch to "python" language CI builds for better matrix management.
* Improve build step behavior.

partially resolves kassonlab#54
eirrgang added a commit to eirrgang/gmxapi that referenced this issue Jul 19, 2018
* Clean up caching, build stages, and cross-repo compatibility testing.
* Move some complexity into supporting scripts.
* Switch to "python" language CI builds for better matrix management.
* Improve build step behavior.

partially resolves kassonlab#54
eirrgang added a commit to eirrgang/gmxapi that referenced this issue Jul 19, 2018
* Clean up caching, build stages, and cross-repo compatibility testing.
* Move some complexity into supporting scripts.
* Switch to "python" language CI builds for better matrix management.
* Improve build step behavior.

partially resolves kassonlab#54
eirrgang added a commit to eirrgang/gmxapi that referenced this issue Jul 20, 2018
* Clean up caching, build stages, and cross-repo compatibility testing.
* Move some complexity into supporting scripts.
* Switch to "python" language CI builds for better matrix management.
* Improve build step behavior.

partially resolves kassonlab#54
eirrgang added a commit to eirrgang/gmxapi that referenced this issue Jul 22, 2018
    * Clean up caching, build stages, and cross-repo compatibility testing.
    * Move some complexity into supporting scripts.
    * Switch to "python" language CI builds for better matrix management.
    * Improve build step behavior.

    partially resolves kassonlab#54
eirrgang added a commit to eirrgang/sample_restraint that referenced this issue Jul 22, 2018
Note that Travis-CI will not build for us until .travis.yml is in
the master branch. Testing of the CI testing is happening in
eirrgang/sample_restraint

Resolves kassonlab/gmxapi#54
eirrgang added a commit to eirrgang/sample_restraint that referenced this issue Jul 22, 2018
Note that Travis-CI will not build for us until .travis.yml is in
the master branch. Testing of the CI testing is happening in
eirrgang/sample_restraint

Resolves kassonlab/gmxapi#54
eirrgang added a commit to kassonlab/sample_restraint that referenced this issue Jul 22, 2018
Infrastructure updates to prepare for 0.0.6 release. Also, fixes kassonlab/gmxapi#54 once merged to master
eirrgang added a commit that referenced this issue Jul 24, 2018
    * Clean up caching, build stages, and cross-repo compatibility testing.
    * Move some complexity into supporting scripts.
    * Switch to "python" language CI builds for better matrix management.
    * Improve build step behavior.

    partially resolves #54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant