Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Testbed module #38

Merged
merged 17 commits into from Aug 31, 2018
Merged

Testbed module #38

merged 17 commits into from Aug 31, 2018

Conversation

jaeddy
Copy link
Member

@jaeddy jaeddy commented Aug 22, 2018

See #33.

Add functions for retrieving and submitting workflow checker
jobs to testbed module (remove from orchestrator module).
Update functions and logic in the testbed module to prepare and
create new workflow checker jobs as test params (JSON), submitted
to evaluation queues. Information about how to run the actual
workflow and post the WES request will be associated directly
with the evaluation queue.

See #33
@coveralls
Copy link

coveralls commented Aug 22, 2018

Pull Request Test Coverage Report for Build 177

  • 150 of 168 (89.29%) changed or added relevant lines in 9 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage increased (+5.4%) to 84.421%

Changes Missing Coverage Covered Lines Changed/Added Lines %
synorchestrator/config.py 7 8 87.5%
synorchestrator/trs/wrapper.py 0 1 0.0%
synorchestrator/wes/wrapper.py 1 2 50.0%
synorchestrator/testbed.py 53 57 92.98%
synorchestrator/eval.py 6 11 54.55%
synorchestrator/orchestrator.py 50 56 89.29%
Totals Coverage Status
Change from base Build 162: 5.4%
Covered Lines: 401
Relevant Lines: 475

💛 - Coveralls

Use the bravado loader class to construct a spec dict from the
swagger yaml, then load the client from the spec with the proper
origin url specified. Loading 'from_url' with a local file
doesn't provide an option to specify the origin url and instead
uses the relative local path (even with the http client provided).
Use the bravado loader class to construct a spec dict from the
swagger yaml, then load the client from the spec with the proper
origin url specified. Loading 'from_url' with a local file
doesn't provide an option to specify the origin url and instead
uses the relative local path (even with the http client provided).
Include argument for named WES client when 'load_wes_client' is
called by the wrapper class. Use a global variable to set the
current option for client library.
Modify the orchestrator config for queues (renamed from 'evals')
to store basic information needed for the testbed, including
where workflow files can be retrieved and a list of WES endpoints
on which to run jobs.

See #33, #34
Fix any calls to retrieve queue configs, and use only TRS or WES ID
to initiate respective instances while checking testbed services for
connectivity.
Add function for retrieving workflow data for a queue from TRS
when not provided; need to add steps to convert this info into
a valid WES request next.
Use conftest.py to describe all test fixtures to avoid
redundancy (and discrepancies) across modules.
Stick with unique queue identifiers for keys in the queue
config, rather than workflow IDs or handles. Update variable
names and accessor steps in assorted modules.
Update functions that were either mismatched with the latest
WES spec or with the workflow-service wes_client library.
Lots of changes made during live testing, not very well
tracked. Also add test data and simplify app config (at
least for version to be stored in repo).
Modify run and monitor functions in orchestrator module to
increase consistency and reduce modification between levels.
@jaeddy jaeddy merged commit acfe81e into develop Aug 31, 2018
@jaeddy jaeddy deleted the testbed-module branch August 31, 2018 04:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants