Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add TFJob test to the Kfctl test; refactor workflows to start to use #1333

Merged
merged 3 commits into from Aug 10, 2018

Conversation

jlewi
Copy link
Contributor

@jlewi jlewi commented Aug 8, 2018

Start adding component tests to the new kfctl workflow.

  • This PR adds the TFJob simple to that workflow.

  • To support that we start refactoring workflows.libsonnet to make it easy to define an Argo Dag that can be nested in other workflows so we can reuse subgraphs across tests.

  • Related to Reusability and composability of steps in our E2E tests #1325 Reusability of subgraphs in our tests.


This change is Reviewable

This PR adds the TFJob simple to that workflow.

To support that we start refactoring workflows.libsonnet to make it easy to define an Argo Dag that can be nested in other workflows so we can reuse subgraphs across tests.

Related to kubeflow#1325 Reusability of subgraphs in our tests.
@jlewi jlewi changed the title [wip] Add TFJob test to the Kfctl test; refactor workflows to start to use Add TFJob test to the Kfctl test; refactor workflows to start to use Aug 8, 2018
@jlewi
Copy link
Contributor Author

jlewi commented Aug 8, 2018

/assign @lluunn

@lluunn
Copy link
Contributor

lluunn commented Aug 8, 2018

Do you want to add testing/ to prowconfig https://github.com/kubeflow/kubeflow/blob/master/prow_config.yaml#L21
so that the ktctl_test is triggered?

Also, I think the variable names in kfTests is confusing.
We have argoDagTemplate, argoTemplates, dagTemplates, argoTemplate (in the buildTemplate).
Can we make it more clear what's the different usage of each one? Maybe better variable names, or at least some comments.

@jlewi
Copy link
Contributor Author

jlewi commented Aug 9, 2018

The test is already being triggered by prow
https://github.com/kubeflow/kubeflow/blob/master/prow_config.yaml#L14

@jlewi
Copy link
Contributor Author

jlewi commented Aug 9, 2018

I take that back looks like its not actually getting triggered.
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/kubeflow_kubeflow/1333/kubeflow-presubmit/2862/

@jlewi
Copy link
Contributor Author

jlewi commented Aug 9, 2018

I think its not being triggered because we aren't including the directory in the prow_config will update.

* autformat_jsonnet should execute jsonnet format from the root of the
  git repo since its using paths relative to the root.
@lluunn
Copy link
Contributor

lluunn commented Aug 9, 2018

/lgtm
/approve

@jlewi
Copy link
Contributor Author

jlewi commented Aug 10, 2018

/approve

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jlewi, lluunn

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@lluunn
Copy link
Contributor

lluunn commented Aug 10, 2018

tide shows not mergeable, not sure why.

@jlewi
Copy link
Contributor Author

jlewi commented Aug 10, 2018

Looks like
kubernetes/test-infra#9001

@k8s-ci-robot k8s-ci-robot merged commit eababf8 into kubeflow:master Aug 10, 2018
saffaalvi pushed a commit to StatCan/kubeflow that referenced this pull request Feb 11, 2021
…ubeflow#1333)

* Start adding component tests to the new kfctl workflow.

This PR adds the TFJob simple to that workflow.

To support that we start refactoring workflows.libsonnet to make it easy to define an Argo Dag that can be nested in other workflows so we can reuse subgraphs across tests.

Related to kubeflow#1325 Reusability of subgraphs in our tests.

* * Give the variables better names and add comments.
* autformat_jsonnet should execute jsonnet format from the root of the
  git repo since its using paths relative to the root.

* Bump the master version because 1.9.7-gke.3 is no longer supported for the master.
yanniszark pushed a commit to arrikto/kubeflow that referenced this pull request Feb 15, 2021
* Init commit

* Modify Insert function
Add retry on empty observation

* Fix mutate volume test

* Fix validate experiment test

* Fix invalid experiment

* Don't get deployed job status when trial is completed

* Not send Trial with unavailable metrics to Suggestion

* Refactor requeue

If objective metric value is not reported metrics collector reports unavailable value to the DB
Controller reconciles Trial until DB is empty

* Add condition before change trial status

* Remove prints

* Fix tfevent parser
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants