Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tags backward compatibility in executor #1481

Merged
merged 3 commits into from Mar 4, 2020

Conversation

RafalSkolasinski
Copy link
Member

@RafalSkolasinski RafalSkolasinski commented Feb 25, 2020

Closes #1474.

To avoid missing some important details in between @seldondev messages I will post general updates to the issue itself.

@seldondev
Copy link
Collaborator

Tue Feb 25 14:19:13 UTC 2020
The logs for [pr-build] [1] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/1.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=1

@seldondev
Copy link
Collaborator

Tue Feb 25 14:19:22 UTC 2020
The logs for [lint] [2] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/2.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=2

@seldondev
Copy link
Collaborator

Wed Feb 26 16:40:34 UTC 2020
The logs for [lint] [4] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/4.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=4

@seldondev
Copy link
Collaborator

Wed Feb 26 16:40:48 UTC 2020
The logs for [pr-build] [3] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/3.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=3

@seldondev
Copy link
Collaborator

Wed Feb 26 17:41:17 UTC 2020
The logs for [lint] [8] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/8.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=8

@seldondev
Copy link
Collaborator

Wed Feb 26 17:41:17 UTC 2020
The logs for [pr-build] [7] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/7.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=7

@seldondev
Copy link
Collaborator

Wed Feb 26 17:45:14 UTC 2020
The logs for [lint] [10] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/10.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=10

@seldondev
Copy link
Collaborator

Wed Feb 26 17:45:15 UTC 2020
The logs for [pr-build] [9] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/9.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=9

@seldondev
Copy link
Collaborator

Wed Feb 26 17:52:33 UTC 2020
The logs for [lint] [12] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/12.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=12

@seldondev
Copy link
Collaborator

Wed Feb 26 17:53:47 UTC 2020
The logs for [pr-build] [11] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/11.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=11

@RafalSkolasinski
Copy link
Member Author

/test integration

@seldondev
Copy link
Collaborator

Thu Feb 27 10:36:56 UTC 2020
The logs for [integration] [13] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/13.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=13

@RafalSkolasinski
Copy link
Member Author

/retest

@seldondev
Copy link
Collaborator

Thu Feb 27 11:58:13 UTC 2020
The logs for [integration] [14] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/14.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=14

@seldondev
Copy link
Collaborator

Tue Mar 3 10:20:07 UTC 2020
The logs for [pr-build] [48] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/48.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=48

@RafalSkolasinski
Copy link
Member Author

The midnight integration tests failed on

test_rolling_update_deployment[graph1.json-graph4.json-ambas]

I have now rebased on master and squash commits. We will see how this run will finish.

@RafalSkolasinski
Copy link
Member Author

Now locally it failed for me on

test_rolling_update_deployment[graph1.json-graph3.json-istio]
test_rolling_update_deployment[graph1.json-graph5.json-istio]

@RafalSkolasinski RafalSkolasinski changed the title WIP: tags backward compatibility in executor tags backward compatibility in executor Mar 3, 2020
@RafalSkolasinski
Copy link
Member Author

This is the rolling_updates tests failing all the time. My new tests seems to be passing.

@RafalSkolasinski
Copy link
Member Author

/retest

@seldondev
Copy link
Collaborator

Tue Mar 3 13:00:39 UTC 2020
The logs for [integration] [51] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/51.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=51

@RafalSkolasinski
Copy link
Member Author

/retest

@seldondev
Copy link
Collaborator

Tue Mar 3 16:38:28 UTC 2020
The logs for [integration] [52] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/52.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=52

@axsaucedo
Copy link
Contributor

/retest

@seldondev
Copy link
Collaborator

Tue Mar 3 19:16:58 UTC 2020
The logs for [integration] [53] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/53.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=53

Copy link
Contributor

@axsaucedo axsaucedo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Really solid tests, and nice one changing prints to logging.info. I added a brief set of followup comments on the way meta is dealt with, but other than that looks good.

Test do seem to be failing due to flakeyness as in the latest one only 1 failed. @RafalSkolasinski can you confirm the tests pass locally? If so happy to merge!

python/seldon_core/utils.py Show resolved Hide resolved
python/seldon_core/utils.py Outdated Show resolved Hide resolved
@RafalSkolasinski
Copy link
Member Author

/test integration

@RafalSkolasinski
Copy link
Member Author

I have increased flakiness, we will see if it will pass now.

@seldondev
Copy link
Collaborator

Wed Mar 4 11:24:57 UTC 2020
The logs for [lint] [55] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/55.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=55

@seldondev
Copy link
Collaborator

Wed Mar 4 11:25:35 UTC 2020
The logs for [integration] [56] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/56.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=56

@seldondev
Copy link
Collaborator

Wed Mar 4 11:26:23 UTC 2020
The logs for [pr-build] [54] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1481/54.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1481 --build=54

Copy link
Contributor

@axsaucedo axsaucedo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks solid!
/approve
/lgtm

@seldondev
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: axsaucedo

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@seldondev
Copy link
Collaborator

@RafalSkolasinski: The following test failed, say /retest to rerun them all:

Test name Commit Details Rerun command
integration 4b3fa19 link /test integration

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@RafalSkolasinski
Copy link
Member Author

RafalSkolasinski commented Mar 4, 2020

All tests pass locally now. The latest problem was with new notebook tests.
There were 4 of them that kept failing due to missing python dependencies, see #1504.

The only one that I didn't manage to run is

test_notebooks.py::TestNotebooks::test_explainer_examples

which is quite odd because I verified that corresponding notebook run without any problems.

@cliveseldon

@axsaucedo axsaucedo merged commit 5eb177c into SeldonIO:master Mar 4, 2020
@RafalSkolasinski RafalSkolasinski deleted the issue/1474 branch March 17, 2020 10:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

executor: tags do not propagate through inference graph
3 participants