Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove references to OAuth and the deprecated Seldon OAuth gateway #2623

Merged
merged 9 commits into from
Nov 19, 2020

Conversation

adriangonz
Copy link
Contributor

@adriangonz adriangonz commented Nov 10, 2020

What this PR does / why we need it:

Remove deprecated OAuth code from seldon_core as well as some references to the deprecated oauth_key and oauth_secret fields of SeldonDeployment.

Which issue(s) this PR fixes:

Fixes #1677

Special notes for your reviewer:

This PR tries to remove most of the references to OAuth and the deprecated Seldon gateway but it's possible that some of them still remain.
There is a seldon_core.SeldonCallCredentials object which holds an auth token, but that one seems to have a scope different to the OAuth code (and could still be potentially useful).

This PR doesn't remove the oauth_key and oauth_secret fields from the CRD as that would mean breaking changes within the same version.
So these fields are still there but flagged as deprecated.

This PR also includes a fix for the hack/update_python_version.sh script, which was breaking a couple notebooks (e.g. 9ce35af#diff-df3b13e162caddc01763ecf53f05bc42a0718582e9f5bd3ebb82a558d914e782).

Does this PR introduce a user-facing change?:

Remove support of the deprecated Seldon OAuth gateway from `seldon_core`.

@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@seldondev
Copy link
Collaborator

Tue Nov 10 16:00:26 UTC 2020
The logs for [pr-build] [1] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/1.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=1

@seldondev
Copy link
Collaborator

Tue Nov 10 16:01:05 UTC 2020
The logs for [lint] [2] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/2.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=2

@adriangonz
Copy link
Contributor Author

/test integration
/test notebooks

@adriangonz
Copy link
Contributor Author

/test docs

@seldondev
Copy link
Collaborator

Tue Nov 10 16:03:13 UTC 2020
The logs for [notebooks] [3] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/3.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=3

@seldondev
Copy link
Collaborator

Tue Nov 10 16:03:32 UTC 2020
The logs for [integration] [4] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/4.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=4

@adriangonz
Copy link
Contributor Author

/cc @cliveseldon @RafalSkolasinski @axsaucedo

@seldondev
Copy link
Collaborator

Tue Nov 10 16:05:01 UTC 2020
The logs for [docs] [5] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/5.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=5

@adriangonz
Copy link
Contributor Author

/test integration

@seldondev
Copy link
Collaborator

Tue Nov 10 16:24:06 UTC 2020
The logs for [integration] [6] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/6.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=6

@adriangonz
Copy link
Contributor Author

/test docs

@seldondev
Copy link
Collaborator

Wed Nov 11 11:44:37 UTC 2020
The logs for [pr-build] [7] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/7.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=7

@seldondev
Copy link
Collaborator

Wed Nov 11 11:44:39 UTC 2020
The logs for [lint] [8] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/8.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=8

@seldondev
Copy link
Collaborator

Wed Nov 11 11:45:02 UTC 2020
The logs for [docs] [9] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/9.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=9

@adriangonz
Copy link
Contributor Author

/test integration

@seldondev
Copy link
Collaborator

Wed Nov 11 12:06:14 UTC 2020
The logs for [integration] [10] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/10.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=10

@adriangonz
Copy link
Contributor Author

/test notebooks

@seldondev
Copy link
Collaborator

Wed Nov 11 14:08:38 UTC 2020
The logs for [notebooks] [11] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/11.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=11

@@ -23,7 +23,7 @@
"source": [
"## Setup Seldon Core\n",
"\n",
"Use the setup notebook to [Setup Cluster](../../../notebooks/seldon_core_setup.ipynb#Setup-Cluster) with [Ambassador Ingress](../../../notebooks/seldon_core_setup.ipynb#Ambassador) and [Install Seldon Core](../../seldon_core_setup.ipynb#Install-Seldon-Core). Instructions [also online](./seldon_core_setup.html)."
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I always worry when I see absolute links... One of the issues is that even if someone will be browsing docs for a given version link will lead to latest...

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree. Unfortunately, there isn't a better alternative when using nbsphinx-link.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe would be worth moving all examples / notebooks inside doc/ folder at some point? Would that help?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That would help, and that's kind of what nbsphinx favours. However, I believe it was decided not to do that to keep the examples folder at the root level of the repo.

Maybe an option worth exploring would be using sym links? Not sure how that would work with Git and nbsphinx.

Copy link
Contributor

@RafalSkolasinski RafalSkolasinski Nov 16, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Symlinks seems reasonable, imo. Maybe worth opening a follow up issue on that.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good shout. I'll open up an issue.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For reference, this is the issue exploring the symlinks: #2649

Copy link
Contributor

@RafalSkolasinski RafalSkolasinski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, nice to see code cleanup 👍

I think one more place to adjust in in batch_processor.py:

CHOICES_GATEWAY_TYPE = ["ambassador", "istio", "seldon"]

probably need to remove seldon gateway type

@RafalSkolasinski
Copy link
Contributor

My comments are more of a "nitpick" - batch_processor adjustment I am happy to take care in follow up.
Unless there is anything else @adriangonz to change here, I would say that we can merge it

@adriangonz
Copy link
Contributor Author

/test notebooks

@adriangonz
Copy link
Contributor Author

@RafalSkolasinski I've kicked off the notebook tests again. Once those pass I think we should be good to merge.

Copy link
Contributor

@RafalSkolasinski RafalSkolasinski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/approve

@seldondev
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: RafalSkolasinski

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@seldondev
Copy link
Collaborator

Mon Nov 16 15:13:18 UTC 2020
The logs for [lint] [14] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/14.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=14

@seldondev
Copy link
Collaborator

Mon Nov 16 15:13:17 UTC 2020
The logs for [pr-build] [13] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/13.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=13

@seldondev
Copy link
Collaborator

Mon Nov 16 15:13:21 UTC 2020
The logs for [integration] [17] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/17.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=17

@seldondev
Copy link
Collaborator

Mon Nov 16 15:13:38 UTC 2020
The logs for [notebooks] [15] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/15.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=15

@seldondev
Copy link
Collaborator

Mon Nov 16 15:16:02 UTC 2020
The logs for [docs] [16] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/16.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=16

@adriangonz
Copy link
Contributor Author

adriangonz commented Nov 16, 2020

The docs linter failed because of a broken external link. It could be something temporary, so we'll leave it there for now.

tutorials/blogs.rst:3: [broken] https://www.mosaicventures.com/mosaicblog/2020/2/20/mlops-the-end-of-end-to-end: 404 Client Error: Not Found for url: https://www.mosaicventures.com/mosaicblog/2020/2/20/mlops-the-end-of-end-to-end

@adriangonz
Copy link
Contributor Author

/test integration

@seldondev
Copy link
Collaborator

Mon Nov 16 16:17:42 UTC 2020
The logs for [integration] [18] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/18.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=18

@adriangonz
Copy link
Contributor Author

/test integration

@seldondev
Copy link
Collaborator

Mon Nov 16 17:37:19 UTC 2020
The logs for [integration] [19] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/19.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=19

@adriangonz
Copy link
Contributor Author

/test integration

@seldondev
Copy link
Collaborator

Tue Nov 17 17:37:31 UTC 2020
The logs for [integration] [20] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/20.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=20

@adriangonz
Copy link
Contributor Author

/test integration

@seldondev
Copy link
Collaborator

Wed Nov 18 09:47:27 UTC 2020
The logs for [integration] [21] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/21.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=21

@adriangonz
Copy link
Contributor Author

/test integration
/test notebooks

@seldondev
Copy link
Collaborator

Thu Nov 19 09:38:22 UTC 2020
The logs for [integration] [23] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/23.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=23

@seldondev
Copy link
Collaborator

Thu Nov 19 09:38:43 UTC 2020
The logs for [notebooks] [22] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/22.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=22

@seldondev
Copy link
Collaborator

@adriangonz: The following tests failed, say /retest to rerun them all:

Test name Commit Details Rerun command
docs 70b62f5 link /test docs
notebooks 70b62f5 link /test notebooks
integration 70b62f5 link /test integration

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the jenkins-x/lighthouse repository. I understand the commands that are listed here.

@adriangonz adriangonz closed this Nov 19, 2020
@adriangonz adriangonz reopened this Nov 19, 2020
@adriangonz
Copy link
Contributor Author

/test integration

@seldondev
Copy link
Collaborator

Thu Nov 19 12:05:22 UTC 2020
The logs for [lint] [25] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/25.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=25

@seldondev
Copy link
Collaborator

Thu Nov 19 12:05:40 UTC 2020
The logs for [pr-build] [24] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/24.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=24

@seldondev
Copy link
Collaborator

Thu Nov 19 12:05:52 UTC 2020
The logs for [lint] [27] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/27.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=27

@seldondev
Copy link
Collaborator

Thu Nov 19 12:05:52 UTC 2020
The logs for [pr-build] [26] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-2623/26.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-2623 --build=26

@seldondev seldondev merged commit 7cec6a4 into SeldonIO:master Nov 19, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Remove OAuth code from Seldon Client
3 participants