Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create a benchmarking framework #1731

Closed
ukclivecox opened this issue Apr 23, 2020 · 2 comments · Fixed by #2075
Closed

Create a benchmarking framework #1731

ukclivecox opened this issue Apr 23, 2020 · 2 comments · Fixed by #2075
Labels
priority/p1
Projects
1.3
Milestone
1.3

Comments

@ukclivecox
Copy link
Contributor

  • Test operator under load
  • Test executor under load
  • Test model servers under load via Seldon and without to compare.
@ukclivecox ukclivecox mentioned this issue Apr 23, 2020
Closed
@gaocegege
Copy link
Contributor

gaocegege commented Apr 27, 2020 •
edited

The operator itself is hard to be the bottleneck. Overhead in the control plane mainly comes from conversion webhooks. Since webhooks are created for Seldon's own resources, it is not a huge problem.

The other two points are important to us (We are investigating if we could replace our own Serving CRD implementation with Seldon Core)

@ukclivecox
Copy link
Contributor Author

@gaocegege Happy to discuss in more detail if you want to ping me on the community slack.

@ukclivecox ukclivecox added this to To do in 1.3 via automation Jun 28, 2020
@ukclivecox ukclivecox added this to the 1.3 milestone Jun 28, 2020
@ukclivecox ukclivecox mentioned this issue Jul 5, 2020
Merged
@ukclivecox ukclivecox moved this from To do to In progress in 1.3 Jul 9, 2020
1.3 automation moved this from In progress to Done Jul 21, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
priority/p1
Projects
No open projects
1.3
  
Done
Milestone
1.3
Development

Successfully merging a pull request may close this issue.

Initial benchmarking and load tests
2 participants
@gaocegege @ukclivecox