Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature: service registry #75

Closed
stefannica opened this issue Apr 23, 2021 · 2 comments
Closed

Feature: service registry #75

stefannica opened this issue Apr 23, 2021 · 2 comments
Assignees
Labels
area/cli CLI features and behavior area/core

Comments

@stefannica
Copy link
Member

We need to manage the services deployed by the pipelines (e.g. prediction services) as first class citizens in fuseml. This enables users to show/list/delete running services.

@stefannica stefannica added area/core area/cli CLI features and behavior labels Apr 23, 2021
@stefannica stefannica added this to To do in Fuseml Repo via automation Apr 23, 2021
@stefannica stefannica added this to Backlog in FuseML Project Board via automation Apr 23, 2021
@stefannica stefannica removed this from To do in Fuseml Repo Apr 23, 2021
@jsuchome jsuchome self-assigned this May 5, 2021
@stefannica stefannica moved this from Backlog to In progress in FuseML Project Board May 10, 2021
@stefannica
Copy link
Member Author

Implementation variants, based on the online discussion we just had, related to how "services" are created and deleted, together with their associated k8s resources:

  1. the "service" descriptor is provided as an extra output of the same container that creates the KFServing resource (e.g. a yaml file) and the workflow engine extracts that somehow and publishes the "service" in the store
  2. use the k8s operator created by Flavio as the back-end that stores and manages "services" and model everything on top of it
  3. reuse the same container that creates the KFServing resources to handle the deleting (and updating) operations. Execute it from the "service" store back-end the same as we execute it from the pipeline every time a delete operation is required
  4. run a standalone service (or just standalone component in fuseml core) that is responsible not just for
    storing "service" entries, but also for interacting with the "back-end" KFserving / seldon core etc. solution to create/delete/update concrete applications

alternative combining 1+3: update the container that creates the KFServing resources to also call the FuseML API and register the "service" and its k8s resources. The "service" store is responsible for deleting them.

jsuchome added a commit to jsuchome/extensions that referenced this issue May 12, 2021
jsuchome added a commit to jsuchome/extensions that referenced this issue May 12, 2021
jsuchome added a commit to jsuchome/extensions that referenced this issue May 14, 2021
jsuchome added a commit to jsuchome/extensions that referenced this issue May 14, 2021
jsuchome added a commit to jsuchome/extensions that referenced this issue May 14, 2021
jsuchome added a commit to jsuchome/extensions that referenced this issue May 14, 2021
@jsuchome
Copy link
Member

I believe this is done now.

FuseML Project Board automation moved this from In progress to Done May 18, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/cli CLI features and behavior area/core
Projects
Development

No branches or pull requests

2 participants