Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move ImageStream creation/handling from Pipelines to Operator #126

Open
1 task
VannTen opened this issue Nov 10, 2022 · 5 comments
Open
1 task

Move ImageStream creation/handling from Pipelines to Operator #126

VannTen opened this issue Nov 10, 2022 · 5 comments
Labels
kind/feature Categorizes issue or PR as related to a new feature. priority/backlog Higher priority than priority/awaiting-more-evidence. priority/important-longterm Important over the long term, but may not be staffed and/or may need multiple releases to complete. wg/cre Issues or PRs related to the Custom Runtime Environment (fka Custom Notebook Image) ODH feature.

Comments

@VannTen
Copy link
Member

VannTen commented Nov 10, 2022

High-level Goals

  • Directly handles ImageStream inside the Operator
  • No interactio between the Pipelines and the Openshift API
  • Optionnaly: Use ImageStream to determine CNBi state (ImageAvailable)

Proposal description

The ImageStream is created as part of the reconcilying loop and used as reconcile trigger

Alternatives

Keep the current situation.

Additional context

This was mentionned during CNBi meeting (9 Nov 2022)
Note that using ImageStream as the "impletementor" of CNBi rather than Pipeline might make more sense.

Consider the following scenarios:

  • CNBi is created => Pipeline gets run => ImageStream created && image pushed.
    => What if the ImageSteam is deleted (by the user) ? In that case, a K8S operator should reconcile, and that means recreating the ImageStream
    => What if the underlying image is removed from the internal registry ? In that case, we'd need a new pipeline to rebuild the image
    Note that both of these scenario do not imply a change of the PipelineRun resource, and will not (currently) trigger a reconcile request in the CNBi controller.

In a more theorical way, we should care about the result (= the ImageStream), not the process (= the PipelineRun) when doing level-based reconcile (the words of k8s docs).

Acceptance Criteria

  • CNBi controller create ImageStream with proper OwnerRefs
  • (Optionnal, might be in another issue)[ ] Reconcile using ImageStream state
@VannTen VannTen added the kind/feature Categorizes issue or PR as related to a new feature. label Nov 10, 2022
@codificat
Copy link
Member

/wg cnbi
/priority important-longterm

@sesheta sesheta added wg/cnbi priority/important-longterm Important over the long term, but may not be staffed and/or may need multiple releases to complete. labels Nov 10, 2022
@VannTen
Copy link
Member Author

VannTen commented Nov 16, 2022

/triage accepted
(Based on last week CNBi meeting)

@sesheta sesheta added wg/cre Issues or PRs related to the Custom Runtime Environment (fka Custom Notebook Image) ODH feature. and removed wg/cnbi labels Nov 18, 2022
@VannTen
Copy link
Member Author

VannTen commented Jan 6, 2023

kubernetes-sigs/controller-runtime#1191 (comment)

TL;DR: ImageStream (and more generically, historical Openshift resources like Routesm etc) CRDs are not easily available. This is unfortunate because we use envtest, which needs to add CRDs used by the Operator to the test cluster, even if we don't test ImageStream functionnality specifically. (see : https://github.com/thoth-station/meteor-operator/blob/main/controllers/cre/suite_test.go#L69-L74 )
@goern We mentionned that in November, maybe we could talk with the Openshift product team (?) to see if they have suggestions ?

@goern
Copy link
Member

goern commented Jan 9, 2023

It might also help to go thru the openshift-sme mailinglist, if it is still active ;) or drop by their slack.

@VannTen
Copy link
Member Author

VannTen commented Jan 25, 2023

/assign

@goern goern added the priority/backlog Higher priority than priority/awaiting-more-evidence. label Mar 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/feature Categorizes issue or PR as related to a new feature. priority/backlog Higher priority than priority/awaiting-more-evidence. priority/important-longterm Important over the long term, but may not be staffed and/or may need multiple releases to complete. wg/cre Issues or PRs related to the Custom Runtime Environment (fka Custom Notebook Image) ODH feature.
Projects
Status: 📋 Backlog
Development

No branches or pull requests

4 participants