Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does pipelines only support on GKE? And the workflow run with some problem. #365

Closed
hackenzheng opened this issue Nov 22, 2018 · 11 comments
Closed

Comments

@hackenzheng
Copy link

  1. I tried deployed pipeline on my local k8s cluster, but there are many problems. And the document just introduce the deployment on GKE. Does pipeline only suport GKE?
  2. As below, when I ran the samples/kubeflow-tf/kubeflow-training-classification.py, the preprocess node ran failed but the sign goes to green means it successful?
    image
@etheleon
Copy link

Hi i ran into the same error message.

@paveldournov
Copy link
Contributor

The samples are currently GKE/GCP specific, they expect inputs as GCS locations for example. +@qimingj

@Ark-kun
Copy link
Contributor

Ark-kun commented Dec 4, 2018

@yebrahim The error messages look a bit strange.

@govindKAG
Copy link

The docs on the site say that it currently only works with GCP.

@jlewi
Copy link
Contributor

jlewi commented Apr 22, 2019

@paveldournov @vicaire @Ark-kun Can we close this issue? Do the docs still state that GKE is required?

We are using labels platform/other and platform/aws to track issues affecting specific platforms.

@vicaire
Copy link
Contributor

vicaire commented Apr 23, 2019

@jlewi, I added the label "platform/other".

@hackenzheng, is our issue resolved?

@govindKAG, please provide a reference to the problematic document so we can fix. KFP aims to run reliably on K8, independently of GCP.

@jlewi
Copy link
Contributor

jlewi commented Apr 23, 2019

I think the relevant doc is
https://www.kubeflow.org/docs/pipelines/pipelines-overview/

And the snippet is

Due to #345 and #337, Kubeflow Pipelines depends on Google Cloud Platform (GCP) services and some of the functionality is currently not supported by non-GKE clusters.

@hackenzheng
Copy link
Author

Yeah, the problem has been solved . Now kfp provides a simple way to deploy on any k8s cluster.

@govindKAG
Copy link

@vicaire I was referring to the link that @jlewi mentioned

@vicaire
Copy link
Contributor

vicaire commented Apr 25, 2019

Thanks @govindKAG.

@sarahmaddox, you have an issue tracking the update of the documentation, correct?

@sarahmaddox
Copy link
Contributor

Yes, here's the doc issue:
kubeflow/website#655

Linchin pushed a commit to Linchin/pipelines that referenced this issue Apr 11, 2023
…kubeflow#365)

* Add fire, gitpython and hub to test image, fix namespace packaging.

* fire is a python library that makes it easy to define entrypoints
* gitpython is a python library for git; this will be used for gitops and CI/CD
* hub is a CLI for github that will be used for gitops

* Create a script to checkout repos. This is intended to be used in
  situations where we want to check out the latest code and then run some
  script.

* Fix a bug in namespace package __init__.py has a typo.

* Parameterize the makefile for the worker image so that we can build the worker image for project kubeflow-releasing using GCB.

* Add a script for configuring permissions on ssh keys.
  * This can be used in an init container to setup ssh keyes;
    see
    https://github.com/jlewi/kubeflow-dev/blob/master/notes/git_on_kubeflow.md

* exclude release-infra from lint
magdalenakuhn17 pushed a commit to magdalenakuhn17/pipelines that referenced this issue Oct 22, 2023
… macOS (kubeflow#365)

* Modify sed options to run 'make test' on macOS

* Remove a workaround by moving a conflicted variable into a function

* Move a few package variables into a function
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

10 participants