-
Notifications
You must be signed in to change notification settings - Fork 707
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Executor Attribute Error when trying to run custom python function-based components with Kubeflow Runner #3628
Comments
@charlesccychen any thoughts about the code packaging solution? |
Hi @bkhuong, we have an issue where it is not possible to use function-based components if they are defined in the same file as the pipeline, which we will clarify. Can you refactor your code so that the component is imported from a different module instead? See https://www.tensorflow.org/tfx/guide/custom_function_component for a working notebook example. |
I ran into the same issue and tried the workaround in the notebook example. It worked for InteractiveContext, but my pipeline failed in Kubeflow Pipelines with a |
Hi, @bkhuong Apologies for the delay and I would suggest you to please follow the section of Python Function-Based Components in this article and we always recommend to go with latest version of TFX and KFP and you can refer Compatibility Matrix here for TFX and KFP and you can also refer to these resources for custom component in TFX [1],[2],[3],[4] If you're looking for complete end to end example of TFX with Kubeflow then you can look into this article I am able to reproduce the same code without any error and for your reference, I have added gist file here so please use latest versions of TFX and KFP with below commands in Google Colab:
If above workaround is working fine for you, Could you please close this issue and If issue still persists please let us know ? Thank you! |
Hi, @bkhuong Closing this issue due to lack of recent activity for couple of weeks. Please feel free to reopen the issue or post comments, if you need any further assistance or update. Thank you! |
Environment: Google Cloud (Uploading pipeline yaml to Kubeflow Pipelines instance)
TFX Version: 0.29
Python version: 3.7.3
Describe the current behavior
I get the following error:
Describe the expected behavior
The PathGeneratorComponent successfully outputs the string artifact "some string".
Standalone code to reproduce the issue
The text was updated successfully, but these errors were encountered: