AttributeError: cython_sources when installing KFP SDK + running Python components

[connor-mccarthy]

TLDR: Cython 3.0.0 just GA'd and introduced a regression which affects building pyyaml on some operating systems with some versions of Python. Upgrade to the latest version of the KFP SDK (v1 or v2) and recompile your components to get the fix.

Short term fix options

• Upgrade to the latest version of the KFP SDK within the major version you are using (1.8.22 and 2.0.1 at the time of writing this)
• Switch to a Python image/version that does not exhibit this error (python:3.7 appears to work in some cases)

With either option, recompile your components to get the fix.

Useful information

• This is an issue originating from outside the KFP.
• "AttributeError: cython_sources" with Cython 3.0.0a10 yaml/pyyaml#601 is good public documentation of this issue.
• This is thematically similar to [bug] urllib3 breaks lightweight components in Vertex AI and kubeflow pipelines with 2.0.x #9326 (comment), but appears to have smaller impact due to fewer affected combinations of KFP SDK versions and environments.

Reproducing

• docker run python:3.7 pip install 'kfp==1.8.20' PASS

• docker run python:3.10 pip install 'kfp==1.8.20' FAIL

• docker run python:3.10 pip install 'kfp==1.8.22' PASS

• docker run python:3.10 pip install 'kfp>=2.0.0,<3.0.0' PASS

Long term fix

We are nearing completion a change that extracts a KFP runtime package, preventing similar failures for existing components that use prior versions of the KFP SDK (versions we cannot patch once released).

[atemate]

Seeing this issue on GCP Vertex that uses Kubeflow internally. Forcing pyyaml==5.3.1 with non-working kfp==1.8.21 fixes the issue (following already mentioned comment)

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[github-actions]

This issue has been automatically closed because it has not had recent activity. Please comment "/reopen" to reopen it.