fix(datascience): enable Arrow S3 and Substrait support in pyarrow build

[puneetsharma21]

Synces the following into Dockerfile.konflux

• fix(datascience): enable Arrow S3 and Substrait support in pyarrow build opendatahub-io/notebooks#2570

Changes

• Added the following CMake flags to the PyArrow build:
  • -DARROW_S3=ON → Enables S3 filesystem support for PyArrow.
  • -DARROW_SUBSTRAIT=ON → Enables Substrait support required by Feast

[jiridanek]

These changes should happen on odh-io/notebooks, I believe. Not directly here.

[atheo89]

Thank you for incorporating the changes on upstream first, I will close this in favor opendatahub-io#2570 the changes will move to downstream on the next nightly sync

[puneetsharma21]

@jiridanek @atheo89 but the changes are in the Dockerfile.konflux in this PR, the upstream PR was for Dockerfile.cpu opendatahub-io#2570.
For the Konflux Dockerfile file, we’ll need to raise a separate PR.

[openshift-ci]

@puneetsharma21: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/images	569948c	link	true	/test images

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

[atheo89]

thank you for moving the changes to .konflux
/lgtm

[atheo89]

/lgtm

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: atheo89, jiridanek

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [atheo89,jiridanek]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment