GH-39425: [CI] Fix import to match new substrait repo structure

[raulcd]

Rationale for this change

Upstream substrait repo did a small refactor. We have to update our imports to match the new structure.

What changes are included in this PR?

Update import

Are these changes tested?

Via archery

Are there any user-facing changes?

No

• Closes: [CI] Test substrait integration job has been failing for some time #39425

[github-actions]

⚠️ GitHub issue #39425 has been automatically assigned in GitHub to PR creator.

[raulcd]

@github-actions crossbow submit test-conda-python-3.10-substrait

[github-actions]

Revision: 1d0226a

Submitted crossbow builds: ursacomputing/crossbow @ actions-d7862e96be

Task	Status
test-conda-python-3.10-substrait

[raulcd]

@richtia @vibhatha is the AceroConsumer on https://github.com/substrait-io/consumer-testing not supposed to work anymore?

 pytest: error: argument --consumer: invalid choice: 'AceroConsumer' (choose from 'DataFusionConsumer', 'DuckDBConsumer')

Should we remove this job on the Arrow nightlies?

[vibhatha]

@raulcd need to check this. I doubt this could be a breaking change in the consumer testing API.

[richtia]

@raulcd @vibhatha Here's a PR to fix it: substrait-io/consumer-testing#43

It was removed a while back since development was stopped on Acero, but if it's needed for tests in Arrow, it can be added back.

[raulcd]

but if it's needed for tests in Arrow, it can be added back.

If we want to keep testing the integration on the Arrow nightly CI it is needed. If we feel is not necessary we can remove the nightly job.

[vibhatha]

It would be better to discuss this and finalize.

[vibhatha]

@github-actions crossbow submit test-conda-python-3.10-substrait

[github-actions]

Revision: 1d0226a

Submitted crossbow builds: ursacomputing/crossbow @ actions-a50d4cf458

Task	Status
test-conda-python-3.10-substrait

[vibhatha]

@raulcd seems like the CIs are passing now as @richtia has merged the PR.

[raulcd]

👍

[vibhatha]

@raulcd by the way I saw this failure in a few PRs recently.

[raulcd]

Thanks @vibhatha . This is supposed to be fixed on main as this was closed yesterday #39423

[conbench-apache-arrow]

After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit fe38d0e.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details.