GH-40023: [Python] Use Cast() instead of CastTo

[llama90]

Rationale for this change

Remove legacy code

What changes are included in this PR?

• Replace the legacy scalar CastTo implementation for Python.

Are these changes tested?

Yes.

Are there any user-facing changes?

No.

• Closes: [Python] Remove Scalar legacy cast from Cython test #40023

[llama90]

@AlenkaF Hello.

If I would like to get this part reviewed, who should I ask? Thank you.

[AlenkaF]

Added a small comment, otherwise LGTM 👍
I think the CI should be green if you rebase.

[llama90]

BTW, It didn't work for me with 3.10, so when I configured it to 3.8, it worked.

It is right?

arrow/docs/source/developers/python.rst

Lines 212 to 219 in d6b9051

	$ conda create -y -n pyarrow-dev -c conda-forge \
	--file arrow/ci/conda_env_unix.txt \
	--file arrow/ci/conda_env_cpp.txt \
	--file arrow/ci/conda_env_python.txt \
	--file arrow/ci/conda_env_gandiva.txt \
	compilers \
	python=3.10 \
	pandas

[llama90]

@AlenkaF @jorisvandenbossche

Hello.
Could I request a review to proceed with additional tasks related to this?
Thank you.

[AlenkaF]

LGTM, thank you!

[llama90]

@AlenkaF Hello.

If there are no problems, can you merge it?

[AlenkaF]

@github-actions crossbow submit -g python

[github-actions]

Revision: 159b7eb

Submitted crossbow builds: ursacomputing/crossbow @ actions-7a0a16d5b4

Task	Status
test-conda-python-3.10
test-conda-python-3.10-cython2
test-conda-python-3.10-hdfs-2.9.2
test-conda-python-3.10-hdfs-3.2.1
test-conda-python-3.10-pandas-latest
test-conda-python-3.10-pandas-nightly
test-conda-python-3.10-spark-v3.5.0
test-conda-python-3.10-substrait
test-conda-python-3.11
test-conda-python-3.11-dask-latest
test-conda-python-3.11-dask-upstream_devel
test-conda-python-3.11-hypothesis
test-conda-python-3.11-pandas-upstream_devel
test-conda-python-3.11-spark-master
test-conda-python-3.12
test-conda-python-3.8
test-conda-python-3.8-pandas-1.0
test-conda-python-3.8-spark-v3.5.0
test-conda-python-3.9
test-conda-python-3.9-pandas-latest
test-cuda-python
test-debian-11-python-3-amd64
test-debian-11-python-3-i386
test-fedora-39-python-3
test-ubuntu-20.04-python-3
test-ubuntu-22.04-python-3

[AlenkaF]

@llama90 could you rebase? I think the failures should be gone then =)

[llama90]

Oh! I rebased it.

[AlenkaF]

@github-actions crossbow submit -g python

[github-actions]

Revision: 40b0711

Submitted crossbow builds: ursacomputing/crossbow @ actions-f68cc7f299

Task	Status
test-conda-python-3.10
test-conda-python-3.10-cython2
test-conda-python-3.10-hdfs-2.9.2
test-conda-python-3.10-hdfs-3.2.1
test-conda-python-3.10-pandas-latest
test-conda-python-3.10-pandas-nightly
test-conda-python-3.10-spark-v3.5.0
test-conda-python-3.10-substrait
test-conda-python-3.11
test-conda-python-3.11-dask-latest
test-conda-python-3.11-dask-upstream_devel
test-conda-python-3.11-hypothesis
test-conda-python-3.11-pandas-upstream_devel
test-conda-python-3.11-spark-master
test-conda-python-3.12
test-conda-python-3.8
test-conda-python-3.8-pandas-1.0
test-conda-python-3.8-spark-v3.5.0
test-conda-python-3.9
test-conda-python-3.9-pandas-latest
test-cuda-python
test-debian-11-python-3-amd64
test-debian-11-python-3-i386
test-fedora-39-python-3
test-ubuntu-20.04-python-3
test-ubuntu-22.04-python-3

[AlenkaF]

The failing builds are not connected and have open issues:

• pandas latest: [Python] NumPy 2 ABI changes (elsize) #40376
• AppVeyor [Python][CI] Failing test_dateutil_tzinfo_to_string due to new release of python-dateutil #40337

Thank you for you contributions @llama90 !

[conbench-apache-arrow]

After merging your PR, Conbench analyzed the 7 benchmarking runs that have been run so far on merge-commit b171b26.

There was 1 benchmark result with an error:

• Commit Run on ursa-i9-9960x at 2024-03-11 10:29:27Z
  • dataframe-to-table (R) with dataset=chi_traffic_2020_Q1, language=R

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 3 possible false positives for unstable benchmarks that are known to sometimes produce them.