Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Python][CI] Failing nightly dask integration tests #39531

Closed
AlenkaF opened this issue Jan 9, 2024 · 1 comment · Fixed by #39534
Closed

[Python][CI] Failing nightly dask integration tests #39531

AlenkaF opened this issue Jan 9, 2024 · 1 comment · Fixed by #39534
Assignees
@AlenkaF
Labels
Component: Python
Milestone
15.0.0

Comments

@AlenkaF
Copy link
Member

AlenkaF commented Jan 9, 2024

Describe the bug, including details regarding any error messages, version, and platform.

Nightly dask test have been failing for a while now, see for example https://github.com/ursacomputing/crossbow/actions/runs/7454907258/job/20283102200

The failing test_dataframe.py::test_describe_empty seems to be a flaky one and has an upstream issue opened: dask/dask#10672.

I haven't found an upstream issue for test_dataframe.py::test_view but it also doesn't look connected to PyArrow.

We should skip both tests in https://github.com/apache/arrow/blob/main/ci/scripts/integration_dask.sh#L37 to clean up nightly tests.

Component(s)

Python
@AlenkaF AlenkaF self-assigned this Jan 9, 2024
@AlenkaF
Copy link
Member Author

AlenkaF commented Jan 9, 2024

Aha, the second failing tests (test_dataframe.py::test_view) is not raising due to our CI using pandas version 2.1.4 and dask probably using dev version of pandas where pd.Series.view is being deprecated: https://pandas.pydata.org/docs/dev/reference/api/pandas.Series.view.html

@github-actions github-actions bot mentioned this issue Jan 9, 2024
Merged
AlenkaF added a commit that referenced this issue Jan 9, 2024
@AlenkaF
GH-39531: [Python][CI] Skip failing dask tests: test_describe_empty a…
74a29a5 
…nd test_view (#39534)

Skipping dask tests `test_dataframe.py::test_describe_empty` and `test_dataframe.py::test_view` on our CI to stop the nightly dask test jobs to fail. 
* Closes: #39531

Authored-by: AlenkaF <frim.alenka@gmail.com>
Signed-off-by: AlenkaF <frim.alenka@gmail.com>
@AlenkaF AlenkaF added this to the 16.0.0 milestone Jan 9, 2024
@raulcd raulcd modified the milestones: 16.0.0, 15.0.0 Jan 9, 2024
raulcd pushed a commit that referenced this issue Jan 10, 2024
@AlenkaF @raulcd
GH-39531: [Python][CI] Skip failing dask tests: test_describe_empty a…
aa52a1a 
…nd test_view (#39534)

Skipping dask tests `test_dataframe.py::test_describe_empty` and `test_dataframe.py::test_view` on our CI to stop the nightly dask test jobs to fail. 
* Closes: #39531

Authored-by: AlenkaF <frim.alenka@gmail.com>
Signed-off-by: AlenkaF <frim.alenka@gmail.com>
clayburn pushed a commit to clayburn/arrow that referenced this issue Jan 23, 2024
@AlenkaF @clayburn
apacheGH-39531: [Python][CI] Skip failing dask tests: test_describe_e…
7689d10 
…mpty and test_view (apache#39534)

Skipping dask tests `test_dataframe.py::test_describe_empty` and `test_dataframe.py::test_view` on our CI to stop the nightly dask test jobs to fail. 
* Closes: apache#39531

Authored-by: AlenkaF <frim.alenka@gmail.com>
Signed-off-by: AlenkaF <frim.alenka@gmail.com>
dgreiss pushed a commit to dgreiss/arrow that referenced this issue Feb 19, 2024
@AlenkaF @dgreiss
apacheGH-39531: [Python][CI] Skip failing dask tests: test_describe_e…
e0f8bd5 
…mpty and test_view (apache#39534)

Skipping dask tests `test_dataframe.py::test_describe_empty` and `test_dataframe.py::test_view` on our CI to stop the nightly dask test jobs to fail. 
* Closes: apache#39531

Authored-by: AlenkaF <frim.alenka@gmail.com>
Signed-off-by: AlenkaF <frim.alenka@gmail.com>
zanmato1984 pushed a commit to zanmato1984/arrow that referenced this issue Feb 28, 2024
@AlenkaF @zanmato1984
apacheGH-39531: [Python][CI] Skip failing dask tests: test_describe_e…
d1e7103 
…mpty and test_view (apache#39534)

Skipping dask tests `test_dataframe.py::test_describe_empty` and `test_dataframe.py::test_view` on our CI to stop the nightly dask test jobs to fail. 
* Closes: apache#39531

Authored-by: AlenkaF <frim.alenka@gmail.com>
Signed-off-by: AlenkaF <frim.alenka@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@AlenkaF AlenkaF

Labels
Component: Python
Projects
None yet
Milestone
15.0.0
Development

Successfully merging a pull request may close this issue.

GH-39531: [Python][CI] Skip failing dask tests: test_describe_empty and test_view AlenkaF/arrow
2 participants
@raulcd @AlenkaF