[Python] CSV test_cancellation unittests fail on Apple M1

[asfimport]

Perhaps M1 is too quick :)

Most noticable when running the release verification tasks: #11511

Failing builds:

• https://github.com/ursacomputing/crossbow/runs/3969076907?check_suite_focus=true
• https://github.com/ursacomputing/crossbow/runs/3974036108?check_suite_focus=true#step:5:2014

Reporter: Krisztian Szucs / @kszucs
Assignee: Antoine Pitrou / @pitrou

PRs and other links:

• GitHub Pull Request #11598

_{Note: This issue was originally created as ARROW-14437. Please see the migration documentation for further details.}

[asfimport]

Krisztian Szucs / @kszucs:
cc @pitrou @jorisvandenbossche

[asfimport]

Joris Van den Bossche / @jorisvandenbossche:
cc @AlenkaF since you have an M1, it would be interesting to see if you can reproduce this (and if so, if it is solved by reducing the sleep time)

[asfimport]

Alenka Frim / @AlenkaF:
@jorisvandenbossche  that would be interesting. We'll do it together as M1 truly is too fast for me :D

[asfimport]

Yibo Cai / @cyb70289:
Remember I once met with this issue.
https://issues.apache.org/jira/browse/ARROW-12241
Looks we should make the workload even larger?
#9920

[asfimport]

Alenka Frim / @AlenkaF:
The csv test passes on my M1 in debug or release mode.

[asfimport]

Yibo Cai / @cyb70289:
I cannot reproduce the error locally either, even after increase the sleep time [1] to 1s.
1.5s does fails the test. I tested on 8 core M1, 16G ram, with AC power connected, release build.

[1] https://github.com/apache/arrow/blob/master/python/pyarrow/tests/test_csv.py#L1328

[asfimport]

Antoine Pitrou / @pitrou:
Perhaps the solution is to dynamically size the workload.

[asfimport]

Krisztian Szucs / @kszucs:
Issue resolved by pull request 11598
#11598