Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use memoryview.nbytes when warning on large graph send #8268

Merged
merged 1 commit into from Oct 13, 2023

Conversation

crusaderky
Copy link
Collaborator

@crusaderky crusaderky commented Oct 12, 2023

Fix bug where the client would not warn when embedding a numpy or pandas constant with word size 8 worth up to 79.9 MB in the graph, whereas it should warn starting from 10 MB.

This is a blocker for Python 3.12 support, as len(memoryview(a)), where a is a 0-dimensional numpy array, won't work anymore. (XREF #8223)

@crusaderky crusaderky self-assigned this Oct 12, 2023
crusaderky added a commit to graingert/distributed that referenced this pull request Oct 12, 2023
@crusaderky crusaderky mentioned this pull request Oct 12, 2023
2 tasks
@github-actions
Copy link
Contributor

Unit Test Results

See test report for an extended history of previous test failures. This is useful for diagnosing flaky tests.

       21 files  ±0         21 suites  ±0   10h 55m 33s ⏱️ + 36m 42s
  3 859 tests +1    3 739 ✔️ +  4     117 💤 ±0    3  - 2 
37 309 runs  +9  35 477 ✔️ +11  1 813 💤 +1  19  - 2 

For more details on these failures, see this check.

Results for commit 4784ad9. ± Comparison against base commit b49c0bb.

@crusaderky crusaderky merged commit 8d89ef0 into dask:main Oct 13, 2023
18 of 29 checks passed
@crusaderky crusaderky deleted the memoryview_nbytes branch October 13, 2023 10:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants