Skip to content

Conversation

@jeremiah-corrado
Copy link
Contributor

Fix recent regression in array transfer performance. The regression was caused by:

  • an in-intent in sendRepMsg (added here) leading to an extra copy of the bytes payload. Fixed by not referencing repMsg after it gets handed off to sendRepMsg.
  • error handling that got moved into executeCommand here. Fixed by moving error handling back out into serverDaemon.

Also converts "tondarray" and "array" commands to use instantiateAndRegister annotation.

jeremiah-corrado and others added 10 commits August 14, 2024 10:06
Signed-off-by: Jeremiah Corrado <jeremiah.corrado@hpe.com>
…ors. Convert array and tondarray commands to use new annotations

Signed-off-by: Jeremiah Corrado <jeremiah.corrado@hpe.com>
Signed-off-by: Jeremiah Corrado <jeremiah.corrado@hpe.com>
Signed-off-by: Jeremiah Corrado <jeremiah.corrado@hpe.com>
Signed-off-by: Jeremiah Corrado <jeremiah.corrado@hpe.com>
Signed-off-by: Jeremiah Corrado <jeremiah.corrado@hpe.com>
Signed-off-by: Jeremiah Corrado <jeremiah.corrado@hpe.com>
Signed-off-by: Jeremiah Corrado <jeremiah.corrado@hpe.com>
Signed-off-by: Jeremiah Corrado <jeremiah.corrado@hpe.com>
@jeremiah-corrado jeremiah-corrado requested review from bmcdonald3 and stress-tess and removed request for bmcdonald3 August 15, 2024 22:36
Copy link
Member

@stress-tess stress-tess left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good! My only question is whether the proto test client file was committed on purpose. If so, we actually moved the tests to the tests directory, so if you could updated that version of client_test instead that would be great

@stress-tess stress-tess enabled auto-merge August 19, 2024 19:37
@stress-tess stress-tess added this pull request to the merge queue Aug 19, 2024
Merged via the queue into Bears-R-Us:master with commit d0db02f Aug 19, 2024
@jeremiah-corrado jeremiah-corrado deleted the array-transfer-perf-fix branch August 19, 2024 21:05
stonea added a commit to chapel-lang/chapel that referenced this pull request Sep 5, 2024
Annotations impacting array transfer performance:

```
8/19/24:
  - Array transfer perf fix (Bears-R-Us/arkouda#3671)
8/27/24:
  - Fix performance regression in to_ndarray (Bears-R-Us/arkouda#3697)
```
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants