Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parallel append #75

Open
alimanfoo opened this issue Sep 21, 2016 · 1 comment
Open

Parallel append #75

alimanfoo opened this issue Sep 21, 2016 · 1 comment
Labels
enhancement New features or improvements

Comments

@alimanfoo
Copy link
Member

Currently the append method on the Array class obtains a lock on the array, which means all append operations are forced to be sequential. An alternative approach would be to implement append by locking the array in order to resize, but then locking only at the chunk level when setting data to be appended into the newly extended region. This would allow multiple append operations to be working in parallel, because they would be writing into non-overlapping regions of the array, while still maintaining the same append semantics.

@alimanfoo
Copy link
Member Author

Maybe have a method extend() which returns the new shape. If locking is handled within extend then there may be no need to keep the lock during the rest of append?

@alimanfoo alimanfoo added this to the v2.2 milestone Jan 24, 2017
@alimanfoo alimanfoo removed this from the v2.2 milestone Oct 31, 2017
@alimanfoo alimanfoo added the enhancement New features or improvements label Nov 21, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New features or improvements
Projects
None yet
Development

No branches or pull requests

1 participant