New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OOM is happening on huge ParRanges toString #9888

Closed
scabug opened this Issue Aug 13, 2016 · 5 comments

Comments

Projects
None yet
1 participant
@scabug
Copy link

scabug commented Aug 13, 2016

In comparison with Range, where toString is overriden, ParRange is trying to output whole set of elements in the range, which is leads to OOM on 50mlns elements.

scala> collection.parallel.immutable.ParRange(1, 50000000, 1, true)
java.lang.OutOfMemoryError: Java heap space
http://stackoverflow.com/questions/38917988/scala-parrange-memory-consumption/38925612#38925612

@scabug

This comment has been minimized.

Copy link
Author

scabug commented Aug 13, 2016

Imported From: https://issues.scala-lang.org/browse/SI-9888?orig=1
Reporter: Volodymyr Glushak (v.glushak-at-gmail.com)
Assignee: Volodymyr Glushak (v.glushak-at-gmail.com)
See #9656

@scabug

This comment has been minimized.

Copy link
Author

scabug commented Aug 13, 2016

Volodymyr Glushak (v.glushak-at-gmail.com) said (edited on Aug 13, 2016 10:56:53 AM UTC):
PR on scala 2.12 created.
scala/scala#5335

@scabug

This comment has been minimized.

Copy link
Author

scabug commented Aug 13, 2016

@som-snytt said:
For some reason, this didn't come up on the related issue, which, I now see from the PR conversation, was surprisingly non-trivial.

@scabug

This comment has been minimized.

Copy link
Author

scabug commented Aug 17, 2016

Volodymyr Glushak (v.glushak-at-gmail.com) said:
Hi. sorry for delay. PR is on me.
I'll figure out how to deal with partest and update it soon.

@scabug

This comment has been minimized.

Copy link
Author

scabug commented Oct 4, 2016

Volodymyr Glushak (v.glushak-at-gmail.com) said:
PR is ready for review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment