Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

read_sql() parallelism parameter #455

Open
rd5802 opened this issue Feb 4, 2019 · 2 comments

Comments

@rd5802
Copy link

commented Feb 4, 2019

Add a parameter which will limit the maximum number of sessions for concurrent partitioned read.

RD

Thanks @rd5802 that sounds good to me. Would you mind to create a new issue so we can track that specific request? I think we can leave this conversation open for the sake of keeping the conversation on parallel read_sql alive.

Originally posted by @devin-petersohn in #418 (comment)

@devin-petersohn

This comment has been minimized.

Copy link
Member

commented Feb 4, 2019

Thanks @rd5802! It should be relatively straightforward, and a couple of people have recently come to me about contributing so I will let someone take it.

All we really need to do for this is to add a max_sessions parameter to modin.experimental.pandas.io.read_sql.

@rd5802

This comment has been minimized.

Copy link
Author

commented Feb 5, 2019

That's really great @devin-petersohn . Looking forward to see whats next 👍 .

ipacheco-uy added a commit to ipacheco-uy/modin that referenced this issue Apr 26, 2019

@ipacheco-uy ipacheco-uy referenced this issue Apr 26, 2019
2 of 3 tasks complete

devin-petersohn added a commit that referenced this issue Apr 29, 2019

@devin-petersohn devin-petersohn referenced this issue Jun 5, 2019
6 of 22 tasks complete
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants
You can’t perform that action at this time.