New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding a way to specify out of core from the command line #277
Adding a way to specify out of core from the command line #277
Conversation
Merged build finished. Test PASSed. |
Test PASSed. |
Merged build finished. Test PASSed. |
Test PASSed. |
Merged build finished. Test PASSed. |
Test PASSed. |
Merged build finished. Test PASSed. |
Test PASSed. |
Merged build finished. Test PASSed. |
Test PASSed. |
Merged build finished. Test PASSed. |
Test PASSed. |
Merged build finished. Test PASSed. |
Test PASSed. |
Merged build finished. Test PASSed. |
Test PASSed. |
This will be blocked on ray-project/ray#3450 |
Lint Making psutil an optional import Allowing object_store_memory to be set as well Disallowing out of core on Mac
* Adds `pip install modin[out_of_core]` as a way to ensure out of core dependencies are installed. * Creates an `initialize_ray` function in `modin.pandas.__init__` to clean up the code * Uses psutil to set the amount of memory to 60% of virtual memory * If psutil is not installed, just used the Ray default
3438a76
to
f95ee76
Compare
Merged build finished. Test FAILed. |
Test FAILed. |
Merged build finished. Test FAILed. |
Test FAILed. |
Merged build finished. Test PASSed. |
Test PASSed. |
Merged build finished. Test PASSed. |
Test PASSed. |
Merged build finished. Test PASSed. |
Test PASSed. |
Merged build finished. Test PASSed. |
Test PASSed. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
some minor compatibility comments, other looks good!
Merged build finished. Test PASSed. |
Test PASSed. |
Merged build finished. Test PASSed. |
Test PASSed. |
Merged build finished. Test PASSed. |
Test PASSed. |
Merged build finished. Test PASSed. |
Test PASSed. |
What do these changes do?
Creates a way to use larger than memory dataframes in Modin without having to initialize Ray first.
Related issue number
git diff upstream/master -u -- "*.py" | flake8 --diff
black --check modin/