-
Notifications
You must be signed in to change notification settings - Fork 27
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
RAPIDS 24.06 Databricks Deployment Docs Update #373
Comments
Does In
I would assume installing |
Oh interesting - you're right!
|
cuML now has a PR to remove the hard dependency for 24.06. DataBricks has 1.0.2 installed on live, and 1.3 on the beta container. cuML won't trigger an update on its own, so to ensure DB users get a good experience I think we should do an upgrade as part of That being said, maybe my initial plan of an |
Ok thanks for confirming. So just to check, you are proposing we add something like the following to our docs pip install --extra-index-url=https://pypi.nvidia.com \
"cudf-cu11" \
"cuml-cu11" \
"dask-cudf-cu11" \
"dask-cuda=={{rapids_version}}" \
"scikit-learn==1.5" |
Yup! I figured this is the best place to do it since we already provide the |
@jarmak-nv @jacobtomlinson @aravenel this issue also affects colab. Thanks for sharing Ben! |
The fix in |
cuML now uses sklearn 1.5 with the merge of rapidsai/cuml#5851 which causes databricks to fail since their containers use at newest version 1.3.
We will need to update the docs to add
to init.sh
Otherwise users will see an error similar to below:
The text was updated successfully, but these errors were encountered: