Skip to content

[Multi-GPU Polars] Reduce DaskEngine local cluster log verbosity - #22167

Merged
rapids-bot[bot] merged 3 commits into
NVIDIA:mainfrom
madsbk:reduce-dask-engine-verbosity
Apr 16, 2026
Merged

[Multi-GPU Polars] Reduce DaskEngine local cluster log verbosity#22167
rapids-bot[bot] merged 3 commits into
NVIDIA:mainfrom
madsbk:reduce-dask-engine-verbosity

Conversation

@madsbk

@madsbk madsbk commented Apr 16, 2026

Copy link
Copy Markdown
Contributor

When DaskEngine creates a local cluster, set the distributed logger level to WARNING (default is INFO) to reduce noisy startup and shutdown logs.

This does not affect user-provided clusters.

When `DaskEngine` creates a local cluster, set the `distributed` logger level to `WARNING` (default is `INFO`) to reduce noisy startup and shutdown logs.

This does not affect user-provided clusters.
@madsbk madsbk self-assigned this Apr 16, 2026
@madsbk madsbk added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Apr 16, 2026
@github-actions github-actions Bot added Python Affects Python cuDF API. cudf-polars Issues specific to cudf-polars labels Apr 16, 2026
@GPUtester GPUtester moved this to In Progress in cuDF Python Apr 16, 2026
@madsbk
madsbk marked this pull request as ready for review April 16, 2026 10:05
@madsbk
madsbk requested a review from a team as a code owner April 16, 2026 10:05
@NVIDIA NVIDIA deleted a comment from copy-pr-bot Bot Apr 16, 2026
Comment thread python/cudf_polars/cudf_polars/experimental/rapidsmpf/frontend/dask.py Outdated
Comment thread python/cudf_polars/cudf_polars/experimental/rapidsmpf/frontend/dask.py Outdated
@madsbk

madsbk commented Apr 16, 2026

Copy link
Copy Markdown
Contributor Author

Thanks @TomAugspurger, I think that did the trick

@madsbk

madsbk commented Apr 16, 2026

Copy link
Copy Markdown
Contributor Author

/merge

@rapids-bot
rapids-bot Bot merged commit c4439fb into NVIDIA:main Apr 16, 2026
88 of 89 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in cuDF Python Apr 16, 2026
@madsbk
madsbk deleted the reduce-dask-engine-verbosity branch April 16, 2026 17:10
shrshi pushed a commit to shrshi/cudf that referenced this pull request May 12, 2026
…DIA#22167)

When `DaskEngine` creates a local cluster, set the `distributed` logger level to `WARNING` (default is `INFO`) to reduce noisy startup and shutdown logs.

This does not affect user-provided clusters.

Authors:
  - Mads R. B. Kristensen (https://github.com/madsbk)

Approvers:
  - Tom Augspurger (https://github.com/TomAugspurger)

URL: NVIDIA#22167
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cudf-polars Issues specific to cudf-polars improvement Improvement / enhancement to an existing function non-breaking Non-breaking change Python Affects Python cuDF API.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants