replace concurrency with compute in RayDataAdapter backend

[omkar-334]

Fixes #1520

[copy-pr-bot]

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

[omkar-334]

cc @praateekmahajan @ayushdg

[greptile-apps]

Greptile Summary

Replaced deprecated concurrency parameter with the newer compute parameter in Ray Data's map_batches API, addressing the deprecation warning introduced in Ray 2.51.

• For actor-based stages, now uses ActorPoolStrategy with either size (for fixed concurrency) or min_size/max_size (for dynamic concurrency range)
• For task-based stages, removed the redundant concurrency: None parameter
• CPU and GPU resource specifications (num_cpus, num_gpus) are now passed alongside the compute strategy in compute_kwargs
• Updated logging to reflect the new parameter name

Confidence Score: 5/5

• This PR is safe to merge - it's a straightforward API migration that addresses a deprecation warning
• The change correctly migrates from the deprecated concurrency parameter to the new compute parameter using ActorPoolStrategy. The logic preserves the same behavior while adhering to Ray Data 2.51+ API changes. The implementation properly handles both fixed concurrency (using size) and dynamic concurrency ranges (using min_size/max_size), and correctly maintains resource specifications.
• No files require special attention

Important Files Changed

Filename	Overview
nemo_curator/backends/experimental/ray_data/adapter.py	Migrated from deprecated concurrency parameter to compute with ActorPoolStrategy for Ray Data 2.51+ compatibility

_{Last reviewed commit: a1b2e10}

[greptile-apps]

_{1 file reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile}

[greptile-apps]

_{1 file reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile}

[weijiac0619]

The migration from concurrency to compute LGTM.

[praateekmahajan]

LGTM thank yu @omkar-334 for your contribution!

[greptile-apps]

_{1 file reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile}

[praateekmahajan]

/ok to test a1b2e10