Update RAPIDS to use cuda::mr::async_resource_ref

[harrism]

This is a cross-RAPIDS tracking issue for the epic described in this document. Please refer to the document for background and details.

Tasks

Beta Give feedback

1. Introduce cuda::mr::{async_}resource_ref to RMM and use in place of device_memory_resource pointers. Introduce conversions between rmm::cuda_stream_view and cuda::stream_ref. Done in Use cuda::mr::memory_resource instead of raw device_memory_resource rmm#1095 (23.12)
2. Require explicit initial pool size in pool_memory_resource. This is because it is difficult to automatically size the pool when the memory is not device memory. Done in Require explicit pool size in pool_memory_resource and move some things out of detail namespace rmm#1417
3. Deprecate and remove get_mem_info methods from memory resources. rmm#1388
   4 of 4
   cpp feature request tech debt +3
   
4. Deprecate and remove supports_streams() from memory resources rmm#1389
   3 of 3
   cpp feature request +2
   
5. [FEA] Change semantics of RMM memory resource equality comparison rmm#1402
   feature request +1
   
6. [FEA] Add a convenience alias in RMM for cuda::mr::async_resource_ref<cuda::mr::device_accessible> rmm#1442
   feature request +1
   
7. [FEA] Refactor RMM in terms of cuda::mr::memory_resource rmm#1443
   12 of 14
   feature request +1
8. Refactor RMM tests to use cuda::resource_ref instead of device_memory_resource pointers. rmm#1444
   feature request +1
   
9. [FEA] Dev container support for building and testing cuDF JNI cudf#15549
   Java feature request +2
10. Replace device_memory_resource* with device_async_resource_ref cudf#15498
    improvement +1
11. Replace device_memory_resource* with device_async_resource_ref raft#2261
    improvement +1
12. Replace device_memory_resource* with device_async_resource_ref cugraph#4333
    improvement +1
13. Replace device_memory_resource* with device_async_resource_ref cuml#5839
    improvement +1
14. Replace device_memory_resource* with device_async_resource_ref cuspatial#1371
    improvement +1
15. Convert any other RAPIDS repos to use rmm::mr::device_async_resource_ref instead of device_memory_resource pointers
16. Refactor RMM resources to implement cuda::memory_resource concepts and deprecate and remove device_memory_resource and host_memory_resource base classes. rmm#1445
    9 of 13
    Epic feature request +2
    

[harrism]

#1443 includes much of this, but I've included all of the work here for cross-repo visibility.

[jakirkham]

Have noted this as "In progress". Please let me know if that is not the case and can change