[Q&A] Will OnnxRuntime with DirectML EP will help me managing gpu vRAM automatically?

[ElinLiu0]

Hi:
Just in curious that will DirectML ep will automatically help me to managing vRAM in actual?Cause i doesn't seen any related GPU mem arena options for DirectML EP just like gpu_mem_limit somehow.

If there's some key point that should i being aware of while using DirectML then let me know.Thanks alot : )

[xadupre]

cc @yuslepukhin

[skottmckay]

The DML EP doesn't have much in the way of settings to configure vram usage. It doesn't appear to use the ORT arena and the only option is to disable arena usage (but setting that doesn't look like it has any meaningful effect in the DML EP implementation).

[ElinLiu0]

The DML EP doesn't have much in the way of settings to configure vram usage. It doesn't appear to use the ORT arena and the only option is to disable arena usage (but setting that doesn't look like it has any meaningful effect in the DML EP implementation).

Understood,That means the fundamental implementation of DML it self is incomplete.So that ORT couldn't access those memory management APIs,isn't it?