[Bug] Phi3.5 Mini fails to initialize IHV with --temp-dir option (NVIDIA RTX 5060 Laptop & AMD Radeon 880M)

[Confuzzle]

When running Phi3.5 Mini on an NVIDIA RTX 5060 Laptop GPU (and also on AMD Radeon 880M) following Running MLPerf Client on an Offline Machine, the benchmark fails to start if the --temp-dir . option is specified. Without --temp-dir ., the benchmark runs successfully.

I'm using .\mlperf-windows.exe -c .\phi3.5\NVIDIA_ORTGenAI-DML_GPU.json --temp-dir . and I got the following:

Execution Summary:

Model: Phi3.5 phi-3.5-mini_instruct-dml (#1):
    :
        OrtGenAI {"device_id":0,"device_name":"NVIDIA GeForce RTX 5060 Laptop GPU","device_type":"GPU","device_vendor":"NVIDIA"}:
            Error:  Failed to initialize IHV,
            Invalid device id: 0
Invalid device id: 0
            Check Logs/error.log and Logs/phi3_5_executor.log for more details.

However, when using .\mlperf-windows.exe -c .\phi3.5\NVIDIA_ORTGenAI-DML_GPU.json (without --temp-dir .), the benchmark can run successfully.

Expected: it should work with or without --temp-dir..

[swasson488]

Assigned some folks to this issue.