Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Rise of the tomb raider causes ring gfx timeout #44

Closed
Zakhrov opened this issue Aug 2, 2018 · 7 comments
Closed

Rise of the tomb raider causes ring gfx timeout #44

Zakhrov opened this issue Aug 2, 2018 · 7 comments
Assignees
@jfactory07
Labels
won't fix Expected issue and won't fix it.

Comments

@Zakhrov
Copy link

Zakhrov commented Aug 2, 2018

launching Rise of the Tomb Raider with AMDVLK causes the following error in dmesg:

[ 1792.044917] [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring gfx timeout, last signaled seq=60221, last emitted seq=60223
[ 1792.044926] [drm] No hardware hang detected. Did some blocks stall?

I managed to get the following errors in the debug build in AMDVLK

AMD-PAL: Warn: Alert triggered: earlyPhase == false | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/pal/src/core/hw/gfxip/gfx6/gfx6Barrier.cpp:237:GetDepthStencilBltPerSubres)
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Warn: Alert triggered: earlyPhase == false | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/pal/src/core/hw/gfxip/gfx6/gfx6Barrier.cpp:237:GetDepthStencilBltPerSubres)
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Warn: Alert triggered: earlyPhase == false | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/pal/src/core/hw/gfxip/gfx6/gfx6Barrier.cpp:237:GetDepthStencilBltPerSubres)
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Warn: Alert triggered: earlyPhase == false | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/pal/src/core/hw/gfxip/gfx6/gfx6Barrier.cpp:237:GetDepthStencilBltPerSubres)
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Warn: Alert triggered: earlyPhase == false | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/pal/src/core/hw/gfxip/gfx6/gfx6Barrier.cpp:237:GetDepthStencilBltPerSubres)
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_po

My GPU is an AMD Radeon HD7770 / R7 250X (GFX6 Cape Verde) running with the AMDGPU driver using AMDVLK update 26/07/2018
Once the error is triggered, the computer stops responding and only a hard reboot works
@Zakhrov Zakhrov changed the title Rise oft the tomb raider causes ring gfx timeout Rise of the tomb raider causes ring gfx timeout Aug 2, 2018
@jinjianrong jinjianrong added the assigned The issue is assigned to engineer label Aug 7, 2018
@Zakhrov
Copy link
Author

Zakhrov commented Aug 7, 2018 •
edited

screenshot_20180715_101539
The release build fails to launch the game. Steam reports that it is running and the process shows up in the task manager but I get no game window. Attached Screenshots:
screenshot_20180715_101611
screenshot_20180715_101800

@jfactory07
Copy link

Would you mind to debug this issue ? It is strange that release build fails to launch the game but debug build will have a gfx ring timeout issue.

@Zakhrov
Copy link
Author

Zakhrov commented Aug 15, 2018

The Problem seems to be with the ImageBarrierPolicy::GetLayouts function. The assertion fails and the system to lock up. I'm not entirely sure why it locks up like that. I can get as far as the loading screen before it locks up and forces me to hard reboot the system.
Adding a return statement to the beginning of the GetLayouts function causes it to spam the following message:

AMD-PAL: Error: Assertion failed: ((imageInfo.oldLayout.usages == LayoutUninitializedTarget) || (imageInfo.oldLayout.engines != 0)) && (imageInfo.newLayout.engines != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/pal/src/core/hw/gfxip/gfx6/gfx6Barrier.cpp:1014:Barrier)
It locks up here as well. In both cases, the CPU utilization hits 80% on the RiseOfTheTombRa process. The release build launches the game. I can see the RiseOftheTombRa process but neither the game nor the configuration dialog shows.

@Zakhrov
Copy link
Author

Zakhrov commented Aug 19, 2018 •
edited

The newest code causes the lock up when running the benchmark in the mountain pass scene. Attached screenshots of the place where it locks up
img_20180819_103947
img_20180819_104008

The system rebooted shortly after I took the pictures.

@jfactory07
Copy link

Thanks for your update ! It seems the latest code has fixed the issue you got when using release driver. I will check the new issue.

@Zakhrov
Copy link
Author

Zakhrov commented Sep 1, 2018

The code as of 31-08-2018 still stalls the GPU on both the debug and release drivers. The debug driver gives the following output

AMD-PAL: Warn: Alert triggered: earlyPhase == false | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/pal/src/core/hw/gfxip/gfx6/gfx6Barrier.cpp:237:GetDepthStencilBltPerSubres)
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_policy.cpp:931:GetLayouts)
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_policy.cpp:931:GetLayouts)

And dmesg gives me the following:

[  326.026713] [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring gfx timeout, signaled seq=71543, emitted seq=71545
[  326.026723] [drm] GPU recovery disabled.

@Zakhrov
Copy link
Author

Zakhrov commented Oct 27, 2018

The newest code (2018-10-26) didn't lock up my system but it did cause the game to crash with the following errors:

AMD-PAL: Error: Assertion failed: pInfo->interpolatorCount >= 1 | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/pal/src/core/hw/gfxip/gfx6/gfx6PipelineChunkVsPs.cpp:124:EarlyInit)
AMD-PAL: Error: Assertion failed: endRegAddr >= startRegAddr | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/pal/src/core/hw/gfxip/gfx6/gfx6CmdUtil.cpp:2929:BuildSetSeqContextRegs)
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_policy.cpp:934:GetLayouts)
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_policy.cpp:934:GetLayouts)
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_policy.cpp:934:GetLayouts)
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_policy.cpp:934:GetLayouts)
RiseOfTheTombRaider: /home/aaron/Projects/AMDVLK/drivers/llpc/patch/llpcCodeGenManager.cpp:113: virtual bool Llpc::LlpcDiagnosticHandler::handleDiagnostics(const llvm::DiagnosticInfo&): Assertion `diagInfo.getSeverity() != DS_Error' failed.
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_policy.cpp:934:GetLayouts)
AMD-PAL: Error: Assertion failed: (results[0].usages != 0) && (results[1].usages != 0) && (results[2].usages != 0) | Reason: Unknown (/home/aaron/Projects/AMDVLK/drivers/xgl/icd/api/barrier_policy.cpp:934:GetLayouts)

It seems to only affect GFX6 GPUs and RADV seems to work fine

@JacobHeAMD JacobHeAMD added won't fix Expected issue and won't fix it. and removed assigned The issue is assigned to engineer labels Aug 19, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jfactory07 jfactory07

Labels
won't fix Expected issue and won't fix it.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@Zakhrov @jfactory07 @jinjianrong @JacobHeAMD