Fix extra incorrectly shown on installation error

[sepehr-rs]

Fixes #13618
This resolves the issue, though I’m not certain it’s the ideal place for the fix. If needed, we can move the solution further down in the stack.

[notatallshaw]

I've not spent any time looking at the code, but I would be pretty nervous about removing the marker information until right before the error message.

Even if that marker information isn't used now someone might want to use it later and be surprised to find all marker information stripped, and there's no comment as to why that happened.