Needs triage. Doesn't apply to Windows because on Windows the MSI refuses to update until you close the GUI. Refs #5790 and #5935