Unlock files blocked by other processes (as alternative to "Unlocker 1.9.2 Cedrick Collomb").
Handle Unlocker can forced close file handles, and then you can delete it usual way
This is GUI for SysInternals handle.exe writen in PowerShell
handle.exe - a small console utility from SysInternals Suite for view and close handles in Windows
Download: https://github.com/KiberInfinity/Handle-Unlocker/archive/master.zip
Unpack to target installation folder.
Run as Administrator install.bat from unpacked files
Run as Administrator uninstall.bat