perf can't find debug symbols in plugins

[c-taylor]

As discussed at ATS summit:

Due to the way ATS copies plugins before loading them and them immediately removes them.
Tools such as perf and gdb cannot find/load symbols without manually copying the plugin back into the temporary directory.

Ideally plugins would be left in place until they need to be removed.
This could be:

• Clean startup
• Clean exit