Temporary prefix is not removed when installing libisal from source

[rhpvorderman]

The build prefix is removed, but the temporary prefix is not. This is a result of the setup.py implementation where libisal is only build once. Otherwise it would have been trivial to remove the prefix.
The temporary install prefix is 1.4 MB big. This is only an issue for installations from the source distribution.