Failures when copying index files to solr cloud leave the data files in place

[ansell]

The solr cloud nodes only have enough disk space for three biocache collections. When failures occur during the copy index files to the solr cloud nodes job, the files for the third collection are not deleted, resulting in the next copy failing due to disk space issues.

All failures during the copy index files job need to delete the files, and the collection so that future automated jobs do not fill up the disks.