Processing: as new data files get generated, upload them to object storage

[franTarkenton]

related to #65

The download step is now complete for both Viirs and Modis data. The next step is to rework how the data processing script step works.

This ticket will:

1. modify the processing of the data so that immediately after new intermediate data is generated it will get copied up to object storage.
2. The script will always check what data is in object storage first, and pull it down before generating locally.

[franTarkenton]

Made some progress on this with the download step, and for the processing / plotting steps for the modis runs. After the amount of time invested and the amount of work remaining made the decision to pivot out of this task and focus more on getting the pipeline to run based on missing data.

Work completed in this ticket includes:

• creation of a class to help manage the inputs / output paths of various data sets that are generated by the process
• detailed analysis of the code in an attempt to understand what data files get created by all the different steps that make up the daily pipeline.
• refactor to have various steps to check to see if they have already run based on the data that exists in object storage.
• removing auto delete of previously generated data.
• more documentation

[franTarkenton]

this ticket is not complete, but am closing, will come back to it if required