[bug] stale images being treated as new content, causing duplicates

[nberlette]

I've noticed a couple instances of the oxblue.com photo stream being down recently. During these time periods, an outdated image in the response is coupled with inaccurate header metadata, making it seem as if its new content.

I need to add a deduplication step that checks the incoming bytes themselves and only proceeds with the scrape if they are new when compared to the most recent scrape. I've had to manually disable the workflow for now until the server returns to normal operation, in the meantime I'll work on a fix for this. I'll also remove all of the duplicates that have amassed during the last couple of outages.