Lightcurve_extraction seems to fail sometimes in certain ways.

[jchate6]

From Request 1162802:
79 blocks were observed between 2021/03/05 and 2021/03/15
30 blocks have ALCDEF files were uploaded to S3
34 blocks have movies uploaded to S3

Request Numbers 2407829, 2407830, 2407845 have movies, but no ALCDEF.

No observations between 06:00 2021/03/08 and 01:00 2021/03/13 were successfully extracted.

Adding to this that long cadences of movies will break the website since they are referencing dozens of URLS at once.

[talister]

I think some of the earlier blocks were affected by both of our main and backup vizier servers being completely borked in early March. This was breaking the frame processing completely as it could get any reference stars. I tweaked catalog_subs on 2021-03-07 18:51 to use the CDS, Strasbourg Vizier but I think I only reran the pipeline for (231937)

[jchate6]

It appears that the issue with blocks that have movies but not ALCDEF is caused by updating, but not overwriting daily alcdef lists combining all the blocks for an obs-day.
Each movie has a different name depending on the block. The ALCDEF files are updated as new blocks come in based on the day. If we upload these files before they are complete, they won't be overwritten unless done so manually.

[jchate6]

I think some of the earlier blocks were affected by both of our main and backup vizier servers being completely borked in early March. This was breaking the frame processing completely as it could get any reference stars. I tweaked catalog_subs on 2021-03-07 18:51 to use the CDS, Strasbourg Vizier but I think I only reran the pipeline for (231937)

This could be why there was no extraction for 2021-03-06. Could it have happened again on 2021-03-08?

[jchate6]

movies have now appeared for all blocks that had ALCDEF files, but not movies. (might have just been delayed loading too many movies.)

[talister]

Possible. Think we need a diagnostic command that can take a SuperBlock number or tracking number, fetch the SuperBlock and all the observed Blocks for that SuperBlock and then for each Block, produce like a 1 line summary of the number of e91 frames and the number of frames with good zeropoints and the presence and creation time of the ALCDEF files and movies (maybe locally and in S3?)

[jchate6]

All of the data seems to be on Apophis, Upload issue?

[jchate6]

Would like to add ImageFields to the block model to reference the relevant gifs.