Reduce memory usage by the dark monitor

[bhilbert4]

This PR makes adjustments to the dark current monitor in order to try and reduce the overall memory usage. I'm afraid there isn't much we can do here. The highest memory usage comes when running the cal pipeline on the input files.

One option would be to skip the cal pipeline and fall back to using (last group - first group) as an approximation of the slope image.

• Look into what effects using the difference image would make.
• Would CRs throw off the statistics since we'd be skipping the jump step
• Would the dark rate histograms still be useful

This is being done as part of the effort to resolve #905

[pep8speaks]

Hello @bhilbert4, Thank you for updating !

• In the file jwql/instrument_monitors/common_monitors/dark_monitor.py:

Line 81:34: E126 continuation line over-indented for hanging indent
Line 387:31: E127 continuation line over-indented for visual indent
Line 387:67: E712 comparison to True should be 'if cond is True:' or 'if cond:'
Line 797:39: E127 continuation line over-indented for visual indent

Comment last updated at 2022-06-03 15:19:57 UTC

[bhilbert4]

I think this is all we can really do for now. I think we should review and merge this, and hopefully #921 will take care of residual memory errors.