The problem is that sacct now reports the state of the failed job as OUT_OF_MEMORY, which wasn't the case before. It appears that in the past this state was a transient one the test could either fail or succeed. This behaviour seems to have changed recently on Slurm and is exhibited at least on version 18.08.7.