My 'loss_l' goes to 1.837 and the model never improves

[MotorCityCobra]

Using the code, the loss_l goes to 1.837 and never improves from there.
I notice when the loss_l reaches 1.837 the values for kl_μ and kl_Σ are both at zero.

I'm using your code here to train a model in MuJoCo. I wonder if some of the constraints should have different values or if there is a more obvious explanation for what is going wrong here.