About the loss curve

[pilot2022]

Hello, thanks for your work and code!

Why the loss curves of x and y are unstable while z is stable？

Did this happen during your training?

[heng-hw]

Hello @pilot2022,

Thanks for your interest!
The oscillation of spatiality learning along the x- and the y-axis could be caused by the occasionally occurring inconsistent language label supervision. If you look at the dataset, you would find that for some objects, the collected labels are sometimes contradicted in descriptions about "left/right" and "front/behind" (but there are no such issues for "below/above", so learning along the z-axis is stable). Hope this helps!

Best,
Heng