how to turnoff logging?

[carlesoctav]

everytimes i run train_lm cli i'll get this ouput on stdout/cmd

[and many more]
9, copy-done.110, copy-done.12, get-tuple-element.4009, negate_add_fusion, copy-done.58, is-finite_select_fusion, copy-done.57), kind=kOutput, calls=
(pid=) {
(pid=)   param_5.2945 = bf16[8,1024,50257]{1,2,0:T(8,128)(2,1)} parameter(5)
(pid=)   param_6.2968 = f32[8,1024]{1,0:T(8,128)S(3)} parameter(6)
(pid=)   param_7.2982 = f32[8,1024]{1,0:T(8,128)S(3)} parameter(7)
(pid=)   param_8.3005 = f32[8,1024]{1,0:T(8,128)S(3)} parameter(8)
(pid=)   param_9.3047 = s32[8,1024]{1,0:T(8,128)S(3)} parameter(9)
(pid=)   fusion.242.clone.1 = bf16[8,1024,50257]{1,2,0:T(8,128)(2,1)} fusion(param_5.2945, param_6.2968, param_7.2982, param_8.3005, param_9.3047), kind=kLoop, calls=
(pid=)   {
[and many more]

is there a way for me to turn this off?

[dlwh]

hrm, we don't usually see that. are you GPU or TPU? how aer you running it?

[carlesoctav]

i was on tpu, but i use this levanter directly on tpuv4-8, instead of createing new vm for the head nodes.
another obsveration, i try run my simple train code (on the same amchine and i dont see any of this xla dump)

[carlesoctav]

I dont use launch.py, i run the python -m levanter.main_train_lm directly on my TPU instance. this output can be supressed (or at least prevented from filling my terminal) by redirecting it to a file, like this: python -m levanter.main.train_lm > trash.log

[dlwh]

ok in that case try TPU_STDERR_LOG_LEVEL=5 python -m levanter.main.train_lm ?

[carlesoctav]

still the same.

screenrecording-2025-10-27_14-03-44-1280.mp4

the only code that i change. all of them are just adding logging.info (to study the codebase)

i'm happy with my current solution rn. thank for the helps.

[dlwh]

oh oh oh, right. also try export TPU_MIN_LOG_LEVEL=5. this is due to ray-project/ray#53756