The program sometimes crashed with backtrace in stderr but sometimes crashed with nothing.
At first the code is golang mixed with some c code, which crashed with error traceback has leftover defers , and the backtrace is attached as BT#1.
Then I insert a dead-loop of sleep to the code before it running into the c code, and it crashed with error systemstack called from unexpected goroutineSIGTRAP: trace trap. Backtrace is attached as BT#2.
The crash only happens on two specific servers, and was never seen on other boxes before.