assertion failed: dropping non-empty stream chunk builder

[fuyufjh]

Describe the bug

Crashed during longevity test:

2022-11-14T19:48:08.616138Z ERROR risingwave_stream::task::stream_manager: actor exit actor=998 error=Executor error: Channel `RemoteInput tonic error: status: Unknown, message: "error reading a body from connection: connection reset", details: [], metadata: MetadataMap { headers: {} }` closed
thread 'risingwave-streaming-actor' panicked at 'assertion failed: `(left == right)`
  left: `74`,
 right: `0`: dropping non-empty stream chunk builder', src/stream/src/common/builder.rs:47:9
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

Since the stacktrace is not enabled yet, I cannot 100% make sure that dropping non-empty stream chunk builder was caused by Channel RemoteInput tonic error`. But it does sound possible.

To Reproduce

None

Expected behavior

No response

Additional context

No response

[fuyufjh]

Failed to reproduce in recent runs. Let's reopen it once seen again.