New segments for consuming Kinesis Data Streams not being created

[fmorillo7694]

When segments reach a threshold row (not the one I specified) the Pinot controller does not create new segments to continue consuming. It does create new ones, once the threshold time is reached.
I have specified the following configurations to the table
"realtime.segment.flush.threshold.rows": "0",
"realtime.segment.flush.threshold.time": "1h",
"realtime.segment.flush.threshold.size": "200M"

However, each segment in S3 is less than 10 megabytes, the segments are closed before reaching the threshold time and size. It seems it gets a default size of 150000 rows and then it does not create new ones up until they get flushed out after an hour.

[Jackie-Jiang]

When using the segment flush threshold, segment will start from a smaller size, then slowly grow to the desired size (there is no direct translation from row count to size). The segment size you see in S3 is the compressed size. You should check the decompressed segment size on the servers.

New segment should be created immediately after the previous one is committed. Can you check the controller log and see if the segment is committed properly?