Broken preview image on RTSP source

[SelimEmre]

Short description

There is an issue with generating image with RTSP sources.

Steps to reproduce

1. Add 720p adaptive option.
2. Add below settings and restart Ant Media Server

settings.previewGenerate=true
settings.createPreviewPeriod=20000
settings.previewHeight=480
settings.previewOverwrite=true

3. Add any RTSP source. You can test it with this RTSP source: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mp4

Expected behavior

It should create an expected resolution png image.

Actual behavior

The images were broken.

Logs

2022-10-22 18:41:12,374 [Thread-11] io.antmedia.streamsource.StreamFetcher - StartStream called, new thread is started for PFUOCgWfe5NH1666453270366
2022-10-22 18:41:12,437 [Thread-12] io.antmedia.streamsource.StreamFetcher - Preparing the StreamFetcher for rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mp4 for streamId:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:12,437 [Thread-12] io.antmedia.streamsource.StreamFetcher - Setting rtsp transport type to tcp for stream source: rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mp4
2022-10-22 18:41:14,585 [Thread-12] io.antmedia.AntMediaApplicationAdapter -  Status of stream PFUOCgWfe5NH1666453270366 is set to Broadcasting with result: true
2022-10-22 18:41:14,585 [Thread-12] io.antmedia.muxer.MuxAdaptor - serverSettings exist io.antmedia.settings.ServerSettings@2185b086
2022-10-22 18:41:14,585 [Thread-12] io.antmedia.muxer.MuxAdaptor - vertx exist io.vertx.core.impl.VertxImpl@7515834c
2022-10-22 18:41:14,585 [Thread-12] io.antmedia.muxer.MuxAdaptor - serverSettings exist io.antmedia.settings.ServerSettings@2185b086
2022-10-22 18:41:14,585 [Thread-12] io.antmedia.muxer.MuxAdaptor - serverSettings exist io.antmedia.settings.ServerSettings@2185b086
2022-10-22 18:41:14,586 [Thread-12] io.antmedia.streamsource.StreamFetcher - PFUOCgWfe5NH1666453270366 stream count in stream rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mp4 is 2
2022-10-22 18:41:14,586 [Thread-12] io.antmedia.muxer.MuxAdaptor - Audio format sample rate:12000 bitrate:0 for stream: PFUOCgWfe5NH1666453270366 source index:0 target index:0
2022-10-22 18:41:14,586 [Thread-12] io.antmedia.muxer.MuxAdaptor - Video format codec Id: 27 width:240 height:160 for stream: PFUOCgWfe5NH1666453270366 source index:1 target index:1
2022-10-22 18:41:14,587 [Thread-12] io.antmedia.enterprise.adaptive.base.AudioDecoder - audio decoder name:  aac for PFUOCgWfe5NH1666453270366 sample rate:12000
2022-10-22 18:41:14,587 [Thread-12] io.antmedia.enterprise.adaptive.EncoderAdaptor - find decoder for stream: PFUOCgWfe5NH1666453270366 
2022-10-22 18:41:14,588 [Thread-12] io.antmedia.enterprise.adaptive.EncoderAdaptor - video decoder name:  h264 for PFUOCgWfe5NH1666453270366  video context timebase:0/2 wxh:240x160
2022-10-22 18:41:14,588 [Thread-12] io.antmedia.enterprise.adaptive.EncoderAdaptor - Object detection is NOT enabled for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:14,588 [Thread-12] io.antmedia.enterprise.adaptive.StreamAdaptor - Stream adaptor scheduled job id 24 stream adaptor:1839122516 for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:14,588 [Thread-12] io.antmedia.enterprise.adaptive.StreamAdaptor - Stream adaptor scheduled job id 25 stream adaptor:627605006 for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:14,589 [Thread-12] io.antmedia.enterprise.adaptive.audio.OpusEncoder - encoder name libopus source sample rate 12000, channel layout 3
2022-10-22 18:41:14,589 [Thread-12] io.antmedia.enterprise.adaptive.audio.AACEncoder - name : aac 
2022-10-22 18:41:14,590 [Thread-12] io.antmedia.enterprise.adaptive.video.H264Encoder - incoming width x height: 240x160, aspect ratio:1.5 video codec timebase:1/30
2022-10-22 18:41:14,590 [Thread-12] io.antmedia.enterprise.adaptive.video.H264Encoder - finding encoder for stream:PFUOCgWfe5NH1666453270366 width/height:1080/720 timebase:1/30 sampleAspectRatio:32/27 gopSize:60 bitrate:1500000
2022-10-22 18:41:14,592 [Thread-12] io.antmedia.enterprise.adaptive.video.H264Encoder - Video codec opened. Context gop size: 60  keyint mint 25 extradata size: 33 video codec timebase: 1/30  codecName: libopenh264 for stream: PFUOCgWfe5NH1666453270366
2022-10-22 18:41:14,592 [Thread-12] io.antmedia.enterprise.adaptive.video.H264Encoder - encoder name: libopenh264 for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:14,593 [Thread-12] io.antmedia.enterprise.webrtc.WebRTCMuxer - extra data 0: 0  1: 0, 2:0, 3:1, 4:103
2022-10-22 18:41:14,593 [Thread-12] io.antmedia.enterprise.preview.PngEncoder - PNG incoming widthxheight:240x160 initial aspect ratio: 0.6666666666666666
2022-10-22 18:41:14,593 [Thread-12] io.antmedia.enterprise.preview.PngEncoder - preparing codec for stream: PFUOCgWfe5NH1666453270366 source wxh:240x160 target wxh:720x480 aspect ratio: 0.6666666666666666
2022-10-22 18:41:14,593 [Thread-12] io.antmedia.enterprise.preview.PngEncoder - leaving prepare codec for stream: PFUOCgWfe5NH1666453270366
2022-10-22 18:41:14,593 [Thread-12] io.antmedia.enterprise.webrtc.WebRTCAdaptor - registering PFUOCgWfe5NH1666453270366 muxer with 720p and codec::H264 to webrtc adaptor
2022-10-22 18:41:14,593 [Thread-12] io.antmedia.enterprise.webrtc.WebRTCAdaptor - Increasing number of live streams: 1 and stream id:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:14,594 [Thread-12] io.antmedia.AntMediaApplicationAdapter - start publish leaved for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:14,595 [vert.x-worker-thread-20] io.antmedia.AntMediaApplicationAdapter -  Status of stream PFUOCgWfe5NH1666453270366 is set to Broadcasting with result: true
2022-10-22 18:41:14,597 [Thread-12] io.antmedia.streamsource.StreamFetcher - dts (30) is bigger than pts(-9223372036854775808)
2022-10-22 18:41:14,598 [Thread-12] io.antmedia.streamsource.StreamFetcher - last dts-9223372036854775808 is bigger than incoming dts 30
2022-10-22 18:41:14,598 [Thread-12] io.antmedia.streamsource.StreamFetcher - last dts0 is bigger than incoming dts 0
2022-10-22 18:41:14,598 [Thread-12] io.antmedia.streamsource.StreamFetcher - dts (1) is bigger than pts(0)
2022-10-22 18:41:14,599 [Thread-12] io.antmedia.streamsource.StreamFetcher - last dts-9223372036854775808 is bigger than incoming dts 31
2022-10-22 18:41:14,609 [vert.x-worker-thread-23] io.antmedia.enterprise.preview.PngEncoder - Ratio(0.0) and incoming ratio(1.5) are not equal for stream:PFUOCgWfe5NH1666453270366 target resolution: 0X480
2022-10-22 18:41:14,609 [vert.x-worker-thread-23] io.antmedia.enterprise.preview.PngEncoder - PNG incoming widthxheight:240x160 initial aspect ratio: 0.6666666666666666
2022-10-22 18:41:14,609 [vert.x-worker-thread-23] io.antmedia.enterprise.preview.PngEncoder - preparing codec for stream: PFUOCgWfe5NH1666453270366 source wxh:240x160 target wxh:720x480 aspect ratio: 0.6666666666666666
2022-10-22 18:41:14,609 [vert.x-worker-thread-23] io.antmedia.enterprise.preview.PngEncoder - leaving prepare codec for stream: PFUOCgWfe5NH1666453270366
2022-10-22 18:41:14,751 [vert.x-worker-thread-19] io.antmedia.enterprise.adaptive.video.H264Encoder - There is no video output at this time for stream index 1 for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:14,785 [vert.x-worker-thread-19] io.antmedia.enterprise.adaptive.video.H264Encoder - There is no video output at this time for stream index 1 for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:14,806 [vert.x-worker-thread-19] io.antmedia.enterprise.adaptive.video.H264Encoder - There is no video output at this time for stream index 1 for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:15,030 [vert.x-worker-thread-44] io.antmedia.enterprise.adaptive.video.H264Encoder - There is no video output at this time for stream index 1 for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:15,038 [vert.x-worker-thread-44] io.antmedia.enterprise.adaptive.video.H264Encoder - There is no video output at this time for stream index 1 for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:17,030 [vert.x-worker-thread-59] io.antmedia.enterprise.adaptive.video.H264Encoder - There is no video output at this time for stream index 1 for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:17,680 [vert.x-worker-thread-50] io.antmedia.enterprise.adaptive.video.H264Encoder - There is no video output at this time for stream index 1 for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:18,009 [vert.x-worker-thread-60] io.antmedia.enterprise.adaptive.video.H264Encoder - There is no video output at this time for stream index 1 for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:24,035 [vert.x-worker-thread-58] io.antmedia.enterprise.adaptive.video.H264Encoder - There is no video output at this time for stream index 1 for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:25,440 [vert.x-worker-thread-32] io.antmedia.enterprise.adaptive.video.H264Encoder - There is no video output at this time for stream index 1 for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:26,037 [vert.x-worker-thread-1] io.antmedia.enterprise.adaptive.video.H264Encoder - There is no video output at this time for stream index 1 for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:26,511 [vert.x-worker-thread-45] io.antmedia.enterprise.adaptive.video.H264Encoder - There is no video output at this time for stream index 1 for stream:PFUOCgWfe5NH1666453270366
2022-10-22 18:41:27,106 [vert.x-worker-thread-6] io.antmedia.enterprise.adaptive.video.H264Encoder - There is no video output at this time for stream index 1 for stream:PFUOCgWfe5NH1666453270366

[SelimEmre]

It's already merged into the Enterprise project.