Update gstreamer and libcamera

[joaoantoniocardoso]

Gstreamer

GStreamer 1.22.3 (current) -> 1.24.x (new stable)

Critical improvements for BlueoS:

• Solves the WebRTCBin leak

Interesting changes from 1.22.3 to 1.22.10:

• appsink: unref buffer in prev sample early so buffers from v4l2 can be released properly
• v4l2src: handle resolution change when buffers are copied
• v4l2: allocator: Don't close foreign dmabuf
• v4l2: bufferpool: Fix large encoded stream regression
• v4l2: bufferpool: Problems when checking for truncated buffer
• v4l2: Fix support for left and top padding
• v4l2object: clear format lists if source change event is received
• v4l2src: Consider framerate during caps selection

Interesting changes from 1.22.10 to 1.24.0:

• WebRTC: Add support for ICE consent freshness (RFC 7675). This requires libnice >= 0.1.22.
• rtpbin and webrtcbin no longer blindly set properties on the jitter buffer assuming it's a standard rtpjitterbuffer, but instead check if the property is available first, to better support non-standard jitterbuffers or even an identity element in lieu of a jitter buffer.
• RTP header extension handling fixes for depayloaders that aggregate multiple input buffers into a single output buffer. Before, only the last RTP input buffer was checked for header extensions. Now the depayloader remembers all RTP packets pushed before an output buffer is produced and checks all RTP input buffers for header extensions.
• h264parse improved its AU boundary detection.
• h264parse, h265parse, mpegvideoparse now support multiple unregistered user data SEI messages.
• The entire gst-omx package and plugin has been retired. The gst-omx module has been removed. The OpenMAX standard is long dead and even the Raspberry Pi OS no longer supports it. There has not been any development since 1.22 was released. Users of these elements should switch to the Video4Linux-based video encoders and decoders which have been the standard on embedded Linux for quite some time now.
• New uvcsink element, based on v4l2sink allow streaming your pipeline as a UVC camera using Linux UVC Gadget driver.
• New rtppassthroughpay element which just passes RTP packets through unchanged, but appears like an RTP payloader element. This is useful for relaying an RTP stream as-is through gst-rtsp-server, which expects an RTP payloader with certain properties at the end of an RTSP media sub-pipeline.
• New inter plugin with new intersink and intersrc elements that allow to 1:N connect different pipelines in the same process. This is implemented around the appsrc / appsink-based StreamProducer API that is provided as part of the GStreamer Rust bindings, and is also used inside webrtcsrc and webrtcsink.
• New livesync element that allows maintaining a contiguous live stream without gaps from a potentially unstable source.

Libcamera

note: libcamera is still disabled. I tried to enable it, but it is failing for armv7 because pyyaml is failing to build from pip. -> Fixed. It's now enabled back again!

LibCamera 0.0.4 (current) -> 0.0.5 -> 0.1.0 -> 0.2.0

[joaoantoniocardoso]

Tested, it's running well: joaoantoniocardoso/blueos-core:update_base is using this docker pull joaoantoniocardoso/blueos-base:update-gstreamer

[patrickelectric]

What is the main advantage of this update ?

[joaoantoniocardoso]

What is the main advantage of this update ?

Nothing critical so far -- for what might affect us, GST has fixes regarding plugins used by MCM's imagesink (jpeg, appsink), and some fixes for h265, for MCM's future h265 feature.

[joaoantoniocardoso]

Changing to draft to hold it until next BlueOS's stable.

[patrickelectric]

@joaoantoniocardoso be free to remove it as a draft and make it open to review as well
We can merge, but probably we are not going to have a release with it for BlueOS stable.

[patrickelectric]

@joaoantoniocardoso can you confirm that since we don´t have libav, h264 dec is not available, and as result the camera manager is failing at the moment ?
bluerobotics/BlueOS#2436 (comment)

[joaoantoniocardoso]

@joaoantoniocardoso can you confirm that since we don´t have libav, h264 dec is not available, and as result the camera manager is failing at the moment ? bluerobotics/BlueOS#2436 (comment)

yeah, that's exactly what is happening.

[joaoantoniocardoso]

@patrickelectric it's now building with both libav and libcamera enabled :)

note: the image size increased from 237 to 288 MB

[patrickelectric]

@patrickelectric it's now building with both libav and libcamera enabled :)

note: the image size increased from 237 to 288 MB

Is there a blueOS version to test it ?

[joaoantoniocardoso]

@patrickelectric it's now building with both libav and libcamera enabled :)
note: the image size increased from 237 to 288 MB

Is there a blueOS version to test it ?

This is updated: bluerobotics/BlueOS#2436