Connecting this client with a gstreamer webrtcbin endpoint

[ggovindan]

Forgive me for this ignorant question.

I want to be able to connect to one of the livekit servers to receive a video stream. I came across this client-sdk implemented in Rust (Thanks a lot for this!).

I have the websocket url for the livekit server and the token.
I tried implementing a webrtc client using gstreamer webrtcbin element similar to the example here (https://gitlab.freedesktop.org/gstreamer/gstreamer/-/blob/1.20/subprojects/gst-examples/webrtc/sendrecv/gst-rust/src/main.rs)but that fails in the signalling.

Will I have to implement or use one of the client-sdk to make the connection and then feed the RTP packets to the gstreamer pipeline?

[theomonnom]

Hey @ggovindan,
You can access video frames and feed them to gstreamer-rs using the on_frame callback from the VideoTracks.
You cannot use webrtcbin because LiveKit uses its own custom signaling protocol.
I'll be really interested in having a gstreamer example, I can help you if you make a PR

[ggovindan]

Thanks @theomonnom ! I will make a PR soon!

[spiegela]

@ggovindan did you have any success with this? I'm also interested in gstreamer -> livekit. Thanks!

[spiegela]

Ok. I mis-read -- I wanted to go the reverse and publish from gstreamer to livekit -- I'll poke around some more

[MathieuDuponchelle]

https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1262 should solve this :)

[MathieuDuponchelle]

(for the gst -> livekit direction)