Add RTSP support on linux / mac / windows

[truedat101]

There should be an alternate route that has rtsp. Needs a server side component.

[truedat101]

Made progress on this. It's good bad and ugly.

In theory, everything should work fine using ffmpeg. However, across each platform, you need to use a different capture tool.

on linux, it should be wonderful and easy, however, it's a mess because Wayland is like 15 years coming, yet not quite there. So if you don't have xorg enabled, x11grab doesn't work right.

On windows it should work.

[truedat101]

So anyway, the set up is

mediamtx + ffmpeg + x11grab

or

mediamtx + obs

I verified the OBS setup works brilliantly. I know OBS is a bit heavyweight, so it's not ideal in that way. But this is just for screen capture streaming, and especially if you want audio too, then you need something that will mux the streams.

gstreamer did work for the camera, so I was able to do gstreamer rtsp + ffmpeg with camera. But that's not the goal, it's screen mirroring.

[truedat101]

[truedat101]

that's streaming to my mac from my linux box.

[truedat101]

I will document a basic setup. Ideally one could have a simple zero dependency binary , and that's what the mediamtx offers. There are precompiled binaries. So this is great. I will get it documented say, for a windows setup and verify it works, and then push up another update to docs.

[truedat101]

The actual HTML5 streaming can come from some ready made components in react. This

https://github.com/k-yle/rtsp-relay?tab=readme-ov-file
(verified it works just fine)

or this:

https://github.com/CookPete/react-player
(really popular)

[truedat101]

I've already verified the react-player thing works with the spectacles, but just need to build a standalone server set up / scripts that can be run by mortals, and tunneled.

I think this is everything needed.

My true true test will be running it on some small arm linux device.

[truedat101]

The problem with ffmpeg + anything is the license ... so it's of cource buyer beware. Either you are grabbing a GPL blob or an LGPL blob. You don't really want to build ffmeg on your own. I think I can avoid issues by giving people the scripts to pull the files and let them decide which thing to use. I would like to avoid OBS if possible because of the performance requirements and complexity, though this is the right way to go if you want ultra sophisticated.

[truedat101]

In terms of streaming, verified:

HLS is simpler, once set up properly, the browser should just handle it. The Snap Spectacles don't seem to do this, and not sure why, could be on my end (how I am streaming), or could be just not possible. Need to test more.

The RTSP will work for sure, however, seems that the snap spectacles want the port number to be 443 or so ... wouldn't get this working on odd high number ports.

[truedat101]

I need to add the supporting JS/node.js project and update docs for mediamtx. There is a process to set these up to run. Probably done in the next few days.