How to use libcamera-vid to stream rtsp on raspberry pi? #3097

renarena · 2022-04-13T10:16:44Z

renarena
Apr 13, 2022

blakeblackshear wrote elsewhere: Ideally, you want to find a way to send raw yuv420p data directly to frigate. That way you can avoid the overhead of encoding the video only to decode it again right away.

I try to use libcamera-vid on pi zero to stream rtsp, but i do not find an example i can use, all tutorials using raspivid or picamera or do not cover rtsp streaming :-(
I installed ffmpeg, gstreamer and rtsp-simple-server on raspbian lite on my Pi Zero.

This both works:
gst-launch-1.0 libcamerasrc ! video/x-raw, width=1920, height=1080, framerate=5/1 ! videoconvert ! videoscale ! autovideosink
libcamera-vid --timeout 0000 --width 1920 --height 1080 --framerate 5 --nopreview --codec h264 --profile high --intra 5 --output -

But i do not know if i need gstreamer or rtsp-simple-server or both and how to create the rtsp stream.
Some examples i found use cvlc but it seems vlc is causing problems lately and should be avoided.

MildarAA · 2022-04-13T17:07:59Z

MildarAA
Apr 13, 2022

I use rpicamsrc and it is working very well and is effective.

There is my example:
/home/xxx/gst-rtsp-server-1.19.2/build/examples/test-launch "( rpicamsrc awb-mode=tungsten preview=false rotation=180 ! video/x-h264, width=1920, height=1080, framerate=15/1, profile=constrained-baseline ! h264parse ! queue ! rtph264pay name=pay0 config-interval=2 pt=96 )"

I know you asked a bit different question but I hope it may help.

3 replies

renarena Apr 13, 2022
Author

Thank you.
With this sort of command i wonder where the /home/xxx/gst-rtsp-server-1.19.2/build/examples/test-launch comes from
I installed gstreamer with apt and there is nowhere something like an example...

I want to use libcamera because picamera is marked as legacy.

MildarAA Apr 15, 2022

Oh shit. I forgot to answer, sorry. That path is from RTSP server. Gstreamer itselve cannot be RTSP server, only client. Your point about being legacy is probably valid. That is partly why I installed older but
proved Buster OS instead of new Bullsteye.
In the end I used this page the most: https://qengineering.eu/install-gstreamer-1.18-on-raspberry-pi-4.html
It worked for me with 1.14 version of Gstreamer but there was a bug that bugged me that should not be in 1.18 so I recompiled everything according to section Buster Version 1.18.4. Somewhere down is section RTSP streaming which explains that RTSP server I am talking about (everything in one convoluted page. yay!).

From my experience where it took me quite a while to set this up. Bullseye OS gave me errors I was not able to solve. Any conversion is a huge problem on performance. Both in Frigate server and in Raspberry zero camera server. This sollution (Raspberry zero with Buster OS, Gstreamer using rpicamsrc) is the best I was able to make work with features I needed and low performance. And to be frank it was hell to discover. rpicamsrc can stream in h264 natively and frigate can process it natively and very easyly. Cannot help with yuv420p thought.. do not even know what it is :D

MildarAA Apr 15, 2022

I also removed part of my original answer where I am streaming only zoomed part of a whole area that I am recording. I distincly remember it was a issue somewhere. probably in the Bullseye OS which promted me to switch to older OS where rpicamsrc, which is wrapper around picamera, is still well supported

renarena · 2022-04-15T11:11:12Z

renarena
Apr 15, 2022
Author

I think yuv420p is the raw format. It doesnt matter if yuv or h264 for now, but i dont seem to get the right command line to use with https://github.com/aler9/rtsp-simple-server

Does work

This line correctly shows my camera video (also before i installed additional 500MB with the -dev plugins from qengineering tutorial)
gst-launch-1.0 libcamerasrc ! video/x-raw, width=640, height=480, framerate=30/1 ! videoconvert ! videoscale ! autovideosink

using libcamera-vid -t 0 --inline --listen -o tcp://0.0.0.0:8888 from https://www.tomshardware.com/how-to/use-raspberry-pi-camera-with-bullseye i can access the stream by tcp/h264://raspberrypi.local:8888

Does not work

Originally i tried to follow https://www.wtip.net/blog/2021/08/raspberry-pi-camera-rtsp-streaming-with-multiple-resolution-feeds/
The python script here https://gist.github.com/wtip/3057c777d2887919af2f1d3872c21405 uses something like
HQcmd = "gst-launch-1.0 fdsrc ! h264parse ! rtspclientsink location=rtsp://myuser:mypass@localhost:8554/hqstream debug=false"

gst-launch-1.0 libcamerasrc ! h264parse ! rtspclientsink location=rtsp://localhost:8554/stream1 gives WARNING: erroneous pipeline: could not link libcamerasrc0 to h264parse0

gst-launch-1.0 libcamerasrc ! rtspclientsink location=rtsp://localhost:8554/stream1 gives

ERROR: from element /GstPipeline:pipeline0/GstRTSPClientSink:rtspclientsink0: Could not open resource for reading and writing.
Additional debug info:
../gst/rtsp-sink/gstrtspclientsink.c(3250): gst_rtsp_client_sink_connect_to_server (): /GstPipeline:pipeline0/GstRTSPClientSink:rtspclientsink0:
Failed to connect. (Generic error)

The rtsp example from rtsp-simple-server says
ffmpeg -re -stream_loop -1 -i file.ts -c copy -f flv rtmp://localhost/mystream

and somewhere else i found
libcamera-vid --timeout 0000 --width 640 --height 480 --framerate 5 --codec h264 --profile high --intra 5 --output - | gst-launch-1.0 -e libcamerasrc ! rtspclientsink location=rtsp://localhost:8554/stream1 which gives
ERROR V4L2 v4l2_device.cpp:349 'imx219 10-0010': Unable to set controls: Device or resource busy

libcamera-vid --timeout 0000 --width 640 --height 480 --framerate 5 --codec h264 --profile high --intra 5 --output - rtsp://localhost:8554/stream1
"streams" strange characters into my terminal. Comes from https://forums.raspberrypi.com/viewtopic.php?p=1937211&hilit=rtsp+stream+libcamera+vid#p1937211

I even installed vlc (another 150MB) https://forums.raspberrypi.com/viewtopic.php?p=1973706
$ libcamera-vid -t 0 --inline -o - | cvlc -vvv stream:///dev/stdin --sout '#rtp{sdp=rtsp://:8080/}' :demux=h264
but this also gave errors regarding Pulseaudio and unknown query 0x30e in demux_vaControlHelper

I have no further idea how a correct command line may look for terminal or rtsp-simple-server :-(

5 replies

mraiser Dec 28, 2022

You were almost there:

libcamera-vid --framerate 30 --nopreview --inline -t 0 --width 1920 --height 1080 --listen -o - | ffmpeg -i - -profile:v high -pix_fmt yuvj420p -level:v 4.1 -preset ultrafast -tune zerolatency -vcodec libx264 -r 10 -s 1920x1080 -f mpegts -flush_packets 0 udp://192.168.0.3:5000?pkt_size=1316

Replace 192.168.0.3 with the ip address of the device you want to view from. Run VLC on that device and open network stream udp://@0.0.0.0:5000

robert-tessonics Jan 3, 2023

While the approach works, best I was able to achieve were 12fps with 3 to 4 seconds delay using a Pi 4 over gigabit ethernet streaming 800x600. In Full HD, framerate drops to a constant 6.8, but the artifacts render every frame unusable.

renarena Jan 3, 2023
Author

normally i use framerate of 3-6 and maybe a smaller resolution, so i hope this will work (not yet tried, need to find, where i put the zero)

JohnMcLear Jan 9, 2024

Errors on Pi5

[NULL @ 0x5555bb9a46c0] Unable to find a suitable output format for '-'

glossyio Jan 18, 2024

Errors on Pi5

[NULL @ 0x5555bb9a46c0] Unable to find a suitable output format for '-'

The Raspberry Pi 5 requires you to use --libav-format h264 to specify the output container, since it can't deduce what isn't specified.

E.g. for a Pi Camera 3 on RPi5 Use
rpicam-vid --camera 0 --mode 2304:1296 --framerate 15 --hdr --timeout 0 --nopreview --codec h264 --libav-video-codec h264 --libav-format h264 --inline -o -

Though, I was unable to get any of the above working for me. I had to install and run go2rtc on the system to forward it. FFMPEG UDP did run, but it was consuming a lot more CPU than go2rtc--it was double the CPU: 20% for the rpicam-vid command, and 20% for the ffmpeg command.

lolorc · 2023-03-26T21:17:42Z

lolorc
Mar 26, 2023

https://github.com/aler9/rtsp-simple-server now supports raspberry cam with libcamera, it's very straight forward and works very well.

0 replies

denics · 2023-11-20T21:06:14Z

denics
Nov 20, 2023

I am quite happy using this:

libcamera-vid -t 0 --inline --height 972 --width 1296 --framerate 10 --nopreview --codec mjpeg --profile high --intra 5 --listen -o tcp://0.0.0.0:8494

with the rpi camera for my octoprint setup

4 replies

jsammarco Jan 7, 2024

This doesn't work on the Raspberry Pi 5. It starts with no error then when you connect you get this error:

pi@pi5:~ $ libcamera-vid -t 0 --inline --height 972 --width 1296 --framerate 10 --nopreview --codec mjpeg --profile high --intra 5 --listen -o tcp://0.0.0.0:8494
[1:15:04.597898970] [2379] INFO Camera camera_manager.cpp:284 libcamera v0.1.0+118-563cd78e
[1:15:04.611728202] [2385] INFO RPI pisp.cpp:653 libpisp version v1.0.2 fa44a258644a 22-11-2023 (21:59:22)
[1:15:04.629516079] [2385] INFO RPI pisp.cpp:1112 Registered camera /base/axi/pcie@120000/rp1/i2c@80000/imx219@10 to CFE device /dev/media1 and ISP device /dev/media0 using PiSP variant BCM2712_C0
[1:15:44.005221692] [2379] WARN V4L2 v4l2_pixelformat.cpp:338 Unsupported V4L2 pixel format Y16
[1:15:44.005270100] [2379] WARN V4L2 v4l2_pixelformat.cpp:338 Unsupported V4L2 pixel format RGB6
[1:15:44.005282360] [2379] WARN V4L2 v4l2_pixelformat.cpp:338 Unsupported V4L2 pixel format BGR6
[1:15:44.005295971] [2379] WARN V4L2 v4l2_pixelformat.cpp:338 Unsupported V4L2 pixel format PC1M
Mode selection for 1296:972:12:P(10)
SRGGB10_CSI2P,640x480/206.654 - Score: 3296
SRGGB10_CSI2P,1640x1232/41.8515 - Score: 1157.49
SRGGB10_CSI2P,1920x1080/47.5737 - Score: 1349.67
SRGGB10_CSI2P,3280x2464/21.1941 - Score: 1875.49
SRGGB8,640x480/206.654 - Score: 4296
SRGGB8,1640x1232/83.703 - Score: 2157.49
SRGGB8,1920x1080/47.5737 - Score: 2349.67
SRGGB8,3280x2464/21.1941 - Score: 2875.49
Stream configuration adjusted
[1:15:44.006103459] [2379] INFO Camera camera.cpp:1183 configuring streams: (0) 1296x972-YUV420 (1) 1640x1232-BGGR16_PISP_COMP1
[1:15:44.006250683] [2385] INFO RPI pisp.cpp:1396 Sensor: /base/axi/pcie@120000/rp1/i2c@80000/imx219@10 - Selected sensor format: 1640x1232-SBGGR10_1X10 - Selected CFE format: 1640x1232-PC1B
terminate called after throwing an instance of 'std::runtime_error'
what(): failed to send data on socket

jsammarco Jan 20, 2024

That doesn't work for my on my RasPi 5.
I got a little closer with this command. I can now stream but only at 640x480 max
rpicam-vid --camera 0 --mode 2304:1296 --framerate 15 --hdr --timeout 0 --nopreview --codec h264 --libav-video-codec h264 --libav-format h264 --inline -o - | ffmpeg -i - -f mjpeg tcp://192.168.1.104:5000?listen

Any suggestions? For a Pi 5?

JohnMcLear Jan 20, 2024

What URI are you using for the Network Stream in VLC? I tried tcp://10.0.0.156:5000?listen h264/tcp and rtsp prefixes but no dice. IP address is correct and I can connect to the TCP port using telnet 10.0.0.156 5000

SOLVED: Correct URI is tcp://10.0.0.156:5000

JohnMcLear Jan 20, 2024

I can confirm this works at 640x480, I tried various input formats and no dice.

jsammarco · 2024-01-20T15:09:24Z

jsammarco
Jan 20, 2024

Damn. Well we're close. We need someone smarter to help us?!?!

…

On Sat, Jan 20, 2024 at 5:20 AM John McLear ***@***.***> wrote: I can confirm this works at 640x480, I tried various input formats and no dice. — Reply to this email directly, view it on GitHub <#3097 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABM4UPGQRLUFTZCSHHLLDPLYPOSAJAVCNFSM5TKFKWP2U5DIOJSWCZC7NNSXTOKENFZWG5LTONUW63SDN5WW2ZLOOQ5TQMJYHE3DGNY> . You are receiving this because you commented.Message ID: ***@***.*** com>

0 replies

td010 · 2024-01-26T08:04:52Z

td010
Jan 26, 2024

libcamera-vid -t 0 --inline --listen -o tcp://0.0.0.0:8888 for rasp 5 libcamera is the only option now.... try this .

2 replies

JohnMcLear Jan 27, 2024

libcamera-vid -t 0 --inline --listen -o tcp://0.0.0.0:8888 returns

pi@raspberrypi:~ $ libcamera-vid -t 0 --inline --listen -o tcp://0.0.0.0:8888 
[0:00:51.257537677] [2064]  INFO Camera camera_manager.cpp:284 libcamera v0.1.0+118-563cd78e
[0:00:51.271346945] [2067]  INFO RPI pisp.cpp:653 libpisp version v1.0.2 fa44a258644a 22-11-2023 (21:59:22)
[0:00:51.288851649] [2067]  INFO RPI pisp.cpp:1112 Registered camera /base/axi/pcie@120000/rp1/i2c@80000/ov5647@36 to CFE device /dev/media1 and ISP device /dev/media2 using PiSP variant BCM2712_C0
Preview window unavailable
[0:00:55.569059339] [2064]  WARN V4L2 v4l2_pixelformat.cpp:338 Unsupported V4L2 pixel format Y16 
[0:00:55.569089856] [2064]  WARN V4L2 v4l2_pixelformat.cpp:338 Unsupported V4L2 pixel format RGB6
[0:00:55.569122862] [2064]  WARN V4L2 v4l2_pixelformat.cpp:338 Unsupported V4L2 pixel format BGR6
[0:00:55.569166622] [2064]  WARN V4L2 v4l2_pixelformat.cpp:338 Unsupported V4L2 pixel format PC1M
Mode selection for 640:480:12:P
    SGBRG10_CSI2P,640x480/0 - Score: 1000
    SGBRG10_CSI2P,1296x972/0 - Score: 1287
    SGBRG10_CSI2P,1920x1080/0 - Score: 1636.67
    SGBRG10_CSI2P,2592x1944/0 - Score: 1854
Stream configuration adjusted
[0:00:55.569638980] [2064]  INFO Camera camera.cpp:1183 configuring streams: (0) 640x480-YUV420 (1) 640x480-GBRG16_PISP_COMP1
[0:00:55.569762275] [2067]  INFO RPI pisp.cpp:1396 Sensor: /base/axi/pcie@120000/rp1/i2c@80000/ov5647@36 - Selected sensor format: 640x480-SGBRG10_1X10 - Selected CFE format: 640x480-PC1g
[NULL @ 0x5555d70b7cd0] Unable to find a suitable output format for 'tcp://0.0.0.0:8888'
ERROR: *** libav: cannot allocate output context ***

Details at https://forums.raspberrypi.com/viewtopic.php?t=360020

glossyio Jan 29, 2024

Note libcamera-vid has been renamed rpicam-vid. Source: https://forums.raspberrypi.com/viewtopic.php?t=359569

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

How to use libcamera-vid to stream rtsp on raspberry pi? #3097

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 6 comments 14 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

Select a reply

How to use libcamera-vid to stream rtsp on raspberry pi? #3097

Replies: 6 comments · 14 replies

renarena Apr 13, 2022 Author

renarena Apr 15, 2022 Author

Does work

Does not work

renarena Jan 3, 2023 Author

Replies: 6 comments 14 replies

renarena Apr 13, 2022
Author

renarena
Apr 15, 2022
Author

renarena Jan 3, 2023
Author