[HW Accel Support]: Crash the hole Proxmox server with Hardware Acceleration

[Lip90]

Describe the problem you are having

I use Frigate on a Proxmox LXC under docker. As soon as I enable hardware acceleration. Crashed the whole system and proxmox and all vm and lxc are restarted. The problem only occurs with frigate. In Jellyfin on the same lcx container the hardware acceleration works without problems. This is generally the first time an LXC container has crashed my entire server.

Does anyone have an idea what the problem could be. I have googled a lot but found nothing.

Version

0.13.2-6476F8A

Frigate config file

mqtt:
  enabled: False

#ffmpeg:
#  hwaccel_args: preset-vaapi

cameras:
  Eingang:
    ffmpeg:
      hwaccel_args: preset-vaapi
      inputs:
        - path: rtsp://127.0.0.1:8554/Eingang
          input_args: preset-rtsp-restream
          roles:
            - record

go2rtc:
  streams:
    #Eingang: onvif://homeassistant:9Q2PdmNeY4Tmj5b8@192.168.2.70:8000
    Eingang: rtsp://homeassistant:9Q2PdmNeY4Tmj5b8@192.168.2.70:554/h264Preview_01_main

docker-compose file or Docker CLI command

version: "3.9"
services:
  frigate:
    container_name: frigate
    privileged: true # this may not be necessary for all setups
    #restart: unless-stopped
    image: ghcr.io/blakeblackshear/frigate:stable
    shm_size: "128mb" # update for your cameras based on calculation above
    devices:
#      - /dev/bus/usb:/dev/bus/usb  # Passes the USB Coral, needs to be modified for other versions
#      - /dev/apex_0:/dev/apex_0    # Passes a PCIe Coral, follow driver instructions here https://coral.ai/docs/m2/get-started/#2a-on-linux
#      - /dev/video11:/dev/video11  # For Raspberry Pi 4B
      - /dev/dri/renderD128:/dev/dri/renderD128 # For intel hwaccel, needs to be updated for your hardware
#      - /dev/dri/card1:/dev/dri/card1
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - /opt/frigate:/config
      - /nfs/frigate:/media/frigate
      - type: tmpfs # Optional: 1GB of memory, reduces SSD/SD Card wear
        target: /tmp/cache
        tmpfs:
          size: 1000000000
    ports:
      - "5000:5000"
      - "8554:8554" # RTSP feeds
      - "8555:8555/tcp" # WebRTC over tcp
      - "8555:8555/udp" # WebRTC over udp
    environment:
      FRIGATE_RTSP_PASSWORD: "hanspetersepp"
      LIBVA_DRIVER_NAME: radeonsi

Relevant log output

Can't see a log because of the direkt crash.

FFprobe output from your camera

# ffprobe rtsp://homeassistant:9Q2PdmNeY4Tmj5b8@192.168.2.70:554/h264Preview_01_main
ffprobe version n5.1-2-g915ef932a3-20220731 Copyright (c) 2007-2022 the FFmpeg developers
  built with gcc 12.1.0 (crosstool-NG 1.25.0.55_3defb7b)
  configuration: --prefix=/ffbuild/prefix --pkg-config-flags=--static --pkg-config=pkg-config --cross-prefix=x86_64-ffbuild-linux-gnu- --arch=x86_64 --target-os=linux --enable-gpl --enable-version3 --disable-debug --enable-iconv --enable-libxml2 --enable-zlib --enable-libfreetype --enable-libfribidi --enable-gmp --enable-lzma --enable-fontconfig --enable-libvorbis --enable-opencl --enable-libpulse --enable-libvmaf --enable-libxcb --enable-xlib --enable-amf --enable-libaom --enable-libaribb24 --enable-avisynth --enable-libdav1d --enable-libdavs2 --disable-libfdk-aac --enable-ffnvcodec --enable-cuda-llvm --enable-frei0r --enable-libgme --enable-libass --enable-libbluray --enable-libjxl --enable-libmp3lame --enable-libopus --enable-mbedtls --enable-librist --enable-libtheora --enable-libvpx --enable-libwebp --enable-lv2 --enable-libmfx --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopenmpt --enable-librav1e --enable-librubberband --disable-schannel --enable-sdl2 --enable-libsoxr --enable-libsrt --enable-libsvtav1 --enable-libtwolame --enable-libuavs3d --enable-libdrm --enable-vaapi --enable-libvidstab --enable-vulkan --enable-libshaderc --enable-libplacebo --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxvid --enable-libzimg --enable-libzvbi --extra-cflags=-DLIBTWOLAME_STATIC --extra-cxxflags= --extra-ldflags=-pthread --extra-ldexeflags=-pie --extra-libs='-ldl -lgomp' --extra-version=20220731
  libavutil      57. 28.100 / 57. 28.100
  libavcodec     59. 37.100 / 59. 37.100
  libavformat    59. 27.100 / 59. 27.100
  libavdevice    59.  7.100 / 59.  7.100
  libavfilter     8. 44.100 /  8. 44.100
  libswscale      6.  7.100 /  6.  7.100
  libswresample   4.  7.100 /  4.  7.100
  libpostproc    56.  6.100 / 56.  6.100
Input #0, rtsp, from 'rtsp://homeassistant:9Q2PdmNeY4Tmj5b8@192.168.2.70:554/h264Preview_01_main':
  Metadata:
    title           : Session streamed by "preview"
    comment         : h264Preview_01_main
  Duration: N/A, start: 0.000000, bitrate: N/A
  Stream #0:0: Video: h264 (High), yuv420p(progressive), 2560x1440, 12.50 tbr, 90k tbn
  Stream #0:1: Audio: aac (LC), 16000 Hz, mono, fltp

Operating system

Proxmox

Install method

Docker Compose

Network connection

Mixed

Camera make and model

Reolink RLC-410W

Any other information that may be helpful

No response

[NickM-27]

what is the output of vainfo run from the lxc?

[Lip90]

@NickM-27 Have you got an idea?

[NickM-27]

Nope, maybe something proxmox related which I have no experience with. I run frigate with the same driver and an AMD 5700G and have not had any issues

[Lip90]

root@debian-docker:~# vainfo
error: XDG_RUNTIME_DIR is invalid or not set in the environment.
error: can't connect to X server!
libva info: VA-API version 1.17.0
libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/radeonsi_drv_video.so
libva info: Found init function __vaDriverInit_1_17
libva info: va_openDriver() returns 0
vainfo: VA-API version: 1.17 (libva 2.12.0)
vainfo: Driver version: Mesa Gallium driver 22.3.6 for AMD Radeon Graphics (renoir, LLVM 15.0.6, DRM 3.54, 6.5.13-3-pve)
vainfo: Supported profile and entrypoints
VAProfileMPEG2Simple : VAEntrypointVLD
VAProfileMPEG2Main : VAEntrypointVLD
VAProfileVC1Simple : VAEntrypointVLD
VAProfileVC1Main : VAEntrypointVLD
VAProfileVC1Advanced : VAEntrypointVLD
VAProfileH264ConstrainedBaseline: VAEntrypointVLD
VAProfileH264ConstrainedBaseline: VAEntrypointEncSlice
VAProfileH264Main : VAEntrypointVLD
VAProfileH264Main : VAEntrypointEncSlice
VAProfileH264High : VAEntrypointVLD
VAProfileH264High : VAEntrypointEncSlice
VAProfileHEVCMain : VAEntrypointVLD
VAProfileHEVCMain : VAEntrypointEncSlice
VAProfileHEVCMain10 : VAEntrypointVLD
VAProfileHEVCMain10 : VAEntrypointEncSlice
VAProfileJPEGBaseline : VAEntrypointVLD
VAProfileVP9Profile0 : VAEntrypointVLD
VAProfileVP9Profile2 : VAEntrypointVLD
VAProfileNone : VAEntrypointVideoProc

[Lip90]

On a proxmox host or bearmetal?

…

________________________________ Von: Nicolas Mowen ***@***.***> Gesendet: Wednesday, April 10, 2024 5:20:11 PM An: blakeblackshear/frigate ***@***.***> Cc: Philipp Stiastny-Pöhlmann ***@***.***>; Author ***@***.***> Betreff: Re: [blakeblackshear/frigate] [HW Accel Support]: Crash the hole Proxmox server with Hardware Acceleration (Discussion #10782) Nope, maybe something proxmox related which I have no experience with. I run frigate with the same driver and an AMD 5700G and have not had any issues — Reply to this email directly, view it on GitHub<#10782 (reply in thread)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AQKB62DEHHA3M3FBOPB5FFLY4VKCXAVCNFSM6AAAAABFSFRRUCVHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4TANZSHA3DQ>. You are receiving this because you authored the thread.Message ID: ***@***.***>

[NickM-27]

baremetal, like I said I have no experience with proxmox

[ch1988]

Same with my proxmox. Once a week, the whole systems "hangs". No error, nothing - just a freeze.

[kafisc1]

Same here.

[thomas-oprews]

same for me, after 10 min up

[tdashmike]

I haven’t had time to try this but maybe it’s the kernel although the article is talking about vGPU/DKMS kernel issues. My host crashes as well running Frigate in a container on a Ubuntu 24.04 VM.

https://www.derekseaman.com/2023/11/proxmox-ve-8-1-windows-11-vgpu-vt-d-passthrough-with-intel-alder-lake.html