Repository navigation
[Support]: One camera's recording stays stuck ("Unable to keep up…", 2 s segments, DTS/PTS errors) after its upstream stream reconnects, until Frigate is restarted #24972
Describe the problem you are havingAfter a stream interruption on one camera (Wi-Fi drop, access-point change, or an encoder-setting change on the camera), that camera's recording gets stuck and stays stuck until I restart Frigate. Detection and live view recover by themselves; only the record path stays broken. The other cameras are unaffected. While stuck: frigate.record.maintainer WARNING : Unable to keep up with recording segments in cache for doorbell. Keeping the N most recent segments out of N and discarding the rest... every ~5 s (steady ~12 per minute) It never clears by itself (left for 8–20+ min); docker restart frigate fixes it immediately. Seen 5 times since mid-October (doorbell 4×, a wired RLC-843A once after changing its encoder settings — that one logged "Invalid or missing video stream" on every segment instead). Storage and CPU are ruled out: with frigate.record.maintainer: debug the copy from cache to the NFS share took 0.21–0.26 s per 10 s segment, and the other four cameras record normally throughout. Frigate runs at ~23 % CPU. Possible mechanism (my guess, looking for confirmation): the reostream project describes the same symptom in VoltTech21/reostream#19 — after the upstream restarts, the timestamps jump, go2rtc keeps Frigate's recorder attached across the reconnect, and ffmpeg "cuts a segment on every keyframe until it catches up". The doorbell's keyframe interval is 2 s, which matches the 2 s segments. Questions: Is it expected that the record ffmpeg stays attached to the go2rtc restream across an upstream reconnect, and so inherits a timestamp discontinuity? Possibly related (different symptom, same backpressure state): #24943. Version0.18.2 (ghcr.io/blakeblackshear/frigate:stable) What browser(s) are you using?No response Frigate config filemqtt:
enabled: true
host: [MQTT Server IP] # MQTT Server
port: 1883
topic_prefix: frigate
client_id: frigate
user: REDACTED
password: REDACTED
tls:
enabled: true # set this to "true" to access frigate via https in a browser
ffmpeg:
hwaccel_args: preset-intel-qsv-h264
input_args: preset-rtsp-restream
detectors:
ov:
type: openvino
device: GPU
model:
path: /openvino-model/ssdlite_mobilenet_v2.xml
labelmap_path: /openvino-model/coco_91cl_bkgr.txt
width: 300
height: 300
input_pixel_format: bgr
input_tensor: nhwc
detect:
enabled: false
fps: 4
min_initialized: 2
max_disappeared: 20
objects:
track:
- person
- dog
- car
review:
alerts:
enabled: true
labels:
- person
- dog
- car
detections:
enabled: true
labels:
- person
- dog
- car
motion:
enabled: false
threshold: 30
lightning_threshold: 0.8
contour_area: 10
improve_contrast: true
mqtt_off_delay: 30
record:
enabled: false
alerts:
pre_capture: 15
post_capture: 5
retain:
days: 3
mode: motion
detections:
pre_capture: 15
post_capture: 5
retain:
days: 3
mode: motion
snapshots:
enabled: false
timestamp: true
bounding_box: true
retain:
default: 10
objects:
person: 3
quality: 70
go2rtc:
ffmpeg:
bin: ffmpeg
volume: -af "volume=30dB"
streams:
doorbell:
- rtsp://REDACTED@[NVR IP ADDRESS]:554/h264Preview_01_main
doorbell_sub:
- rtsp://REDACTED@[NVR IP ADDRESS]:554/h264Preview_01_sub
nvr-02: # Garage via NVR
- rtsp://REDACTED@[NVR IP ADDRESS]:554/Preview_02_main
nvr-02_sub: # Garage 2 sub via NVR
- rtsp://REDACTED@[NVR IP ADDRESS]:554/Preview_02_sub
nvr-03: # Dog Run via NVR
- rtsp://REDACTED@[NVR IP ADDRESS]:554/Preview_03_main
nvr-03_sub: # Dog Run sub via NVR
- rtsp://REDACTED@[NVR IP ADDRESS]:554/Preview_03_sub
nvr-04: # Back Yard via NVR
- rtsp://REDACTED@[NVR IP ADDRESS]:554/Preview_04_main
nvr-04_sub: # Back Yard sub via NVR
- rtsp://REDACTED@[NVR IP ADDRESS]:554/Preview_04_sub
nvr-05: # North Side via NVR
- rtsp://REDACTED@[NVR IP ADDRESS]:554/Preview_05_main
nvr-05_sub: # North Side sub via NVR
- rtsp://REDACTED@[NVR IP ADDRESS]:554/Preview_05_sub
webrtc:
candidates:
- [FRIGATE IP ADDRESS]:8555 # frigate ip
- stun:8555
cameras:
doorbell:
enabled: true
ui:
order: 1
ffmpeg:
inputs:
- path: rtsp://127.0.0.1:8554/doorbell
roles:
- record
- path: rtsp://127.0.0.1:8554/doorbell_sub
roles:
- detect
detect:
enabled: true
width: 640
height: 480
stationary:
classifier: true
interval: 40
threshold: 40
max_frames:
objects:
car: 200
objects:
filters:
car:
mask:
object_mask_1:
friendly_name: Object Mask 1 (car)
enabled: true
coordinates:
0.418,0.54,0.62,0.534,0.625,0.707,0.408,0.688,0.402,0.576
review:
alerts:
required_zones:
- Entryway
motion:
enabled: true
mask:
motion_mask_1:
friendly_name: Motion Mask 1
enabled: true
coordinates: 0.628,0,1,0,1,0.054,0.628,0.054
threshold: 45
contour_area: 20
improve_contrast: true
record:
enabled: true
snapshots:
enabled: true
zones:
Entryway:
coordinates:
0,0,0.628,0,0.628,0.054,1,0.054,1,0.266,0.722,0.369,0.504,0.366,0.405,0.572,0.408,0.661,0.639,0.71,0.705,0.708,0.926,0.717,0.953,0.665,1,0.665,1,1,0,1
inertia: 3
loitering_time: 0
objects: person
live:
streams:
Main: doorbell
Sub: doorbell_sub
height: 800
nvr-02:
enabled: true
ui:
order: 2
ffmpeg:
inputs:
- path: rtsp://127.0.0.1:8554/nvr-02
roles:
- record
- path: rtsp://127.0.0.1:8554/nvr-02_sub
roles:
- detect
detect:
enabled: true
width: 640
height: 360
stationary:
classifier: true
interval: 40
threshold: 40
max_frames:
objects:
car: 200
review:
alerts:
required_zones: Garage
motion:
enabled: true
mask:
motion_mask_1:
friendly_name: Motion Mask 1
enabled: true
coordinates: 0.63,0.07,0.63,0,1,0,1,0.07
threshold: 65
contour_area: 90
improve_contrast: true
record:
enabled: true
snapshots:
enabled: true
zones:
Garage:
coordinates:
0.069,0.734,0.17,0.471,0.662,0.428,0.651,0.538,0.709,0.629,0.838,0.693
inertia: 3
loitering_time: 0
objects:
- car
- dog
- person
enabled: true
objects:
filters:
car:
mask:
object_mask_1:
friendly_name: Object Mask 1 (car)
enabled: true
coordinates: 0.033,0.741,0.842,0.691,0.97,1,0,1,0,0.81
object_mask_2:
friendly_name: Object Mask 2 (car)
enabled: true
coordinates: 1,0.394,0.998,0.76,0.735,0.626,0.69,0.571,0.739,0.345
live:
streams:
Main: nvr-02
Sub: nvr-02_sub
height: 800
nvr-03:
enabled: true
ui:
order: 4
ffmpeg:
inputs:
- path: rtsp://127.0.0.1:8554/nvr-03
roles:
- record
- path: rtsp://127.0.0.1:8554/nvr-03_sub
roles:
- detect
detect:
enabled: true
width: 640
height: 360
review:
alerts:
required_zones: Dog_Run
motion:
enabled: true
mask:
motion_mask_1:
friendly_name: Motion Mask 1
enabled: true
coordinates: 0.63,0.07,0.63,0,1,0,1,0.07
threshold: 65
contour_area: 90
improve_contrast: true
record:
enabled: true
snapshots:
enabled: true
zones:
Dog_Run:
coordinates:
0.152,0.33,0.231,0.303,0.227,0.07,0.324,0.079,0.325,0.279,1,0.683,1,1,0.203,1
inertia: 3
loitering_time: 0
objects:
- dog
- person
live:
streams:
Main: nvr-03
Sub: nvr-03_sub
height: 800
nvr-04:
enabled: true
ui:
order: 3
ffmpeg:
inputs:
- path: rtsp://127.0.0.1:8554/nvr-04
roles:
- record
- path: rtsp://127.0.0.1:8554/nvr-04_sub
roles:
- detect
detect:
enabled: true
width: 640
height: 360
review:
alerts:
required_zones: Back_Yard
motion:
enabled: true
mask:
motion_mask_1:
friendly_name: Motion Mask 1
enabled: true
coordinates: 0.63,0.07,0.63,0,1,0,1,0.07
threshold: 65
contour_area: 90
improve_contrast: true
record:
enabled: true
snapshots:
enabled: true
zones:
Back_Yard:
coordinates:
0.013,0.116,0.227,0.068,0.324,0.077,0.581,0.074,0.834,0.212,1,0.445,0.778,1,0.141,0.998,0.05,0.503
inertia: 3
loitering_time: 0
objects:
- dog
- person
live:
streams:
Main: nvr-04
Sub: nvr-04_sub
height: 800
nvr-05:
enabled: true
ui:
order: 5
ffmpeg:
inputs:
- path: rtsp://127.0.0.1:8554/nvr-05
roles:
- record
- path: rtsp://127.0.0.1:8554/nvr-05_sub
roles:
- detect
detect:
enabled: true
width: 640
height: 360
review:
alerts:
required_zones: North_Side
motion:
enabled: true
mask:
motion_mask_1:
friendly_name: Motion Mask 1
enabled: true
coordinates: 0.63,0.07,0.63,0,1,0,1,0.07
threshold: 65
contour_area: 90
improve_contrast: true
record:
enabled: true
snapshots:
enabled: true
zones:
North_Side:
coordinates: 0.63,0.07,0.802,0.07,0.767,0.518,0.686,1,0,1,0.412,0.325
inertia: 3
loitering_time: 0
objects:
- dog
- person
live:
streams:
Main: nvr-05
Sub: nvr-05_sub
height: 800
face_recognition:
enabled: false
model_size: small
semantic_search:
enabled: false
model_size: small
lpr:
enabled: false
classification:
bird:
enabled: false
version: 0.18-0Relevant Frigate log output2026-11-12 22:57:30.856853488 [2026-11-12 22:57:30] frigate.video.ffmpeg ERROR : doorbell: Unable to read frames from ffmpeg process.
2026-11-12 22:57:30.857382397 [2026-11-12 22:57:30] frigate.video.ffmpeg ERROR : doorbell: ffmpeg process is not running. exiting capture thread...
2026-11-12 22:57:31.436188569 [2026-11-12 22:57:31] watchdog.doorbell ERROR : Ffmpeg process crashed unexpectedly for doorbell.
2026-11-12 22:57:31.436856163 [2026-11-12 22:57:31] watchdog.doorbell ERROR : The following ffmpeg logs include the last 100 lines prior to exit.
2026-11-12 22:57:31.437367701 [2026-11-12 22:57:31] ffmpeg.doorbell.detect ERROR : libva info: VA-API version 1.22.0
2026-11-12 22:57:31.438019739 [2026-11-12 22:57:31] ffmpeg.doorbell.detect ERROR : libva info: User environment variable requested driver 'iHD'
2026-11-12 22:57:31.438567255 [2026-11-12 22:57:31] ffmpeg.doorbell.detect ERROR : libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so
2026-11-12 22:57:31.439147824 [2026-11-12 22:57:31] ffmpeg.doorbell.detect ERROR : libva info: Found init function __vaDriverInit_1_22
2026-11-12 22:57:31.439626393 [2026-11-12 22:57:31] ffmpeg.doorbell.detect ERROR : libva info: va_openDriver() returns 0
2026-11-12 22:57:31.440436011 [2026-11-12 22:57:31] ffmpeg.doorbell.detect ERROR : [in#0/rtsp @ 0x5c1f756f4600] Failed reading RTSP data: Connection timed out
2026-11-12 22:57:31.441239198 [2026-11-12 22:57:31] ffmpeg.doorbell.detect ERROR : Last message repeated 1 times
2026-11-12 22:57:31.443860568 [2026-11-12 22:57:31] ffmpeg.doorbell.detect ERROR : [in#0/rtsp @ 0x5c1f75425380] Error during demuxing: Connection timed out
2026-11-12 22:57:31.451288726 [2026-11-12 22:57:31] ffmpeg.doorbell.record ERROR : [segment @ 0x6149decf70c0] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2026-11-12 22:57:31.452012353 [2026-11-12 22:57:31] ffmpeg.doorbell.record ERROR : [aac @ 0x6149ded43000] Queue input is backward in time
2026-11-12 22:57:31.453011653 [2026-11-12 22:57:31] ffmpeg.doorbell.record ERROR : Last message repeated 26 times
2026-11-12 22:57:31.454096967 [2026-11-12 22:57:31] ffmpeg.doorbell.record ERROR : [aost#0:1/aac @ 0x6149ded396c0] Non-monotonic DTS; previous: 116597384, current: 116597382; changing to 116597385. This may result in incorrect timestamps in the output file.
2026-11-12 22:57:31.454099996 [2026-11-12 22:57:31] ffmpeg.doorbell.record ERROR : [aac @ 0x6149ded43000] Queue input is backward in time
2026-11-12 22:57:31.454446497 [2026-11-12 22:57:31] ffmpeg.doorbell.record ERROR : Last message repeated 30 times
2026-11-12 22:57:31.454972664 [2026-11-12 22:57:31] ffmpeg.doorbell.record ERROR : [in#0/rtsp @ 0x6149decd6ac0] Failed reading RTSP data: Connection timed out
2026-11-12 22:57:31.455406957 [2026-11-12 22:57:31] ffmpeg.doorbell.record ERROR : Last message repeated 1 times
2026-11-12 22:57:31.455975796 [2026-11-12 22:57:31] ffmpeg.doorbell.record ERROR : [in#0/rtsp @ 0x6149decd67c0] Error during demuxing: Connection timed out
2026-11-12 22:57:38.014676692 22:57:38.014 WRN github.com/AlexxIT/go2rtc/internal/streams/producer.go:170 > error="read tcp 172.19.0.2:52486->NVR_IP:554: i/o timeout" url=rtsp://REDACTED@NVR_IP:554/h264Preview_01_sub
2026-11-12 22:57:38.052018624 22:57:38.051 WRN github.com/AlexxIT/go2rtc/internal/streams/producer.go:170 > error="read tcp 172.19.0.2:52482->NVR_IP:554: i/o timeout" url=rtsp://REDACTED@NVR_IP:554/h264Preview_01_main
2026-11-12 22:57:56.389941175 [2026-11-12 22:57:56] frigate.record.maintainer WARNING : Unable to keep up with recording segments in cache for doorbell. Keeping the 6 most recent segments out of 7 and discarding the rest...
2026-11-12 22:58:01.386786342 [2026-11-12 22:58:01] frigate.record.maintainer WARNING : Unable to keep up with recording segments in cache for doorbell. Keeping the 6 most recent segments out of 9 and discarding the rest...
2026-11-12 22:58:06.384322399 [2026-11-12 22:58:06] frigate.record.maintainer WARNING : Unable to keep up with recording segments in cache for doorbell. Keeping the 6 most recent segments out of 8 and discarding the rest...
2026-11-12 22:58:11.436036217 [2026-11-12 22:58:11] frigate.record.maintainer WARNING : Unable to keep up with recording segments in cache for doorbell. Keeping the 6 most recent segments out of 9 and discarding the rest...
2026-11-12 22:58:16.392790771 [2026-11-12 22:58:16] frigate.record.maintainer WARNING : Unable to keep up with recording segments in cache for doorbell. Keeping the 6 most recent segments out of 8 and discarding the rest...
2026-11-12 22:58:18.500814969 [2026-11-12 22:58:18] frigate.video.ffmpeg ERROR : doorbell: Unable to read frames from ffmpeg process.
2026-11-12 22:58:18.502208773 [2026-11-12 22:58:18] frigate.video.ffmpeg ERROR : doorbell: Unable to read frames from ffmpeg process.
2026-11-12 22:58:18.502432325 [2026-11-12 22:58:18] frigate.video.ffmpeg ERROR : doorbell: Unable to read frames from ffmpeg process.
2026-11-12 22:58:18.502771259 [2026-11-12 22:58:18] frigate.video.ffmpeg ERROR : doorbell: Unable to read frames from ffmpeg process.
2026-11-12 22:58:18.503683311 [2026-11-12 22:58:18] frigate.video.ffmpeg ERROR : doorbell: Unable to read frames from ffmpeg process.
2026-11-12 22:58:18.504129222 [2026-11-12 22:58:18] frigate.video.ffmpeg ERROR : doorbell: Unable to read frames from ffmpeg process.
2026-11-12 22:58:18.504448274 [2026-11-12 22:58:18] frigate.video.ffmpeg ERROR : doorbell: Unable to read frames from ffmpeg process.
2026-11-12 22:58:18.504919058 [2026-11-12 22:58:18] frigate.video.ffmpeg ERROR : doorbell: Unable to read frames from ffmpeg process.
2026-11-12 22:58:18.505329341 [2026-11-12 22:58:18] frigate.video.ffmpeg ERROR : doorbell: ffmpeg process is not running. exiting capture thread...
2026-11-12 22:58:18.506130489 [2026-11-12 22:58:18] watchdog.doorbell ERROR : The following ffmpeg logs include the last 100 lines prior to exit.
2026-11-12 22:58:18.506353165 [2026-11-12 22:58:18] ffmpeg.doorbell.detect ERROR : libva info: VA-API version 1.22.0
2026-11-12 22:58:18.506599736 [2026-11-12 22:58:18] ffmpeg.doorbell.detect ERROR : libva info: User environment variable requested driver 'iHD'
--- message types over the episode (count) ---
81 frigate.record.maintainer WARNING : Unable to keep up with recording segments in cache for doorbell. Keeping the N most recent segments out of N and discarding the rest...
9 frigate.video.ffmpeg ERROR : doorbell: Unable to read frames from ffmpeg process.
3 ffmpeg.doorbell.record ERROR : Last message repeated N times
2 watchdog.doorbell ERROR : The following ffmpeg logs include the last N lines prior to exit.
2 frigate.video.ffmpeg ERROR : doorbell: ffmpeg process is not running. exiting capture thread...
2 ffmpeg.doorbell.record ERROR : [aac @ NxH] Queue input is backward in time
2 ffmpeg.doorbell.detect ERROR : libva info: va_openDriver() returns N
2 ffmpeg.doorbell.detect ERROR : libva info: VA-API version N.N.N
2 ffmpeg.doorbell.detect ERROR : libva info: User environment variable requested driver 'iHD'
2 ffmpeg.doorbell.detect ERROR : libva info: Trying to open /usr/lib/xN_N-linux-gnu/dri/iHD_drv_video.so
2 ffmpeg.doorbell.detect ERROR : libva info: Found init function __vaDriverInit_N_N
1 watchdog.doorbell ERROR : Ffmpeg process crashed unexpectedly for doorbell.
1 ffmpeg.doorbell.record ERROR : [segment @ NxH] Timestamps are unset in a packet for stream N. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
1 ffmpeg.doorbell.record ERROR : [in#N/rtsp @ NxH] Failed reading RTSP data: Connection timed out
1 ffmpeg.doorbell.record ERROR : [in#N/rtsp @ NxH] Error during demuxing: Connection timed out
1 ffmpeg.doorbell.record ERROR : [aost#N:N/aac @ NxH] Non-monotonic DTS; previous: N, current: N; changing to N. This may result in incorrect timestamps in the output file.
1 ffmpeg.doorbell.detect ERROR : [in#N/rtsp @ NxH] RTP: PT=N: bad cseq adcN expected=bNb
1 ffmpeg.doorbell.detect ERROR : [in#N/rtsp @ NxH] RTP: PT=N: bad cseq Nd expected=bN
1 ffmpeg.doorbell.detect ERROR : [in#N/rtsp @ NxH] Failed reading RTSP data: Connection timed out
1 ffmpeg.doorbell.detect ERROR : [in#N/rtsp @ NxH] Error during demuxing: Connection timed outRelevant go2rtc log output2026-11-12 22:57:38.014676692 22:57:38.014 WRN github.com/AlexxIT/go2rtc/internal/streams/producer.go:170 > error="read tcp 172.19.0.2:52486->NVR_IP:554: i/o timeout" url=rtsp://REDACTED@NVR_IP:554/h264Preview_01_sub
2026-11-12 22:57:38.052018624 22:57:38.051 WRN github.com/AlexxIT/go2rtc/internal/streams/producer.go:170 > error="read tcp 172.19.0.2:52482->NVR_IP:554: i/o timeout" url=rtsp://REDACTED@NVR_IP:554/h264Preview_01_main
2026-11-12 23:04:54.330742645 23:04:54.330 INF go2rtc platform=linux/amd64 revision=b5948cf version=1.9.14
2026-11-12 23:04:54.330763900 23:04:54.330 INF config path=/config/go2rtc_homekit.yml
2026-11-12 23:04:54.331645573 23:04:54.331 INF [api] listen addr=:1984
2026-11-12 23:04:54.331800035 23:04:54.331 INF [rtsp] listen addr=:8554
2026-11-12 23:04:54.332205833 23:04:54.332 INF [webrtc] listen tcp addr=[::]:8555
2026-11-12 23:04:54.332344295 23:04:54.332 INF [webrtc] listen udp addr=172.19.0.2:8555
2026-11-12 23:10:09.537421249 23:10:09.537 WRN github.com/AlexxIT/go2rtc/internal/streams/producer.go:170 > error="read tcp 172.19.0.2:48670->NVR_IP:554: i/o timeout" url=rtsp://REDACTED@NVR_IP:554/h264Preview_01_sub
2026-11-12 23:10:09.583757530 23:10:09.583 WRN github.com/AlexxIT/go2rtc/internal/streams/producer.go:170 > error="read tcp 172.19.0.2:48666->NVR_IP:554: i/o timeout" url=rtsp://REDACTED@NVR_IP:554/h264Preview_01_main
2026-11-12 23:13:40.769125851 23:13:40.768 INF go2rtc platform=linux/amd64 revision=b5948cf version=1.9.14
2026-11-12 23:13:40.769149350 23:13:40.769 INF config path=/config/go2rtc_homekit.yml
2026-11-12 23:13:40.769862912 23:13:40.769 INF [api] listen addr=:1984
2026-11-12 23:13:40.770055004 23:13:40.770 INF [rtsp] listen addr=:8554
2026-11-12 23:13:40.770416536 23:13:40.770 INF [webrtc] listen tcp addr=[::]:8555
2026-11-12 23:13:40.770648024 23:13:40.770 INF [webrtc] listen udp addr=172.19.0.2:8555FFprobe output from your camera=== doorbell ===
Input #0, rtsp, from 'rtsp://127.0.0.1:8554/doorbell':
Metadata:
title : go2rtc/1.9.14
Duration: N/A, start: 0.000000, bitrate: N/A
Stream #0:0: Video: h264 (High), yuv420p(progressive), 2560x1920, 25 fps, 25 tbr, 90k tbn
Stream #0:1: Audio: aac (LC), 16000 Hz, mono, fltp
codec_name=h264
profile=High
codec_type=video
width=2560
height=1920
r_frame_rate=25/1
avg_frame_rate=25/1
time_base=1/90000
codec_name=aac
profile=LC
codec_type=audio
sample_rate=16000
channels=1
r_frame_rate=0/0
avg_frame_rate=0/0
time_base=1/16000
=== doorbell_sub ===
Input #0, rtsp, from 'rtsp://127.0.0.1:8554/doorbell_sub':
Metadata:
title : go2rtc/1.9.14
Duration: N/A, start: 0.000000, bitrate: N/A
Stream #0:0: Video: h264 (High), yuv420p(progressive), 640x480, 25 fps, 25 tbr, 90k tbn
Stream #0:1: Audio: aac (LC), 16000 Hz, mono, fltp
codec_name=h264
profile=High
codec_type=video
width=640
height=480
r_frame_rate=25/1
avg_frame_rate=25/1
time_base=1/90000
codec_name=aac
profile=LC
codec_type=audio
sample_rate=16000
channels=1
r_frame_rate=0/0
avg_frame_rate=0/0
time_base=1/16000Frigate statsCurrent stats (healthy state); the problem isn’t happening at the moment...
{
"cameras": {
"doorbell": {
"camera_fps": 4.0,
"process_fps": 4.0,
"skipped_fps": 0.0,
"detection_fps": 0.0,
"detection_enabled": true,
"pid": 886,
"capture_pid": 951,
"ffmpeg_pid": 1096204,
"audio_rms": 0,
"audio_dBFS": 0,
"connection_quality": "excellent",
"expected_fps": 4,
"reconnects_last_hour": 0,
"stalls_last_hour": 0,
"ffmpeg_cpu": "1.1",
"capture_cpu": "0.7",
"detect_cpu": "1.3"
},
"nvr-02": {
"camera_fps": 4.0,
"process_fps": 4.0,
"skipped_fps": 0.0,
"detection_fps": 4.0,
"detection_enabled": true,
"pid": 1039,
"capture_pid": 1156,
"ffmpeg_pid": 1096375,
"audio_rms": 0,
"audio_dBFS": 0,
"connection_quality": "excellent",
"expected_fps": 4,
"reconnects_last_hour": 0,
"stalls_last_hour": 0,
"ffmpeg_cpu": "0.8",
"capture_cpu": "0.7",
"detect_cpu": "7.6"
},
"nvr-03": {
"camera_fps": 4.0,
"process_fps": 4.0,
"skipped_fps": 0.0,
"detection_fps": 0.0,
"detection_enabled": true,
"pid": 1231,
"capture_pid": 1305,
"ffmpeg_pid": 1096277,
"audio_rms": 0,
"audio_dBFS": 0,
"connection_quality": "excellent",
"expected_fps": 4,
"reconnects_last_hour": 0,
"stalls_last_hour": 0,
"ffmpeg_cpu": "0.8",
"capture_cpu": "0.6",
"detect_cpu": "1.4"
},
"nvr-04": {
"camera_fps": 4.0,
"process_fps": 4.0,
"skipped_fps": 0.0,
"detection_fps": 0.0,
"detection_enabled": true,
"pid": 1385,
"capture_pid": 1456,
"ffmpeg_pid": 1096404,
"audio_rms": 0,
"audio_dBFS": 0,
"connection_quality": "excellent",
"expected_fps": 4,
"reconnects_last_hour": 0,
"stalls_last_hour": 0,
"ffmpeg_cpu": "0.9",
"capture_cpu": "0.6",
"detect_cpu": "1.2"
},
"nvr-05": {
"camera_fps": 4.1,
"process_fps": 4.0,
"skipped_fps": 0.0,
"detection_fps": 0.0,
"detection_enabled": true,
"pid": 1530,
"capture_pid": 1605,
"ffmpeg_pid": 1096219,
"audio_rms": 0,
"audio_dBFS": 0,
"connection_quality": "excellent",
"expected_fps": 4,
"reconnects_last_hour": 0,
"stalls_last_hour": 0,
"ffmpeg_cpu": "0.9",
"capture_cpu": "0.6",
"detect_cpu": "1.5"
}
},
"detectors": {
"ov": {
"inference_speed": 10.14,
"detection_start": 0.0,
"pid": 814,
"cpu": "1.9",
"mem": "0.4"
}
},
"camera_fps": 20.0,
"process_fps": 20.0,
"skipped_fps": 0.0,
"detection_fps": 4.0,
"embeddings": {},
"gpu_usages": {
"Core i5-9500T CPU @ 2.20GHz iGPU": {
"vendor": "intel",
"gpu": "3.02%",
"mem": "-%",
"compute": "2.39%",
"dec": "0.63%",
"clients": {
"137": "0.0%",
"814": "2.39%",
"1096204": "0.19%",
"1096219": "0.14%",
"1096277": "0.1%",
"1096375": "0.14%",
"1096404": "0.06%"
}
}
},
"cpu_usages": {
"frigate.full_system": {
"cpu": "25.7",
"mem": "70.9"
},
"28": {
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0",
"cmdline": "s6-supervise go2rtc-log"
},
"30": {
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0",
"cmdline": "s6-supervise go2rtc"
},
"36": {
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0",
"cmdline": "s6-supervise go2rtc-healthcheck"
},
"98": {
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0",
"cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/go2rtc"
},
"128": {
"cpu": "11.9",
"cpu_average": "12",
"mem": "0.1",
"cmdline": "/usr/local/go2rtc/bin/go2rtc -config=/config/go2rtc_homekit.yml -config=/dev/shm/go2rtc.yaml"
},
"136": {
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0",
"cmdline": "bash ./run.user go2rtc-healthcheck"
},
"137": {
"cpu": "5.2",
"cpu_average": "4",
"mem": "1.0",
"cmdline": "python3 -u -m frigate"
},
"386": {
"cpu": "2.4",
"cpu_average": "2",
"mem": "0.2",
"cmdline": "python3 -u -m frigate"
},
"392": {
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0",
"cmdline": "/usr/bin/python3 -Wignore:::numpy.core.getlimits -c from multiprocessing.resource_tracker import main;main(4)"
},
"729": {
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.1",
"cmdline": "/usr/bin/python3 -Wignore:::numpy.core.getlimits -c from multiprocessing.forkserver import main; main(27, 28, ['sqlite3', 'numpy', 'cv2', 'peewee', 'zmq', 'ruamel.yaml', 'frigate.camera.maintainer'], **{'sys_path': ['/opt/frigate', '/usr/lib/python311.zip', '/usr/lib/python3.11', '/usr/lib/python3.11/lib-dynload', '/usr/local/lib/python3.11/dist-packages', '/usr/lib/python3/dist-packages']})"
},
"743": {
"cpu": "8.4",
"cpu_average": "6",
"mem": "0.4",
"cmdline": "frigate.recording_manager"
},
"755": {
"cpu": "0.7",
"cpu_average": "0",
"mem": "0.2",
"cmdline": "frigate.review_segment_manager"
},
"766": {
"cpu": "1.2",
"cpu_average": "1",
"mem": "0.2",
"cmdline": "frigate.embeddings_manager"
},
"814": {
"cpu": "1.9",
"cpu_average": "0",
"mem": "0.4",
"cmdline": "frigate.detector:ov"
},
"834": {
"cpu": "1.5",
"cpu_average": "1",
"mem": "0.3",
"cmdline": "frigate.output"
},
"862": {
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.2",
"cmdline": "frigate.audio_manager"
},
"886": {
"cpu": "1.3",
"cpu_average": "2",
"mem": "0.3",
"cmdline": "frigate.process:doorbell"
},
"951": {
"cpu": "0.7",
"cpu_average": "0",
"mem": "0.2",
"cmdline": "frigate.capture:doorbell"
},
"1039": {
"cpu": "7.6",
"cpu_average": "2",
"mem": "0.5",
"cmdline": "frigate.process:nvr-02"
},
"1084": {
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 640x480 -i pipe: -threads 1 -f mpegts -s 1066x800 -codec:v mpeg1video -q 8 -bf 0 pipe:"
},
"1089": {
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 640x360 -i pipe: -threads 1 -f mpegts -s 1422x800 -codec:v mpeg1video -q 8 -bf 0 pipe:"
},
"1094": {
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 640x360 -i pipe: -threads 1 -f mpegts -s 1422x800 -codec:v mpeg1video -q 8 -bf 0 pipe:"
},
"1099": {
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 640x360 -i pipe: -threads 1 -f mpegts -s 1422x800 -codec:v mpeg1video -q 8 -bf 0 pipe:"
},
"1105": {
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 640x360 -i pipe: -threads 1 -f mpegts -s 1422x800 -codec:v mpeg1video -q 8 -bf 0 pipe:"
},
"1114": {
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.1",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:"
},
"1156": {
"cpu": "0.7",
"cpu_average": "0",
"mem": "0.2",
"cmdline": "frigate.capture:nvr-02"
},
"1231": {
"cpu": "1.4",
"cpu_average": "1",
"mem": "0.2",
"cmdline": "frigate.process:nvr-03"
},
"1305": {
"cpu": "0.6",
"cpu_average": "0",
"mem": "0.2",
"cmdline": "frigate.capture:nvr-03"
},
"1385": {
"cpu": "1.2",
"cpu_average": "1",
"mem": "0.2",
"cmdline": "frigate.process:nvr-04"
},
"1456": {
"cpu": "0.6",
"cpu_average": "0",
"mem": "0.2",
"cmdline": "frigate.capture:nvr-04"
},
"1530": {
"cpu": "1.5",
"cpu_average": "1",
"mem": "0.2",
"cmdline": "frigate.process:nvr-05"
},
"1605": {
"cpu": "0.6",
"cpu_average": "0",
"mem": "0.2",
"cmdline": "frigate.capture:nvr-05"
},
"1096199": {
"cpu": "5.3",
"cpu_average": "6",
"mem": "0.1",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.18.2-cfa08c5 -rtsp_transport tcp -timeout 10000000 -i rtsp://127.0.0.1:8554/nvr-04 -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/nvr-04@%Y%m%d%H%M%S%z.mp4"
},
"1096200": {
"cpu": "1.4",
"cpu_average": "1",
"mem": "0.1",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.18.2-cfa08c5 -rtsp_transport tcp -timeout 10000000 -i rtsp://127.0.0.1:8554/nvr-02 -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/nvr-02@%Y%m%d%H%M%S%z.mp4"
},
"1096201": {
"cpu": "5.8",
"cpu_average": "5",
"mem": "0.1",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.18.2-cfa08c5 -rtsp_transport tcp -timeout 10000000 -i rtsp://127.0.0.1:8554/doorbell -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/doorbell@%Y%m%d%H%M%S%z.mp4"
},
"1096202": {
"cpu": "5.8",
"cpu_average": "6",
"mem": "0.1",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.18.2-cfa08c5 -rtsp_transport tcp -timeout 10000000 -i rtsp://127.0.0.1:8554/nvr-05 -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/nvr-05@%Y%m%d%H%M%S%z.mp4"
},
"1096203": {
"cpu": "5.3",
"cpu_average": "5",
"mem": "0.1",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.18.2-cfa08c5 -rtsp_transport tcp -timeout 10000000 -i rtsp://127.0.0.1:8554/nvr-03 -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/nvr-03@%Y%m%d%H%M%S%z.mp4"
},
"1096204": {
"cpu": "1.1",
"cpu_average": "1",
"mem": "0.2",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel qsv -qsv_device /dev/dri/renderD128 -hwaccel_output_format qsv -c:v h264_qsv -bsf:v dump_extra -user_agent FFmpeg Frigate/0.18.2-cfa08c5 -rtsp_transport tcp -timeout 10000000 -i rtsp://127.0.0.1:8554/doorbell_sub -r 4 -vf fps=4,vpp_qsv=w=640:h=480:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:"
},
"1096219": {
"cpu": "0.9",
"cpu_average": "0",
"mem": "0.2",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel qsv -qsv_device /dev/dri/renderD128 -hwaccel_output_format qsv -c:v h264_qsv -bsf:v dump_extra -user_agent FFmpeg Frigate/0.18.2-cfa08c5 -rtsp_transport tcp -timeout 10000000 -i rtsp://127.0.0.1:8554/nvr-05_sub -r 4 -vf fps=4,vpp_qsv=w=640:h=360:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:"
},
"1096277": {
"cpu": "0.8",
"cpu_average": "0",
"mem": "0.2",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel qsv -qsv_device /dev/dri/renderD128 -hwaccel_output_format qsv -c:v h264_qsv -bsf:v dump_extra -user_agent FFmpeg Frigate/0.18.2-cfa08c5 -rtsp_transport tcp -timeout 10000000 -i rtsp://127.0.0.1:8554/nvr-03_sub -r 4 -vf fps=4,vpp_qsv=w=640:h=360:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:"
},
"1096375": {
"cpu": "0.8",
"cpu_average": "0",
"mem": "0.2",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel qsv -qsv_device /dev/dri/renderD128 -hwaccel_output_format qsv -c:v h264_qsv -bsf:v dump_extra -user_agent FFmpeg Frigate/0.18.2-cfa08c5 -rtsp_transport tcp -timeout 10000000 -i rtsp://127.0.0.1:8554/nvr-02_sub -r 4 -vf fps=4,vpp_qsv=w=640:h=360:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:"
},
"1096404": {
"cpu": "0.9",
"cpu_average": "0",
"mem": "0.2",
"cmdline": "/usr/lib/ffmpeg/8.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel qsv -qsv_device /dev/dri/renderD128 -hwaccel_output_format qsv -c:v h264_qsv -bsf:v dump_extra -user_agent FFmpeg Frigate/0.18.2-cfa08c5 -rtsp_transport tcp -timeout 10000000 -i rtsp://127.0.0.1:8554/nvr-04_sub -r 4 -vf fps=4,vpp_qsv=w=640:h=360:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:"
}
},
"service": {
"uptime": 133137,
"version": "0.18.2-cfa08c5",
"latest_version": "0.18.2",
"storage": {
"/media/frigate/recordings": {
"total": 14639193.6,
"used": 2848239.2,
"free": 11790954.4,
"mount_type": "nfs4"
},
"/media/frigate/clips": {
"total": 14639193.6,
"used": 2848239.2,
"free": 11790954.4,
"mount_type": "nfs4"
},
"/tmp/cache": {
"total": 953.7,
"used": 63.5,
"free": 890.1,
"mount_type": "tmpfs"
},
"/dev/shm": {
"total": 512.0,
"used": 99.8,
"free": 412.2,
"mount_type": "tmpfs",
"available": 462.0,
"camera_frame_size": 6.300000000000001,
"shm_frame_count": 50,
"min_shm": 176
}
},
"last_updated": 1794679961
},
"processes": {
"recording": {
"pid": 743,
"cpu": "8.4",
"mem": "0.4"
},
"review_segment": {
"pid": 755,
"cpu": "0.7",
"mem": "0.2"
},
"go2rtc": {
"pid": 128,
"cpu": "11.9",
"mem": "0.1"
},
"embeddings": {
"pid": 766,
"cpu": "1.2",
"mem": "0.2"
},
"audio_detector": {
"pid": 862,
"cpu": "0.0",
"mem": "0.2"
}
}
}Install methodProxmox via Docker docker-compose file or Docker CLI commandservices:
frigate:
container_name: frigate
privileged: true # this may not be necessary for all setups
restart: unless-stopped
stop_grace_period: 30s
image: ghcr.io/blakeblackshear/frigate:stable
shm_size: "512mb" # update for your cameras based on calculation above
devices:
- /dev/dri/renderD128:/dev/dri/renderD128
- /dev/dri/card1:/dev/dri/card0
volumes:
- /etc/localtime:/etc/localtime:ro
- /home/REDACTED/docker/frigate/config:/config
- /home/REDACTED/docker/frigate/storage:/media/frigate
- type: tmpfs # Optional: 1GB of memory, reduces SSD/SD Card wear
target: /tmp/cache
tmpfs:
size: 1000000000
ports:
- "9154:5000" # http access on port 9154
- "8554:8554" # RTSP feeds
- "8555:8555/tcp" # WebRTC over tcp
- "8555:8555/udp" # WebRTC over udp
- "8971:8971" # http access on port 8971
- "1984:1984" # go2rtc
environment:
LIBVA_DRIVER_NAME: iHD
FRIGATE_RTSP_PASSWORD: "REDACTED"
TZ: America/Edmonton
logging:
driver: json-file
options:
max-size: "20m"
max-file: "5"
cap_add:
- PERFMONObject DetectorOpenVino Network connectionMixed Camera make and modelReolink Video Doorbell WiFi (affected; fw v3.0.0.7106) via Reolink RLN8-410 NVR (fw v3.6.5.562). Others via the same NVR: 3× RLC-843A, 1× RLC-823S1 (unaffected, except one RLC-843A once after an encoder change). Screenshots of the Frigate UI's System metrics pagesNote: the system is currently healthy, an active incident is not happening...
Any other information that may be helpfulEpisodes so far (all cleared only by
In each case only that camera's record path was stuck; detect and live view recovered, and the other cameras on the same NVR and go2rtc kept recording normally. go2rtc did not crash or restart (go2rtc log above). Workaround for now: a cron script that detects one camera logging "Unable to keep up..." in 8 of 10 minutes and runs Closest match I found: VoltTech21/reostream#19 (timestamp jump after the upstream reconnects; recorder stays attached through go2rtc and cuts a segment at every keyframe until Frigate restarts). Possibly related backpressure issue: #24943 (that camera also had audio going through the AAC re-encode; the doorbell also has audio). |
Replies: 3 comments 3 replies
|
I can't confirm the specific behavior you're asking about — whether the record ffmpeg stays attached to the go2rtc restream across an upstream reconnect and inherits the timestamp discontinuity — and I can't confirm whether this is a bug. That internal detail isn't something I can verify. What I can speak to is the symptom pattern you're seeing, which is documented. On the timestamp errors and short segments: On the audio side specifically: your Routing the stream through go2rtc's You can also drop audio from the recording entirely with a preset: On the "Invalid or missing video stream" episode (nvr-03 after the encoder change): that variant is caused by broken camera timestamps, including "Smart Codec" / H.264+ modes.(1) An encoding-parameter change mid-stream produces exactly that.(2) Worth confirming no smart codec mode is enabled on that camera and that its keyframe interval equals its frame rate.(2) On the WiFi doorbell: every episode you list started with a link or encoder disruption. WiFi cameras, powerline adapters, a saturated uplink, a failing switch port, or a marginal cable all produce this pattern, and usually only on one camera at a time.(2) In general, WiFi cameras are not recommended.(1) For the part I can't answer — recorder reattachment semantics across a reconnect and whether a self-recovery path should exist — raise it on GitHub. Useful references meanwhile: Recordings Errors, Common Error Messages, go2rtc troubleshooting. I can give you a general, non-documentation-based answer on the reconnect behavior if that would help. 📚 Sources: Have another question? Just tag @inkeep. |
|
You could try pointing the record input straight at your NVR ( |
|
Update: tested the suggestion (thanks). 17:41 - changed only the doorbell's record input from the go2rtc restream to the NVR directly: ~18:13 - rebooted the doorbell from the Reolink app to force a reconnect. Result:
So from the same disruption, the camera recording directly recovered and the one recording via the restream did not. That fits the idea that the record ffmpeg stays attached to go2rtc across the upstream reconnect and never resets. I've reverted to the documented restream setup for now. Is this a known limitation, or worth opening an issue? Is there a supported way to have the record process reset when the restream's source reconnects? Happy to provide a redacted log snapshot from the 18:16-18:30 stuck period. |



Right, this is a go2rtc issue: AlexxIT/go2rtc#2404. When go2rtc reconnects to the camera, it moves already connected clients like Frigate's record process onto the new stream without resetting the timestamps, so the recording never recovers. Recording directly from the NVR is the best workaround until that's fixed upstream.