Hikvision AAC Support for 16Beta

[moogoos]

Ive been running G.711ulaw with h265 video encoding on my hikvision cameras fine since maybe version 12 using h265. I've recently upgraded to some g3 cameras and all is good. With the latest release I want to try and get native AAC to work with both live and recording feeds. Live audio works but recordings are still not working. I am changing the following but not sure if im doing this correctly. I'd like to try and maintain h265 if possible but would consider going back to h264.

ffmpeg:
#  hwaccel_args: preset-intel-qsv-h265
  hwaccel_args: preset-vaapi
  output_args:
#    record: preset-record-generic-audio-copy
     record: preset-record-generic-audio-aac

go2rtc:
  rtsp:
    username: xx
    password: xx
  streams:
    street_main:
      - rtsp://xx@xx:8539/Streaming/channels/101
#      - ffmpeg:street_main#audio=aac
    street_sub:
      - rtsp://xx@xxx:8539/Streaming/channels/102
#      - ffmpeg:street_sub#audio=aac

and my camera config:

ffmpeg:
  output_args:
    record: preset-record-generic-audio-aac # Im not sure I still need this arg
  inputs:
    - path: rtsp://127.0.0.1:8554/street_main?video&audio # <--- the name here must match the name of the camera in restream
      input_args: preset-rtsp-restream
      roles:
        - record
    - path: rtsp://127.0.0.1:8554/street_sub?video&audio # <--- the name here must match the name of the camera in restream
      input_args: preset-rtsp-restream
      roles:
        - detect
        - audio

but i get the following error:

2025-08-02 14:28:22.891635316 [2025-08-02 14:28:22] watchdog.street ERROR : No new recording segments were created for street in the last 120s. restarting the ffmpeg record process...
2025-08-02 14:28:22.891746926 [2025-08-02 14:28:22] watchdog.street INFO : Terminating the existing ffmpeg process...
2025-08-02 14:28:22.891875857 [2025-08-02 14:28:22] watchdog.street INFO : Waiting for ffmpeg to exit gracefully...

[inkeep-ai-assistant[bot]]

For Hikvision cameras and AAC audio support in Frigate, here are key points based on the documentation:

1. Audio Codec Compatibility: For best compatibility with both live view and recordings, Frigate recommends using H.264 for video and AAC for audio. H.265 is not supported for WebRTC live view, but can be used for recording if your client supports it(1).

2. Camera RTSP URLs: The format for Hikvision RTSP streams should be:

   rtsp://USERNAME:PASSWORD@CAMERA-IP/streaming/channels/101  # main stream
   rtsp://USERNAME:PASSWORD@CAMERA-IP/streaming/channels/102  # sub stream
   

   Double-check that your camera is outputting AAC audio on the stream you are using(2).

3. FFmpeg Output Args:

   • Use preset-record-generic-audio-aac to transcode audio to AAC in the recordings.
   • If your camera already outputs AAC audio, you can use preset-record-generic-audio-copy to avoid unnecessary transcoding(3).

4. Restream Setup: Ensure your go2rtc and camera names match exactly. If using restream, your input path should be:

   - path: rtsp://127.0.0.1:8554/<camera_name>
     input_args: preset-rtsp-restream
     roles:
       - record
   

   Use the audio role only if you need audio events(4).

5. Hardware Acceleration: For Intel CPUs, preset-vaapi is recommended for both H.264 and H.265 streams. If you have issues with Quicksync, prefer preset-vaapi(5).

6. Live Audio: Live audio requires go2rtc to be configured and the camera to provide AAC, PCMA, or PCMU audio. WebRTC and MSE have specific codec requirements—AAC is best for broad compatibility(6)(1).

7. Recording Issues: If you see errors about no new recording segments, it often means ffmpeg is not receiving a compatible stream or there is an issue with the codec negotiation. Ensure your camera is actually sending AAC audio if you use audio=copy, or let Frigate transcode to AAC if needed(7)(3).

Summary of recommended configuration for your case:

• Set your camera to output AAC audio, H.264 video if possible.
• Use this in your FFmpeg config:

  ffmpeg:
    hwaccel_args: preset-vaapi
    output_args:
      record: preset-record-generic-audio-aac
    inputs:
      - path: rtsp://127.0.0.1:8554/street_main
        input_args: preset-rtsp-restream
        roles:
          - record
      - path: rtsp://127.0.0.1:8554/street_sub
        input_args: preset-rtsp-restream
        roles:
          - detect

• Remove ?video&audio from the end of your paths unless explicitly required by your camera (not shown in Frigate docs).
• If your camera supports AAC natively, try preset-record-generic-audio-copy for efficiency.
• If you still get errors, check go2rtc and ffmpeg logs for codec mismatches.

For more details, see:

• Live View
• FFmpeg presets
• Camera Specific Configurations
• Restream

📚 Sources:

1. Live View
2. Camera Specific Configurations
3. FFmpeg presets
4. Restream
5. Hardware Acceleration
6. Configuring go2rtc
7. Frequently Asked Questions

---

Have another question? Just tag @inkeep.

[moogoos]

Ive made some progress with the auto reply. Will see if I can get all the cameras sorted. This system is great.

[moogoos]

Got it sorted. Thank you!

[kiloptero]

can you share your config?

[moogoos]

Can you tell me a little about your setup and I can provide a cutdown version of it. It's pretty lengthy.

[kiloptero]

hikvision gen 3
having some issues with the logs

[kiloptero]

dont care about the lenght;) i can remake it

[moogoos]

yeah it's more about filtering out a lot of repetitive work. It's probably 2 thousand lines. Here's a single cam. keep in mind you have to create a camera user with remote live view and make sure they're "activated". You have to login as that user to the cam ui. I've also had to reboot my camera for that user setting to take effect. I use a custom rtsp port. I'm using intel 265k Ultra CPU. Works with both coral and openvino.

Hope this helps:

mqtt:
  enabled: true
  host: hostname
  port: port
  user: user
  password: password

birdseye:
  enabled: true
  mode: continuous

ffmpeg:
  hwaccel_args: preset-vaapi
  output_args:
    record: preset-record-generic-audio-copy

detectors:
  coral:
    type: edgetpu
    device: pci

#detectors:
#  ov:
#    type: openvino
#    device: GPU

#model:
#  width: 300
#  height: 300
#  input_tensor: nhwc
#  input_pixel_format: bgr
#  path: /openvino-model/ssdlite_mobilenet_v2.xml
#  labelmap_path: /openvino-model/coco_91cl_bkgr.txt

#logger:
#  default: info
#  logs:
#    frigate.events.audio: debug

snapshots:
  enabled: true
  timestamp: true
  retain:
    default: 60

record:
  sync_recordings: true

go2rtc:
  rtsp:
    username: username
    password: password
  streams:
    street_main:
      - rtsp://user:password@cam_ip:8539/Streaming/channels/101
    street_sub:
      - rtsp://user:password@cam_ip:8539/Streaming/channels/102

  street:
    live:
      streams:
        street_main: street_main
    ui:
      order: 2
    birdseye:
      order: 2
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/street_main?video&audio # <--- the name here must match the name of the camera in restream
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/street_sub?video&audio # <--- the name here must match the name of the camera in restream
          input_args: preset-rtsp-restream
          roles:
            - detect
            - audio
    audio:
      enabled: true
      max_not_heard: 30
      min_volume: 200
      listen:
        - bark
        - fire_alarm
        - scream
        - speech
        - yell
      filters:
        bark:
          threshold: 0.5
    objects:
      track:
        - person
        - car
        - bicycle
        - motorcycle
        - dog
        - cat
        - mouse
    detect:
      enabled: true
      width: 1280
      height: 720
      fps: 5
    record:
      enabled: true
      retain:
        days: 21
        mode: all
      alerts:
        retain:
          days: 120
      detections:
        retain:
          days: 120

[kiloptero]

why restream? rhanks Andres Roepke

…

On Fri, Aug 8, 2025 at 00:19 Christian ***@***.***> wrote: yeah it's more about filtering out a lot of repetitive work. It's probably 2 thousand lines. Here's a single cam. keep in mind you have to create a camera user with remote live view and make sure they're "activated". You have to login as that user to the cam ui. I've also had to reboot my camera for that user setting to take effect. I use a custom rtsp port. I'm using intel 265k Ultra CPU. Works with both coral and openvino. Hope this helps: mqtt: enabled: true host: hostname port: port user: user password: password birdseye: enabled: true mode: continuous ffmpeg: hwaccel_args: preset-vaapi output_args: record: preset-record-generic-audio-copy detectors: coral: type: edgetpu device: pci #detectors: # ov: # type: openvino # device: GPU #model: # width: 300 # height: 300 # input_tensor: nhwc # input_pixel_format: bgr # path: /openvino-model/ssdlite_mobilenet_v2.xml # labelmap_path: /openvino-model/coco_91cl_bkgr.txt #logger: # default: info # logs: # frigate.events.audio: debug snapshots: enabled: true timestamp: true retain: default: 60 record: sync_recordings: true go2rtc: rtsp: username: username password: password streams: street_main: - ***@***.***_ip:8539/Streaming/channels/101 street_sub: - ***@***.***_ip:8539/Streaming/channels/102 street: live: streams: street_main: street_main ui: order: 2 birdseye: order: 2 ffmpeg: inputs: - path: rtsp://127.0.0.1:8554/street_main?video&audio # <--- the name here must match the name of the camera in restream input_args: preset-rtsp-restream roles: - record - path: rtsp://127.0.0.1:8554/street_sub?video&audio # <--- the name here must match the name of the camera in restream input_args: preset-rtsp-restream roles: - detect - audio audio: enabled: true max_not_heard: 30 min_volume: 200 listen: - bark - fire_alarm - scream - speech - yell filters: bark: threshold: 0.5 objects: track: - person - car - bicycle - motorcycle - dog - cat - mouse detect: enabled: true width: 1280 height: 720 fps: 5 record: enabled: true retain: days: 21 mode: all alerts: retain: days: 120 detections: retain: days: 120 — Reply to this email directly, view it on GitHub <#19365 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AIOTKWW6QKTYTT74P5AU27L3MQQNVAVCNFSM6AAAAACC7EX5KSVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTIMBUGIYDKNI> . You are receiving this because you commented.Message ID: ***@***.*** com>

[moogoos]

camera limts and live view are a couple reasons. Please open a new dicussion if you have questions or try the AI tool:

https://docs.frigate.video/

[kiloptero]

mqtt:
host: 10.1.2.100
user: login
password: pass
topic_prefix: frigate

#environment_vars: # esto es para las amd

LIBVA_DRIVER_NAME: radeonsi

objects:

Optional: list of objects to track from labelmap.txt (default: shown below)

track:
- person
- cat
- car

filters:
# bicycle:
# threshold: 0.8
person:
threshold: 0.7
min_score: 0.6
cat:
threshold: 0.6
min_score: 0.4
car:
threshold: 0.7
min_score: 0.6

review:
alerts:
labels:
- cat
- person
- car

detections:
labels:
- cat
- car

  - dog
  - person

record:
sync_recordings: true
enabled: true
retain:
days: 3
mode: all
alerts:
retain:
days: 3
mode: all
detections:
retain:
days: 3
mode: all
snapshots:
enabled: true
retain:
default: 1000

ffmpeg:
hwaccel_args: preset-vaapi

go2rtc:
streams:
Reolinkduo21:
- ffmpeg:rtsp://login:pass@ip:554/h265Preview_01_main

  #- ffmpeg:Reolinkduo21#audio=opus
Reolinkduo21sub:
  - ffmpeg:rtsp://login:pass@ip:554/h264Preview_01_sub
 # - ffmpeg:Reolinkduo21sub#audio=opus
EntradaCasasub:
  - rtsp://login:pass@10.1.2.116:554/Streaming/Channels/102
#  - "ffmpeg:EntradaCasasub?audio=opus"
EntradaCasa:
  - rtsp://login:pass@10.1.2.116:554/Streaming/Channels/101
 # - "ffmpeg:EntradaCasa?audio=opus"

webrtc:
candidates:
- 10.1.2.100:8555
- stun:8555

cameras:

Reolinkduo21:
lpr:
enabled: true

mqtt:

timestamp: false

bounding_box: false

crop: true

quality: 100

height: 720

ffmpeg:
  
  output_args:
    record: preset-record-generic-audio-copy
  inputs:
    - path: rtsp://127.0.0.1:8554/Reolinkduo21?video=copy&audio=aac
      input_args: preset-rtsp-restream

      roles:
        - record
        - audio

    - path: rtsp://127.0.0.1:8554/Reolinkduo21sub?video=copy
      input_args: preset-rtsp-restream
      roles:
        - detect

live:
  streams:
    Reolinkduo21sub: Reolinkduo21sub
    Reolinkduo21: Reolinkduo21
audio:
  enabled: true
  listen:
    - bark
    - fire_alarm
    - scream
    - speech
    - yell

zones:
  casa_persona:
    coordinates: 
      0,0.012,0.276,0,0.347,0.496,0.554,0.546,0.512,0.59,0.6,1,0.024,0.974,0.033,0.912
    loitering_time: 0
    inertia: 3
    objects:
      - person
      - cat
  human:
    coordinates: 0.587,0.491,0.729,0.44,0.851,0.931,0.616,0.987
    loitering_time: 10
    objects: person
    inertia: 3
  casa_auto:
    coordinates: 0.235,0.504,0.544,0.582,0.572,1,0.222,1
    loitering_time: 0
    objects: car
    inertia: 3
motion:
  threshold: 30
  contour_area: 10
  improve_contrast: true
  mask: 0.807,0.007,0.616,0,0.859,0.465,0.983,0.773,0.996,0.993,0.996,0.007
objects:
  #track:
   # - person
   # - cat
  filters:
    car:
      min_area: 1000
      mask: 
        0.526,0.074,0.608,0.414,0.745,0.376,0.87,0.898,0.983,0.854,0.632,0.036
    person:
      min_area: 600
review:
  alerts:
    required_zones:
      - casa_persona
      - casa_auto
  detections:
    required_zones: human

EntradaCasa:
lpr:
enabled: true

birdseye:
  order: 1
#mqtt:
#  timestamp: false
#  bounding_box: false
#  crop: true
#  quality: 100
#  height: 720


ffmpeg:
  #hwaccel_args: preset-intel-qsv-h265
  output_args:
    
    record: preset-record-generic-audio-copy
  inputs:
    - path: rtsp://127.0.0.1:8554/EntradaCasa?video&audio 
      input_args: preset-rtsp-restream
      roles:
        - record
        - audio
    - path: rtsp://127.0.0.1:8554/EntradaCasasub?video&audio 
      input_args: preset-rtsp-restream
      roles:
        - detect

        #- record
#onvif:
#  host: 10.1.2.120
#  port: 8000
#  user: admin
#  password: reolinkmargo1

live:
  streams:
    EntradaCasasub: EntradaCasasub
    EntradaCasa: EntradaCasa

motion:
  mask: 0.006,0.042,0.008,0.103,0.269,0.104,0.265,0.047
  threshold: 30
  contour_area: 10
  improve_contrast: true
objects:
  track:
    - person
    - cat



review:
  alerts:
    labels:
      - person

  detections:
    labels:
      - cat

detectors:
coral_1:
type: edgetpu
device: usb:0
coral_2:
type: edgetpu
device: usb:1

database:
path: /config/frigate.db
# model:
# path: "/custom_model.tflite"

birdseye:
enabled: true
# 1 is the highest quality, and 31 is the lowest. Lower quality feeds utilize less CPU resources.
quality: 10
mode: continuous
restream: true
detect:
#width: 1280
#height: 720
fps: 5
enabled: true

#ui:

live_mode: mse

version: 0.16-0
lpr:
enabled: true
min_area: 1500 # Run recognition on larger plates only (4000 pixels represents a 63x63 pixel square in your image)
recognition_threshold: 0.6
known_plates:
Mazda_Kathy:
- MP-77-48
- MR-33-65
- MO-38-11
- MK-62-15

semantic_search:
enabled: true
reindex: false
model_size: small
camera_groups:
bird:
order: 1
icon: LuBird
cameras: birdseye
camaras:
order: 2
icon: LuAntenna
cameras:
- EntradaCasasub
- EntradaCasa
- Reolinkduo21
classification:
bird:
enabled: false
face_recognition:
enabled: false
model_size: large

[moogoos]

Is there a question here?

Please wrap your config in the code ticks ```. Hard to read and also the logs if you're looking for help. I would suggest starting a new thread if you need help. And you have a reolink camera. That's not relevant is this closed discussion

[kiloptero]

sorry! im sharing my yaml.. for some reason the hikvision camera send me logs errors Andres Roepke

…

On Fri, Aug 8, 2025 at 17:09 Christian ***@***.***> wrote: Is there a question here? Please wrap your config in the code ticks ```. Hard to read. — Reply to this email directly, view it on GitHub <#19365 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AIOTKWSS4PO4QVAH6ZXEAT33MUGZ3AVCNFSM6AAAAACC7EX5KSVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTIMBVGE3DKNA> . You are receiving this because you commented.Message ID: ***@***.*** com>

[kiloptero]

error | 2025-08-08 17:43:43 | frigate.video | EntradaCasa: Unable to read frames from ffmpeg process. error | 2025-08-08 17:43:43 | frigate.video | EntradaCasa: ffmpeg process is not running. exiting capture thread... error | 2025-08-08 17:43:46 | watchdog.EntradaCasa | Ffmpeg process crashed unexpectedly for EntradaCasa. error | 2025-08-08 17:43:46 | watchdog.EntradaCasa | The following ffmpeg logs include the last 100 lines prior to exit. error | 2025-08-08 17:43:46 | ffmpeg.EntradaCasa.detect | [AVHWFramesContext @ 0x7f8e5c017940] Failed to sync surface 0x15: 1 (operation failed). error | 2025-08-08 17:43:46 | ffmpeg.EntradaCasa.detect | [hwdownload @ 0x7f8e58003980] Failed to download frame: -5. error | 2025-08-08 17:43:46 | ffmpeg.EntradaCasa.detect | [vf#0:0 @ 0x55b60ff21880] Error while filtering: Input/output error error | 2025-08-08 17:43:46 | ffmpeg.EntradaCasa.detect | [vf#0:0 @ 0x55b60ff21880] Task finished with error code: -5 (Input/output error) error | 2025-08-08 17:43:46 | ffmpeg.EntradaCasa.detect | [vf#0:0 @ 0x55b60ff21880] Terminating thread with return code -5 (Input/output error) info | 2025-08-08 17:43:46 | watchdog.EntradaCasa | Restarting ffmpeg... Andres Roepke

…

On Fri, Aug 8, 2025 at 17:42 Andres Roepke ***@***.***> wrote: sorry! im sharing my yaml.. for some reason the hikvision camera send me logs errors Andres Roepke On Fri, Aug 8, 2025 at 17:09 Christian ***@***.***> wrote: > Is there a question here? > > Please wrap your config in the code ticks ```. Hard to read. > > — > Reply to this email directly, view it on GitHub > <#19365 (reply in thread)>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AIOTKWSS4PO4QVAH6ZXEAT33MUGZ3AVCNFSM6AAAAACC7EX5KSVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTIMBVGE3DKNA> > . > You are receiving this because you commented.Message ID: > ***@***.*** > com> >