Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Support]: Automating based on audio events #8171

Closed
brayStorm opened this issue Oct 14, 2023 · 2 comments
Closed

[Support]: Automating based on audio events #8171

brayStorm opened this issue Oct 14, 2023 · 2 comments
Labels
beta Related to the current beta version of frigate question Further information is requested

Comments

@brayStorm
Copy link

brayStorm commented Oct 14, 2023 •
edited
Loading

Describe the problem you are having

I have audio detection set up, and it appears to be working well, and labelling sound from my children's room (crying, yelling, screaming, etc). When one of these is triggered should it be publishing something to frigate/events ? I have not been able to identify an audio event in that list, and I would like to trigger a HA automation on the back of crying/yelling/screaming detected.

Version

0.13.0-0858859

Frigate config file

mqtt:
  host: 192.168.86.181
  port: 1883
  user: frigate
  password: frigate
  topic_prefix: frigate

detectors:
  coral:
    type: edgetpu
    device: pci:0

detect:
  width: 896
  height: 672
  fps: 7

model:
  labelmap:   
    2: vehicle
    3: vehicle
    5: vehicle
    7: vehicle
    15: animal
    16: animal
    17: animal
    18: animal
    19: animal
    20: animal
    21: animal
    22: animal
    23: animal
    24: animal

snapshots:
  enabled: True
  timestamp: False
  bounding_box: True
  crop: True
  retain:
    default: 10

record:
  enabled: true
  retain:
    days: 10
    mode: active_objects
  events:
    pre_capture: 10
    post_capture: 10

go2rtc:
  webrtc:
    candidates:
      - 192.168.86.185:8555
      - stun:8555
  streams:
    twins: 
      - rtsp://frigate:frigate@192.168.86.62:554/stream1#video=copy#audio=opus
      - "ffmpeg:twins#audio=aac"
      - tapo://<USER>:<PASS>@192.168.86.62
    twins_sub: 
      - rtsp://frigate:frigate@192.168.86.62:554/stream2#video=copy#audio=copy#audio=opus
      - "ffmpeg:twins#audio=aac"
    porch: 
      - ffmpeg:http://192.168.86.186/flv?port=1935&app=bcs&stream=channel0_main.bcs&user=<USER>&password=<PASS>#video=copy#audio=copy#audio=opus
      - "ffmpeg:porch#audio=aac"
    porch_sub: ffmpeg:http://192.168.86.186/flv?port=1935&app=bcs&stream=channel0_ext.bcs&user=<USER>&password=<PASS>#video=copy#audio=copy#audio=opus
    driveway: 
      - ffmpeg:http://192.168.86.53/flv?port=1935&app=bcs&stream=channel0_main.bcs&user=<USER>&password=<PASS>#video=copy#audio=copy#audio=opus
      - "ffmpeg:driveway#audio=aac"      
    driveway_sub: ffmpeg:http://192.168.86.53/flv?port=1935&app=bcs&stream=channel0_ext.bcs&user=<USER>&password=<PASS>#video=copy#audio=copy#audio=opus
    sideyard: 
      - ffmpeg:http://192.168.86.50/flv?port=1935&app=bcs&stream=channel0_main.bcs&user=<USER>&password=<PASS>#video=copy#audio=copy#audio=opus
      - "ffmpeg:sideyard#audio=aac"      
    sideyard_sub: ffmpeg:http://192.168.86.50/flv?port=1935&app=bcs&stream=channel0_ext.bcs&user=<USER>&password=<PASS>#video=copy#audio=copy#audio=opus
    rear: 
      - ffmpeg:http://192.168.86.187/flv?port=1935&app=bcs&stream=channel0_main.bcs&user=<USER&password=<PASS>#video=copy#audio=copy#audio=opus
      - "ffmpeg:rear#audio=aac"      
    rear_sub: ffmpeg:http://192.168.86.187/flv?port=1935&app=bcs&stream=channel0_ext.bcs&user=<USER>&password=<PASS>#video=copy#audio=copy#audio=opus

cameras:
  twins:
    ffmpeg:
      output_args:
          record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://127.0.0.1:8554/twins?video&audio
          input_args: preset-rtsp-restream
          roles:
            - record
            - audio
        - path: rtsp://127.0.0.1:8554/twins_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    objects:
      track:
        - person
      filters:
        person:
          mask:
            - 364,165,346,597,175,576,142,530,219,179
            - 491,533,491,606,628,595,687,536,611,181,460,177
    motion:
      mask:
        - 364,165,346,597,175,576,142,530,219,179
        - 491,533,491,606,628,595,687,536,611,181,460,177
    audio:
      enabled: True
      max_not_heard: 30
      min_volume: 200
      listen:
        - crying
        - scream
        - yell
      filters:
        crying:
          threshold: 0.8
        scream:
          threshold: 0.8        
        yell:
          threshold: 0.8        
  porch:
    ffmpeg:
      output_args:
          record: preset-record-generic-audio-aac
      input_args:
        - -avoid_negative_ts
        - make_zero
        - -fflags
        - nobuffer+genpts+discardcorrupt
        - -flags
        - low_delay
        - -strict
        - experimental
        - -analyzeduration
        - 1000M
        - -probesize
        - 1000M
        - -rw_timeout
        - "5000000"
      inputs:
        - path: rtsp://127.0.0.1:8554/porch?video&audio
          input_args: preset-rtsp-restream
          roles:
            - record
            - audio
        - path: rtsp://127.0.0.1:8554/porch_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    objects:
      track:
        - person
        - animal
      filters:
        person:
          min_area: 4000
          threshold: 0.8
          mask: 
            - 26,427,95,403,113,0,27,0       
        animal:
          min_area: 4000
          threshold: 0.8            
    motion:
      mask:
        - 35,168,152,157,180,0,37,0         
    mqtt:
      enabled: true
      timestamp: false
      bounding_box: true
      crop: true
      height: 270
      quality: 50

  driveway:
    ffmpeg:
      output_args:
          record: preset-record-generic-audio-aac
      input_args:
        - -avoid_negative_ts
        - make_zero
        - -fflags
        - +genpts+discardcorrupt
        - -flags
        - low_delay
        - -strict
        - experimental
        - -analyzeduration
        - 1000M
        - -probesize
        - 1000M
        - -rw_timeout
        - "5000000" 
      inputs:
        - path: rtsp://127.0.0.1:8554/driveway?video&audio
          input_args: preset-rtsp-restream
          roles:
            - record
            - audio
        - path: rtsp://127.0.0.1:8554/driveway_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    objects:
      track:
        - person
        - animal
        - vehicle       
    motion:
      mask:
        - 296,0,309,170,99,191,87,0
        - 819,0,825,119,694,108,642,0
    mqtt:
      enabled: true
      timestamp: false
      bounding_box: true
      crop: true
      height: 270
      quality: 50

  sideyard:
    ffmpeg:
      output_args:
          record: preset-record-generic-audio-aac
      input_args:
        - -avoid_negative_ts
        - make_zero
        - -fflags
        - nobuffer+genpts+discardcorrupt
        - -flags
        - low_delay
        - -strict
        - experimental
        - -analyzeduration
        - 1000M
        - -probesize
        - 1000M
        - -rw_timeout
        - "5000000"
      inputs:
        - path: rtsp://127.0.0.1:8554/sideyard?video&audio
          input_args: preset-rtsp-restream
          roles:
            - record
            - audio
        - path: rtsp://127.0.0.1:8554/sideyard_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    objects:
      track:
        - person
        - animal
      filters:
        person:
          min_area: 12000
          threshold: 0.8
        animal:
          min_area: 8000
          threshold: 0.8
    mqtt:
      enabled: true
      timestamp: false
      bounding_box: true
      crop: true
      height: 270
      quality: 70

  rear:
    ffmpeg:
      output_args:
          record: preset-record-generic-audio-aac
      input_args:
        - -avoid_negative_ts
        - make_zero
        - -fflags
        - nobuffer+genpts+discardcorrupt
        - -flags
        - low_delay
        - -strict
        - experimental
        - -analyzeduration
        - 1000M
        - -probesize
        - 1000M
        - -rw_timeout
        - "5000000"
      inputs:
        - path: rtsp://127.0.0.1:8554/rear?video&audio
          input_args: preset-rtsp-restream
          roles:
            - record
            - audio
        - path: rtsp://127.0.0.1:8554/rear_sub
          input_args: preset-rtsp-restream
          roles:
            - detect   
    objects:
      track:
        - person
        - animal
      filters:
        person:
          min_area: 8000
          threshold: 0.8
        animal:
          min_area: 4000
          threshold: 0.8             
    mqtt:
      enabled: true
      timestamp: false
      bounding_box: true
      crop: true
      height: 270
      quality: 50

Relevant log output

2023-10-14 16:06:38.010209960  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927559, current: 731561869; changing to 732927560. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.010247405  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : DTS 4294215280, next:112401000 st:1 invalid dropping
2023-10-14 16:06:38.010296849  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : PTS 4294215280, next:112401000 invalid dropping st:1
2023-10-14 16:06:38.010372176  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927560, current: 731562883; changing to 732927561. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.010432251  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : DTS 4294215760, next:112461000 st:1 invalid dropping
2023-10-14 16:06:38.010469238  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : PTS 4294215760, next:112461000 invalid dropping st:1
2023-10-14 16:06:38.010531867  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:1; previous: 46631226, current: 896712; changing to 46631227. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.010602887  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927561, current: 731563912; changing to 732927562. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.010658990  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : DTS 4294216240, next:112521000 st:1 invalid dropping
2023-10-14 16:06:38.010720696  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : PTS 4294216240, next:112521000 invalid dropping st:1
2023-10-14 16:06:38.010773677  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927562, current: 731564910; changing to 732927563. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.010832202  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : DTS 4294216736, next:112581000 st:1 invalid dropping
2023-10-14 16:06:38.010894619  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : PTS 4294216736, next:112581000 invalid dropping st:1
2023-10-14 16:06:38.010949699  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:1; previous: 46631227, current: 897736; changing to 46631228. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.011003490  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927563, current: 731565939; changing to 732927564. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.011063353  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : DTS 4294217200, next:112641000 st:1 invalid dropping
2023-10-14 16:06:38.011120350  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : PTS 4294217200, next:112641000 invalid dropping st:1
2023-10-14 16:06:38.011175646  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927564, current: 731566968; changing to 732927565. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.011229759  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : DTS 4294217680, next:112701000 st:1 invalid dropping
2023-10-14 16:06:38.011288248  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : PTS 4294217680, next:112701000 invalid dropping st:1
2023-10-14 16:06:38.011341846  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:1; previous: 46631228, current: 898760; changing to 46631229. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.011398276  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927565, current: 731568013; changing to 732927566. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.011452069  [2023-10-14 16:06:37] ffmpeg.twins.audio_record      ERROR   : DTS 4294218160, next:112761000 st:1 invalid dropping
2023-10-14 16:06:38.011508291  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294218160, next:112761000 invalid dropping st:1
2023-10-14 16:06:38.011570295  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927566, current: 731568996; changing to 732927567. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.011622863  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : DTS 4294218640, next:112821000 st:1 invalid dropping
2023-10-14 16:06:38.011677060  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294218640, next:112821000 invalid dropping st:1
2023-10-14 16:06:38.011732177  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:1; previous: 46631229, current: 899784; changing to 46631230. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.011784435  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927567, current: 731570040; changing to 732927568. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.011837412  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : DTS 4294219120, next:112881000 st:1 invalid dropping
2023-10-14 16:06:38.011889173  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294219120, next:112881000 invalid dropping st:1
2023-10-14 16:06:38.011942468  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : DTS 4294219600, next:112941000 st:1 invalid dropping
2023-10-14 16:06:38.011993980  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294219600, next:112941000 invalid dropping st:1
2023-10-14 16:06:38.012051513  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:1; previous: 46631230, current: 900808; changing to 46631231. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.012103228  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927568, current: 731571085; changing to 732927569. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.012159050  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : DTS 4294220080, next:113001000 st:1 invalid dropping
2023-10-14 16:06:38.012210180  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294220080, next:113001000 invalid dropping st:1
2023-10-14 16:06:38.012264796  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927569, current: 731572083; changing to 732927570. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.012316189  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : DTS 4294220560, next:113061000 st:1 invalid dropping
2023-10-14 16:06:38.012369247  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294220560, next:113061000 invalid dropping st:1
2023-10-14 16:06:38.012422698  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:1; previous: 46631231, current: 901832; changing to 46631232. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.012477147  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927570, current: 731573112; changing to 732927571. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.012530229  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : DTS 4294221040, next:113121000 st:1 invalid dropping
2023-10-14 16:06:38.012581826  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294221040, next:113121000 invalid dropping st:1
2023-10-14 16:06:38.012635392  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927571, current: 731574157; changing to 732927572. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.012687291  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : DTS 4294221520, next:113181000 st:1 invalid dropping
2023-10-14 16:06:38.012740003  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294221520, next:113181000 invalid dropping st:1
2023-10-14 16:06:38.012794199  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:1; previous: 46631232, current: 902856; changing to 46631233. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.012847872  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927572, current: 731575155; changing to 732927573. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.012901700  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : DTS 4294222000, next:113241000 st:1 invalid dropping
2023-10-14 16:06:38.013209147  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294222000, next:113241000 invalid dropping st:1
2023-10-14 16:06:38.013212684  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927573, current: 731576184; changing to 732927574. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.013214695  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : DTS 4294222480, next:113301000 st:1 invalid dropping
2023-10-14 16:06:38.013216552  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294222480, next:113301000 invalid dropping st:1
2023-10-14 16:06:38.013219151  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927574, current: 731577214; changing to 732927575. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.013258054  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : DTS 4294222960, next:113361000 st:1 invalid dropping
2023-10-14 16:06:38.013317173  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294222960, next:113361000 invalid dropping st:1
2023-10-14 16:06:38.013373940  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:1; previous: 46631233, current: 903880; changing to 46631234. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.013452611  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927575, current: 731578243; changing to 732927576. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.013503492  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : DTS 4294223440, next:113421000 st:1 invalid dropping
2023-10-14 16:06:38.013564030  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294223440, next:113421000 invalid dropping st:1
2023-10-14 16:06:38.013619929  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927576, current: 731579241; changing to 732927577. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.013680870  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : DTS 4294223928, next:113481000 st:1 invalid dropping
2023-10-14 16:06:38.013737433  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294223928, next:113481000 invalid dropping st:1
2023-10-14 16:06:38.013797387  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:1; previous: 46631234, current: 904904; changing to 46631235. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.013856677  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927577, current: 731580286; changing to 732927578. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.013911141  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : DTS 4294224440, next:113541000 st:1 invalid dropping
2023-10-14 16:06:38.013969734  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294224440, next:113541000 invalid dropping st:1
2023-10-14 16:06:38.014072670  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : DTS 4294224880, next:113601000 st:1 invalid dropping
2023-10-14 16:06:38.014121813  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294224880, next:113601000 invalid dropping st:1
2023-10-14 16:06:38.014210124  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:1; previous: 46631235, current: 905928; changing to 46631236. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.014266849  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:0; previous: 732927578, current: 731581299; changing to 732927579. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.014324094  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : DTS 4294225360, next:113661000 st:1 invalid dropping
2023-10-14 16:06:38.014380774  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : PTS 4294225360, next:113661000 invalid dropping st:1
2023-10-14 16:06:38.014437829  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:1; previous: 46631236, current: 906952; changing to 46631237. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.014494838  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x56210e6fd8c0] Non-monotonous DTS in output stream 0:1; previous: 46631237, current: 907976; changing to 46631238. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.014553811  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [aac @ 0x55ee97d26580] Too many bits 8832.000000 > 6144 per frame requested, clamping to max
2023-10-14 16:06:38.014620470  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : [segment @ 0x55ee97d240c0] Non-monotonous DTS in output stream 0:0; previous: 4877322, current: 4755471; changing to 4877323. This may result in incorrect timestamps in the output file.
2023-10-14 16:06:38.014677795  [2023-10-14 16:06:38] ffmpeg.twins.audio_record      ERROR   : rtsp://127.0.0.1:8554/twins?video&audio: Connection timed out
2023-10-14 16:06:38.014736633  [2023-10-14 16:06:38] watchdog.twins                 INFO    : Terminating the existing ffmpeg process...
2023-10-14 16:06:38.014796595  [2023-10-14 16:06:38] watchdog.twins                 INFO    : Waiting for ffmpeg to exit gracefully...
2023-10-14 16:06:48.013958797  [2023-10-14 16:06:48] watchdog.twins                 INFO    : No frames received from twins in 20 seconds. Exiting ffmpeg...
2023-10-14 16:06:48.014155480  [2023-10-14 16:06:48] watchdog.twins                 INFO    : Waiting for ffmpeg to exit gracefully...
2023-10-14 16:06:48.076799980  [2023-10-14 16:06:48] frigate.video                  ERROR   : twins: Unable to read frames from ffmpeg process.
2023-10-14 16:06:48.076909804  [2023-10-14 16:06:48] frigate.video                  ERROR   : twins: ffmpeg process is not running. exiting capture thread...

FFprobe output from your camera

.

Frigate stats

No response

Operating system

Other

Install method

Docker Compose

Coral version

M.2

Network connection

Wired

Camera make and model

Tapo C100

Any other information that may be helpful

No response
@NickM-27 NickM-27 added question Further information is requested beta Related to the current beta version of frigate and removed support triage labels Oct 14, 2023
@NickM-27
Copy link
Collaborator

NickM-27 commented Oct 14, 2023 •
edited
Loading

/events is for objects only. When using version 5.0 (currently in beta) of the frigate integration all audio types are added as sound sensors and can be used to fire notifications or other automations

@NickM-27
Copy link
Collaborator

Feel free to leave a comment on #8366 if there are any more questions regarding this

@freefd freefd mentioned this issue May 13, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
beta Related to the current beta version of frigate question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@NickM-27 @brayStorm