Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074> #124516

Open
ecchodun opened this issue Aug 24, 2024 · 63 comments
Open

Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074> #124516

ecchodun opened this issue Aug 24, 2024 · 63 comments
Assignees
Labels
integration: zha waiting-for-diagnostics https://www.home-assistant.io/docs/configuration/troubleshooting/#debug-logs-and-diagnostics

Comments

@ecchodun
Copy link

The problem

Never had an issue and now I'm getting the following error on various Zigbee devices - Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

What version of Home Assistant Core has the issue?

core-2024.8.2

What was the last working version of Home Assistant Core?

core-2024.8.1

What type of installation are you running?

Home Assistant OS

Integration causing the issue

Zigbee

Link to integration documentation on our website

No response

Diagnostics information

No response

Example YAML snippet

No response

Anything in the logs that might be useful for us?

Logger: homeassistant.components.automation.new_automation_closet
Source: components/automation/__init__.py:776
integration: Automation (documentation, issues)
First occurred: 7:25:55 PM (1 occurrences)
Last logged: 7:25:55 PM
Error while executing automation automation.new_automation_closet: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

Additional information

This has occurred sporadically over the past few days. I did add a Nortek dongle along with my existing Zigbee dongle, but even after unplugging it I'm still getting this error.

@home-assistant
Copy link

Hey there @dmulcahey, @Adminiuga, @puddly, @TheJulianJES, mind taking a look at this issue as it has been labeled with an integration (zha) you are listed as a code owner for? Thanks!

Code owner commands

Code owners of zha can trigger bot actions by commenting:

  • @home-assistant close Closes the issue.
  • @home-assistant rename Awesome new title Renames the issue.
  • @home-assistant reopen Reopen the issue.
  • @home-assistant unassign zha Removes the current integration label and assignees on the issue, add the integration domain after the command.
  • @home-assistant add-label needs-more-information Add a label (needs-more-information, problem in dependency, problem in custom component) to the issue.
  • @home-assistant remove-label needs-more-information Remove a label (needs-more-information, problem in dependency, problem in custom component) on the issue.

(message by CodeOwnersMention)


zha documentation
zha source
(message by IssueLinks)

@ufondu88
Copy link

ufondu88 commented Aug 25, 2024

I'm having the same issue. I have a group of Ikea blinds that I control. Some of the blinds are triggered, but some are not. The logs show the same error

@puddly
Copy link
Contributor

puddly commented Aug 25, 2024

This will likely be improved by zigpy/bellows#646 (in the next beta) if your devices are battery operated. Note that nothing changed between 2024.8.1 and 2024.8.2 (and in many many months beforehand) so any issues you're experiencing are with your environment.

@ufondu88
Copy link

ufondu88 commented Aug 25, 2024

My environment has not changed in many months. This issue started after the upgrade to 2024.8.2. And, yes, my devices are battery operated

@puddly
Copy link
Contributor

puddly commented Aug 25, 2024

My environment has not changed in many months.

If you haven't changed the stick firmware, something in your RF environment has changed. It doesn't mean that you changed something, just that it has changed. New neighbors (or old neighbors who added new equipment), wifi router moved its 2.4GHz network channel, temperatures changed and your device's battery voltage has dropped, new SSD nearby, etc.

This issue started after the upgrade to 2024.8.2

They may have started at the same time but if you downgrade to 2024.8.1, things will remain exactly the same.

@ecchodun
Copy link
Author

I will say, that my environment did change in that in addition to my existing Silicon Labs Sonoff Zigbee dongle, I added a new Nortek Z-Wave/Zigbee to take advantage of the Z-wave frequency (the Zigbee is not active on the dual-device). It may have been coincidental that when I did so, I started to get the error, but yesterday I added a 10' USB extension cable to the Z-wave dongle (the Sonoff already had one) and I haven't had the error 3074 in over 24 hours. It could be a coincidence and I'll certainly keep this thread updated, but it's worth noting.

@jamestalbot3
Copy link

I have also had this error pop up on IKEA battery operated blinds out of nowhere today. I haven't added or changed my zigbee devices in any way. They just refuse to communicate at all

@ecchodun
Copy link
Author

Just got it again after not seeing it for over 24 hours - Error while executing automation automation.new_automation_closet: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

@chicagoandy
Copy link

Yes, also getting these starting yesterday. No network changes. There are enough people having this that rules our typical device incompatibility.

@jgandhi19
Copy link

jgandhi19 commented Aug 26, 2024

I started receiving these errors after upgrading as well. No other changes, this doesn't seem to be a coincidence that others are experiencing the same issues.

I will mention that the devices I'm seeing as failing are Sengled light bulbs, not battery powered.

@chuckie007
Copy link

Also started getting this in the last few days. No changes in months to zigbee devices.

@puddly
Copy link
Contributor

puddly commented Aug 26, 2024

As mentioned above, there have been no changes to ZHA in the past few releases. More fundamentally, however, ZHA does not have control over routing to your devices. It asks the stick to send a message and the stick responds with the status code you're seeing. If this changed all of the sudden, this is 100% a result of your environment. You can verify by downgrading HA Core.

That being said, if downgrading helps, please enable ZHA debug logging, leave it running for half an hour and toggle some devices to generate log data, and disable debug logging to generate a log. Please do this on a version that works and one that does not and we can see what the difference is between the logs.

@bryanklingner
Copy link

Just here to say I experienced very similar symptoms:

  • Zigbee controller is Skyconnect, working fine for months
  • Devices are IKEA Fyrtur motorized shades
  • Started getting this error 3074, shade function highly sporadic

I have seen other similar reports eg https://community.home-assistant.io/t/connection-problems-with-zha/762314

Seems too widespread to just be a coincidence for all of us. I'll try to get some logs to post.

@rwarner
Copy link

rwarner commented Aug 26, 2024

Also chiming in here with the same issue. Was not seeing this until upgrading to 2024.8.3 today. Some buttons have rendered completely useless all of the sudden after this update.

I keep getting Zigbee requests sort of "pooled together" after a few minutes when trying to turn lights on and off. Then they all of a sudden execute and this error pops up.

@rwarner
Copy link

rwarner commented Aug 27, 2024

FWIW, I rolled back to 2024.8.1 last night to hopefully resolve this but ran into the same issue. Which is weird because I didn't have this issue until moving to 2024.8.3.

I have an issue running my script with a Zigbee button to toggle some lights for some reason which hits this error:

sequence:
  - entity_id:
      - light.master_bedroom_lights
    action: light.toggle
  - delay:
      milliseconds: 250
  - condition: state
    entity_id: light.master_bedroom_lights
    state: "on"
  - continue_on_error: true
    data_template:
      entity_id: light.master_bedroom_lights
      brightness_pct: |
        {% if now().hour >= 21 %}
          30
        {% elif now().hour <= 7 %}
          30
        {% else %}
          100
        {% endif %}
      color_temp: |-
        {% if now().hour >= 21 %}
          470
        {% elif now().hour <= 7 %}
          470
        {% else %}
          350
        {% endif %}
    action: light.turn_on

toggle_bedroom_lights: Error executing script. Error for call_service at pos 1: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

I'll go to execute this script, then it won't work. So I'll go into Home Assistant to toggle the same lights, then that "pooling" action will happen and the lights will just turn on and off and on and off, etc..

Have also been getting a lot of zigbee devices notifying me they've gone "unavailable" suddenly

@rwarner
Copy link

rwarner commented Aug 27, 2024

I just downgraded to 2024.7.4 and do not run into this issue with my previous comment FWIW

@puddly
Copy link
Contributor

puddly commented Aug 27, 2024

Can you generate a debug log by enabling debug logging for ZHA, reloading the integration, and letting it run for half an hour while doing what you can to trigger the issue? Without a log from each version, it's hard to see what's different.

@rwarner
Copy link

rwarner commented Aug 27, 2024

Sure thing I can try to get you something hopefully soon. On the 2024.8.3 version? Or the 2024.7.4?

@puddly
Copy link
Contributor

puddly commented Aug 27, 2024

Both of them, if you could. One alone won't show what changed.

@ecchodun
Copy link
Author

Here is my last log of it occurring from just today - Logger: zigpy.zcl
Source: runner.py:190
First occurred: August 26, 2024 at 2:09:41 PM (5 occurrences)
Last logged: 5:57:30 AM

[0x3E90:1:0x0020] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 265, in request return await self.device.request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 339, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 833, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/bellows/zigbee/application.py", line 825, in send_packet raise zigpy.exceptions.DeliveryError( zigpy.exceptions.DeliveryError: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074> The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/general.py", line 646, in check_in_response await self.fast_poll_stop() File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 83, in wrapper with wrap_zigpy_exceptions(): File "/usr/local/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 75, in wrap_zigpy_exceptions raise ZHAException(message) from exc zha.exceptions.ZHAException: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>
[0x7B00:1:0x0020] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 265, in request return await self.device.request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 339, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 833, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/bellows/zigbee/application.py", line 825, in send_packet raise zigpy.exceptions.DeliveryError( zigpy.exceptions.DeliveryError: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074> The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/general.py", line 646, in check_in_response await self.fast_poll_stop() File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 83, in wrapper with wrap_zigpy_exceptions(): File "/usr/local/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 75, in wrap_zigpy_exceptions raise ZHAException(message) from exc zha.exceptions.ZHAException: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

@bryanklingner
Copy link

A bit more information:

I tried replacing the Nabu Casa SkyConnect with an old Sonoff Zigbee 3.0 USB stick, rebuilding my network from scratch. The flakiness and 3074 errors have disappeared.

So, at least anecdotally this may be an issue specific to the SkyConnect stick.

@ecchodun
Copy link
Author

A bit more information:

I tried replacing the Nabu Casa SkyConnect with an old Sonoff Zigbee 3.0 USB stick, rebuilding my network from scratch. The flakiness and 3074 errors have disappeared.

So, at least anecdotally this may be an issue specific to the SkyConnect stick.

I have the issue with Sonoff Zigbee 3.0 USB stick. It's likely to pop up for you again.

@rwarner
Copy link

rwarner commented Aug 28, 2024

Both of them, if you could. One alone won't show what changed.

Sent you over the logs on Discord.

Of course, after I did the logging on 2024.7.4 and then upgraded my python installation to 2024.8.3 it has been working on 2024.8.3 just fine... haven't seen the error come back yet.

When going from 2024.7.4 to 2024.8.3 though I did get some pip errors and I'm curious if one of the libraries stuck to the old one or something. Got some of this:

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
async-upnp-client 0.39.0 requires aiohttp~=3.9.1, but you have aiohttp 3.10.5 which is incompatible.
aiohttp-fast-url-dispatcher 0.3.0 requires aiohttp<3.10,>=3.8.5, but you have aiohttp 3.10.5 which is incompatible.
zha 0.0.30 requires bellows==0.40.3, but you have bellows 0.39.1 which is incompatible.
zha 0.0.30 requires zha-quirks==0.0.118, but you have zha-quirks 0.0.117 which is incompatible.
zha 0.0.30 requires zigpy==0.65.3, but you have zigpy 0.64.1 which is incompatible.
zha 0.0.30 requires zigpy-deconz==0.23.3, but you have zigpy-deconz 0.23.2 which is incompatible.
zha 0.0.30 requires zigpy-xbee==0.20.2, but you have zigpy-xbee 0.20.1 which is incompatible.
zha 0.0.30 requires zigpy-zigate==0.13.1, but you have zigpy-zigate 0.12.1 which is incompatible.
zha 0.0.30 requires zigpy-znp==0.12.4, but you have zigpy-znp 0.12.2 which is incompatible.

@ufondu88
Copy link

I have to say, I have not encountered this issue in a while. I have not changed anything about my environment and I am still on 2024.8.3. It has now been a few days since I have gotten this error. I have no idea what could have fixed the issue

@chicagoandy
Copy link

chicagoandy commented Aug 28, 2024

Same with me. Over the weekend I was getting this everywhere, for no reason. I rebooted, both soft and hard. I "reconfigured network". I removed and readded devices. Nothing worked.
Then it got better with 2024.8.3, or perhaps HAOS 13.1. No idea what went wrong, but the most frustrating aspect was the large number of unhelpful comments about incompatible devices. I hope this is just a ghost that goes away, but overall - the general flakiness of ZHA is confirmed for me.

@ecchodun
Copy link
Author

ecchodun commented Sep 1, 2024

Just received it for the first time today. Funny thing is, I checked the time of the error and my log doesn't indicate any attempted contact with a Zigbee device at such time.

Logger: zigpy.zcl
Source: runner.py:190
First occurred: 9:18:03 PM (1 occurrences)
Last logged: 9:18:03 PM

[0x7B00:1:0x0020] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 265, in request return await self.device.request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 339, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 833, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/bellows/zigbee/application.py", line 825, in send_packet raise zigpy.exceptions.DeliveryError( zigpy.exceptions.DeliveryError: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074> The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/general.py", line 643, in check_in_response await self.checkin_response(True, self.CHECKIN_FAST_POLL_TIMEOUT, tsn=tsn) File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/init.py", line 83, in wrapper with wrap_zigpy_exceptions(): File "/usr/local/lib/python3.12/contextlib.py", line 158, in exit self.gen.throw(value) File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/init.py", line 75, in wrap_zigpy_exceptions raise ZHAException(message) from exc zha.exceptions.ZHAException: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

@TerminalAddict
Copy link

this morning I have:

ha core update --version 2024.7.4
ha core update --version 2024.8.1

and left it at that .. let's see how I go

@ecchodun
Copy link
Author

ecchodun commented Sep 1, 2024

How does one update just the Core? I tried to restore from a partial backup with an old version and lost a lot of my changes I made.

@rwarner
Copy link

rwarner commented Sep 1, 2024

@rwarner did you restore from backup to 2024.7.x ? or did you:

ha core update --version 2024.7.4

No I updated my HA core python virtual environment with that specific version using something like the following:
pip3 install homeassistant==2024.7.3

FWIW still not seeing this error again over the weekend. Will update to the next version whenever that’s out and see if it comes back.

@TerminalAddict
Copy link

Well, my downgrade, and upgrade didn't work.

Error while executing automation automation.turn_on_garage_lights_when_motion_is_detected: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

@TerminalAddict
Copy link

couldn't turn my lights off this morning.
WAF = 0
this is not a fun time

@dmulcahey
Copy link
Contributor

couldn't turn my lights off this morning. WAF = 0 this is not a fun time

#124516 (comment)

Perform these steps and attach debug logs.

@dmulcahey
Copy link
Contributor

Just received it for the first time today. Funny thing is, I checked the time of the error and my log doesn't indicate any attempted contact with a Zigbee device at such time.

Logger: zigpy.zcl Source: runner.py:190 First occurred: 9:18:03 PM (1 occurrences) Last logged: 9:18:03 PM

[0x7B00:1:0x0020] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 265, in request return await self.device.request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 339, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 833, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/bellows/zigbee/application.py", line 825, in send_packet raise zigpy.exceptions.DeliveryError( zigpy.exceptions.DeliveryError: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074> The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/general.py", line 643, in check_in_response await self.checkin_response(True, self.CHECKIN_FAST_POLL_TIMEOUT, tsn=tsn) File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/init.py", line 83, in wrapper with wrap_zigpy_exceptions(): File "/usr/local/lib/python3.12/contextlib.py", line 158, in exit self.gen.throw(value) File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/init.py", line 75, in wrap_zigpy_exceptions raise ZHAException(message) from exc zha.exceptions.ZHAException: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

This is an automatic reply to a check in from the device. There are 0 functional issues from this particular log and it is safe to ignore.

@dmulcahey
Copy link
Contributor

12 hours without an error and then boom - If it is interference of some sort, why is it so random? This particular error looks similarly timed with a Door Sensor Checkin Event being fired.

Logger: zigpy.zcl Source: runner.py:190 First occurred: 5:03:51 PM (1 occurrences) Last logged: 5:03:51 PM

[0x3E90:1:0x0020] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 265, in request return await self.device.request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 339, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 833, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/bellows/zigbee/application.py", line 825, in send_packet raise zigpy.exceptions.DeliveryError( zigpy.exceptions.DeliveryError: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074> The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/general.py", line 645, in check_in_response await self.set_long_poll_interval(self.LONG_POLL) File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/init.py", line 83, in wrapper with wrap_zigpy_exceptions(): File "/usr/local/lib/python3.12/contextlib.py", line 158, in exit self.gen.throw(value) File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/init.py", line 75, in wrap_zigpy_exceptions raise ZHAException(message) from exc zha.exceptions.ZHAException: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

Ditto with this one. Safe to ignore

@dmulcahey
Copy link
Contributor

Here is my last log of it occurring from just today - Logger: zigpy.zcl Source: runner.py:190 First occurred: August 26, 2024 at 2:09:41 PM (5 occurrences) Last logged: 5:57:30 AM

[0x3E90:1:0x0020] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 265, in request return await self.device.request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 339, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 833, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/bellows/zigbee/application.py", line 825, in send_packet raise zigpy.exceptions.DeliveryError( zigpy.exceptions.DeliveryError: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074> The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/general.py", line 646, in check_in_response await self.fast_poll_stop() File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 83, in wrapper with wrap_zigpy_exceptions(): File "/usr/local/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 75, in wrap_zigpy_exceptions raise ZHAException(message) from exc zha.exceptions.ZHAException: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>
[0x7B00:1:0x0020] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 265, in request return await self.device.request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 339, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 833, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/bellows/zigbee/application.py", line 825, in send_packet raise zigpy.exceptions.DeliveryError( zigpy.exceptions.DeliveryError: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074> The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/general.py", line 646, in check_in_response await self.fast_poll_stop() File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 83, in wrapper with wrap_zigpy_exceptions(): File "/usr/local/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 75, in wrap_zigpy_exceptions raise ZHAException(message) from exc zha.exceptions.ZHAException: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

These are also a non issue

@ecchodun
Copy link
Author

ecchodun commented Sep 3, 2024

On a positive note, it's been about 48 hours without an error (did I just jinx it).

@Firewolf1337
Copy link

Firewolf1337 commented Sep 4, 2024

@dmulcahey can you confirm that this is a new message (sl_Status.ZIGBEE_DELIVERY_FAILED: 3074) since bellows 0.40.0 which was bumped into zha 0.0.30 coming with HA Core in 2024.8.1

So that we are not insane 😅 and this message couldn't be seen prior?
(I don't want to blame someone or discuss if that can be ignored, just want to know the cause)

@dmulcahey
Copy link
Contributor

@dmulcahey can you confirm that this is a new message (sl_Status.ZIGBEE_DELIVERY_FAILED: 3074) since bellows 0.40.0 which was bumped into zha 0.0.30 coming with HA Core in 2024.8.1

So that we are not insane 😅 and this message couldn't be seen prior? (I don't want to blame someone or discuss if that can be ignored, just want to know the cause)

#107105 (comment)

this has been happening all along. The only thing that changed is the actual error constant: <EmberStatus.DELIVERY_FAILED: 102> became <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074> other than that this has been happening for years and it is innocuous. You can search closed issues if you don't believe me.

(I don't want to blame someone or discuss if that can be ignored, just want to know the cause)

The cause is the stack failed to deliver the message. There is nothing we can do about that.

@vordenken
Copy link

I too have massive problems with zha (Skyconnect stick on an extension cable) since updating to 2024.8.3 / 13.1...
I did not change anything in my environment, no new devices etc. The biggest problem is that not only the battery powered devices are not working but all of my lightbulbs and smart sockets are broken too. Only reloading zha fixes the issue (temporary)...

Is it safe to downgrade to an older version?
I have a backup as well but then my gathered statistics are gone.

@rwarner
Copy link

rwarner commented Sep 7, 2024

Okay so I’ve been running 2024.8.4 since I last posted and as of yesterday I ran into the same problematic issue I originally ran into earlier. Am getting all sorts of zigbee devices going offline suddenly. I have some new errors in the log here with devices not responding suddenly. Was fine for a few days and then this all happened suddenly. Can’t provide closer debug logs than this at the moment.

image
Logger: zigpy.zcl
Source: runner.py:190
First occurred: September 5, 2024 at 3:14:25 PM (57 occurrences)
Last logged: 3:42:03 PM

[0x6777:1:0x0020] Traceback (most recent call last): File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/bellows/zigbee/application.py", line 822, in send_packet send_status, _ = await req.result ^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zigpy/device.py", line 339, in request await send_request() File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zigpy/application.py", line 833, in request await self.send_packet( File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/bellows/zigbee/application.py", line 821, in send_packet async with asyncio_timeout(APS_ACK_TIMEOUT): File "/home/homeassistant/.pyenv/versions/3.12.2/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/general.py", line 643, in check_in_response await self.checkin_response(True, self.CHECKIN_FAST_POLL_TIMEOUT, tsn=tsn) File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 83, in wrapper with wrap_zigpy_exceptions(): File "/home/homeassistant/.pyenv/versions/3.12.2/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 68, in wrap_zigpy_exceptions raise ZHAException("Failed to send request: device did not respond") from exc zha.exceptions.ZHAException: Failed to send request: device did not respond
[0xADD7:1:0x0020] Traceback (most recent call last): File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zigpy/endpoint.py", line 265, in request return await self.device.request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zigpy/device.py", line 339, in request await send_request() File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zigpy/application.py", line 833, in request await self.send_packet( File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/bellows/zigbee/application.py", line 825, in send_packet raise zigpy.exceptions.DeliveryError( zigpy.exceptions.DeliveryError: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074> The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/general.py", line 643, in check_in_response await self.checkin_response(True, self.CHECKIN_FAST_POLL_TIMEOUT, tsn=tsn) File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 83, in wrapper with wrap_zigpy_exceptions(): File "/home/homeassistant/.pyenv/versions/3.12.2/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 75, in wrap_zigpy_exceptions raise ZHAException(message) from exc zha.exceptions.ZHAException: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>
[0xEC2B:1:0x0020] Traceback (most recent call last): File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zigpy/endpoint.py", line 265, in request return await self.device.request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zigpy/device.py", line 339, in request await send_request() File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zigpy/application.py", line 833, in request await self.send_packet( File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/bellows/zigbee/application.py", line 825, in send_packet raise zigpy.exceptions.DeliveryError( zigpy.exceptions.DeliveryError: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074> The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/general.py", line 643, in check_in_response await self.checkin_response(True, self.CHECKIN_FAST_POLL_TIMEOUT, tsn=tsn) File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 83, in wrapper with wrap_zigpy_exceptions(): File "/home/homeassistant/.pyenv/versions/3.12.2/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 75, in wrap_zigpy_exceptions raise ZHAException(message) from exc zha.exceptions.ZHAException: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>
[0x6777:1:0x0020] Traceback (most recent call last): File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zigpy/endpoint.py", line 265, in request return await self.device.request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zigpy/device.py", line 339, in request await send_request() File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zigpy/application.py", line 833, in request await self.send_packet( File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/bellows/zigbee/application.py", line 825, in send_packet raise zigpy.exceptions.DeliveryError( zigpy.exceptions.DeliveryError: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074> The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/general.py", line 643, in check_in_response await self.checkin_response(True, self.CHECKIN_FAST_POLL_TIMEOUT, tsn=tsn) File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 83, in wrapper with wrap_zigpy_exceptions(): File "/home/homeassistant/.pyenv/versions/3.12.2/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 75, in wrap_zigpy_exceptions raise ZHAException(message) from exc zha.exceptions.ZHAException: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>
[0x6777:1:0x0020] Traceback (most recent call last): File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zigpy/endpoint.py", line 265, in request return await self.device.request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zigpy/device.py", line 339, in request await send_request() File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zigpy/application.py", line 833, in request await self.send_packet( File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/bellows/zigbee/application.py", line 806, in send_packet raise zigpy.exceptions.DeliveryError( zigpy.exceptions.DeliveryError: Failed to enqueue message after 3 attempts: <sl_Status.ZIGBEE_MAX_MESSAGE_LIMIT_REACHED: 3075> The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/general.py", line 643, in check_in_response await self.checkin_response(True, self.CHECKIN_FAST_POLL_TIMEOUT, tsn=tsn) File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 83, in wrapper with wrap_zigpy_exceptions(): File "/home/homeassistant/.pyenv/versions/3.12.2/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/srv/homeassistant/homeassistant_venv_3.12.2/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 75, in wrap_zigpy_exceptions raise ZHAException(message) from exc zha.exceptions.ZHAException: Failed to send request: Failed to enqueue message after 3 attempts: <sl_Status.ZIGBEE_MAX_MESSAGE_LIMIT_REACHED: 3075>
image
Logger: homeassistant.components.automation.morning_reset_all_lights_to_default_brightness
Source: helpers/script.py:2030
integration: Automation (documentation, issues)
First occurred: September 6, 2024 at 1:00:09 PM (6 occurrences)
Last logged: 1:00:45 PM

MORNING - Reset all lights to default brightness: Error executing script. Error for call_service at pos 1: Failed to send request: Failed to enqueue message after 3 attempts: <sl_Status.ZIGBEE_MAX_MESSAGE_LIMIT_REACHED: 3075>
MORNING - Reset all lights to default brightness: Error executing script. Error for call_service at pos 2: Failed to send request: Failed to enqueue message after 3 attempts: <sl_Status.ZIGBEE_MAX_MESSAGE_LIMIT_REACHED: 3075>
MORNING - Reset all lights to default brightness: Error executing script. Error for call_service at pos 3: Failed to send request: Failed to enqueue message after 3 attempts: <sl_Status.ZIGBEE_MAX_MESSAGE_LIMIT_REACHED: 3075>

@hardelone
Copy link

My zigbee is dead. Home assistant sometimes recognize state of entity but I cant control anything. Reboot sw or hw not helping. They are not battery device which I jlhave problem. My smart home is totaly useless. I dont know what to do...

Logger: homeassistant.components.websocket_api.http.connection
Zdroj: components/websocket_api/commands.py:245
Integrácia: Home Assistant WebSocket API (dokumentácia, problémy)
Prvýkrát sa vyskytol: 16:18:44 (1 výskytov)
Naposledy prihlásený: 16:18:44

[140387397687120] Unexpected exception
Traceback (most recent call last):
File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/init.py", line 67, in wrap_zigpy_exceptions
yield
File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/init.py", line 85, in wrapper
return await RETRYABLE_REQUEST_DECORATOR(func)(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/zigpy/util.py", line 136, in retry
return await func()
^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/init.py", line 378, in request
return await self._endpoint.request(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 265, in request
return await self.device.request(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 339, in request
await send_request()
File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 834, in request
await self.send_packet(
File "/usr/local/lib/python3.12/site-packages/bellows/zigbee/application.py", line 827, in send_packet
raise zigpy.exceptions.DeliveryError(
zigpy.exceptions.DeliveryError: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/components/zha/helpers.py", line 1288, in handler
return await func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/components/zha/light.py", line 181, in async_turn_on
await self.entity_data.entity.async_turn_on(
File "/usr/local/lib/python3.12/site-packages/zha/application/platforms/light/init.py", line 413, in async_turn_on
result = await self._on_off_cluster_handler.on()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/init.py", line 84, in wrapper
with wrap_zigpy_exceptions():
File "/usr/local/lib/python3.12/contextlib.py", line 158, in exit
self.gen.throw(value)
File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/init.py", line 76, in wrap_zigpy_exceptions
raise ZHAException(message) from exc
zha.exceptions.ZHAException: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/components/websocket_api/commands.py", line 245, in handle_call_service
response = await hass.services.async_call(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/core.py", line 2761, in async_call
response_data = await coro
^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/core.py", line 2804, in _execute_service
return await target(service_call)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/adaptive_lighting/hass_utils.py", line 62, in service_func_proxy
await existing_service.job.target(call)
File "/usr/src/homeassistant/homeassistant/helpers/service.py", line 996, in entity_service_call
single_response = await _handle_entity_call(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/helpers/service.py", line 1068, in _handle_entity_call
result = await task
^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/components/light/init.py", line 626, in async_handle_light_on_service
await light.async_turn_on(**filter_turn_on_params(light, params))
File "/usr/src/homeassistant/homeassistant/components/zha/helpers.py", line 1290, in handler
raise HomeAssistantError(err) from err
homeassistant.exceptions.HomeAssistantError: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

@TerminalAddict
Copy link

Not cool that I can't turn my lights off at night.
Or on in the morning.
Rebooting HA fixes the problem for a few hours

@dgibbs64
Copy link

dgibbs64 commented Sep 9, 2024

Just wanted to also add the issues since the recent Home Assistant upgrade, My IKEA devices (mainly switches) either don't respond or very delayed. and get the sl_Status.ZIGBEE_DELIVERY_FAILED: 307 error

Edit: Also worth adding that my thermostat is affected as well. It is very difficult to adjust the settings on it....and winter is coming.

@TerminalAddict
Copy link

As per request. debug logging turned on

Logger: homeassistant.core
Source: core.py:2781
First occurred: 10:29:31 AM (5 occurrences)
Last logged: 10:29:35 AM

Error executing service: <ServiceCall light.turn_off (c:01J7CEDF1PDTJZN36794PJZX4D): entity_id=['light.office_lights_light'], params=>
Error executing service: <ServiceCall light.turn_off (c:01J7CEDF1PDTJZN36794PJZX4D): entity_id=['light.shower'], params=>
Error executing service: <ServiceCall light.turn_off (c:01J7CEDF1PDTJZN36794PJZX4D): entity_id=['light.entry_lights'], params=>
Error executing service: <ServiceCall light.turn_off (c:01J7CEDF1PDTJZN36794PJZX4D): entity_id=['light.kitchen_lights'], params=>
Error executing service: <ServiceCall light.turn_off (c:01J7CEDF1PDTJZN36794PJZX4D): entity_id=['light.hallway_lights'], params=>
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 67, in wrap_zigpy_exceptions
    yield
  File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 85, in wrapper
    return await RETRYABLE_REQUEST_DECORATOR(func)(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/util.py", line 136, in retry
    return await func()
           ^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/__init__.py", line 378, in request
    return await self._endpoint.request(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 265, in request
    return await self.device.request(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 339, in request
    await send_request()
  File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 834, in request
    await self.send_packet(
  File "/usr/local/lib/python3.12/site-packages/bellows/zigbee/application.py", line 827, in send_packet
    raise zigpy.exceptions.DeliveryError(
zigpy.exceptions.DeliveryError: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/zha/helpers.py", line 1288, in handler
    return await func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/zha/light.py", line 195, in async_turn_off
    await self.entity_data.entity.async_turn_off(
  File "/usr/local/lib/python3.12/site-packages/zha/application/platforms/light/__init__.py", line 521, in async_turn_off
    result = await self._on_off_cluster_handler.off()
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 84, in wrapper
    with wrap_zigpy_exceptions():
  File "/usr/local/lib/python3.12/contextlib.py", line 158, in __exit__
    self.gen.throw(value)
  File "/usr/local/lib/python3.12/site-packages/zha/zigbee/cluster_handlers/__init__.py", line 76, in wrap_zigpy_exceptions
    raise ZHAException(message) from exc
zha.exceptions.ZHAException: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/core.py", line 2781, in _run_service_call_catch_exceptions
    await coro_or_task
  File "/usr/src/homeassistant/homeassistant/core.py", line 2804, in _execute_service
    return await target(service_call)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/helpers/service.py", line 996, in entity_service_call
    single_response = await _handle_entity_call(
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/helpers/service.py", line 1068, in _handle_entity_call
    result = await task
             ^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/light/__init__.py", line 637, in async_handle_light_off_service
    await light.async_turn_off(**filter_turn_off_params(light, params))
  File "/usr/src/homeassistant/homeassistant/components/zha/helpers.py", line 1290, in handler
    raise HomeAssistantError(err) from err
homeassistant.exceptions.HomeAssistantError: Failed to send request: Failed to deliver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

@barney34
Copy link

+1 started getting this issue out of the blue 2024.9.1 hopefully it was a one time thing.

@oliverhec
Copy link

oliverhec commented Sep 11, 2024

liver message: <sl_Status.ZIGBEE_DELIVERY_FAILED: 3074>

I've experienced this kind of errors while using OTA with ZHA. Downgrading HA did not help that much. Since I've updated the Firmware of my SkyConnect the connection seems to be stable.

@puddly
Copy link
Contributor

puddly commented Sep 11, 2024

For anyone commenting on this issue with logs, please generate them as shown below. The tracebacks you see in /config/logs don't really contain any information, unfortunately.

image

@TerminalAddict
Copy link

TerminalAddict commented Sep 11, 2024

couldn't turn my lights off this morning from a slave switch (a zigbee switch that isn't wired directly to the lights circuit - _TZ3000_ugaem1nb):

{
  "home_assistant": {
    "installation_type": "Home Assistant OS",
    "version": "2024.9.1",
    "dev": false,
    "hassio": true,
    "virtualenv": false,
    "python_version": "3.12.4",
    "docker": true,
    "arch": "x86_64",
    "timezone": "Pacific/Auckland",
    "os_name": "Linux",
    "os_version": "6.6.46-haos",
    "supervisor": "2024.08.0",
    "host_os": "Home Assistant OS 13.1",
    "docker_version": "26.1.4",
    "chassis": "vm",
    "run_as_root": true
  },
  "custom_components": {
    "watchman": {
      "documentation": "https://github.com/dummylabs/thewatchman",
      "version": "0.6.3",
      "requirements": [
        "prettytable==3.10.0"
      ]
    },
    "hacs": {
      "documentation": "https://hacs.xyz/docs/configuration/start",
      "version": "2.0.1",
      "requirements": [
        "aiogithubapi>=22.10.1"
      ]
    },
    "remootio": {
      "documentation": "https://www.home-assistant.io/integrations/remootio",
      "version": "2.0",
      "requirements": [
        "aioremootio @ git+https://github.com/peaceduck/aioremootio"
      ]
    },
    "alarmo": {
      "documentation": "https://github.com/nielsfaber/alarmo",
      "version": "v1.10.4",
      "requirements": []
    },
    "localtuya": {
      "documentation": "https://github.com/rospogrigio/localtuya/",
      "version": "5.2.1",
      "requirements": []
    }
  },
  "integration_manifest": {
    "domain": "zha",
    "name": "Zigbee Home Automation",
    "after_dependencies": [
      "onboarding",
      "usb"
    ],
    "codeowners": [
      "dmulcahey",
      "adminiuga",
      "puddly",
      "TheJulianJES"
    ],
    "config_flow": true,
    "dependencies": [
      "file_upload"
    ],
    "documentation": "https://www.home-assistant.io/integrations/zha",
    "iot_class": "local_polling",
    "loggers": [
      "aiosqlite",
      "bellows",
      "crccheck",
      "pure_pcapy3",
      "zhaquirks",
      "zigpy",
      "zigpy_deconz",
      "zigpy_xbee",
      "zigpy_zigate",
      "zigpy_znp",
      "zha",
      "universal_silabs_flasher"
    ],
    "requirements": [
      "universal-silabs-flasher==0.0.22",
      "zha==0.0.32"
    ],
    "usb": [
      {
        "vid": "10C4",
        "pid": "EA60",
        "description": "*2652*",
        "known_devices": [
          "slae.sh cc2652rb stick"
        ]
      },
      {
        "vid": "10C4",
        "pid": "EA60",
        "description": "*slzb-07*",
        "known_devices": [
          "smlight slzb-07"
        ]
      },
      {
        "vid": "1A86",
        "pid": "55D4",
        "description": "*sonoff*plus*",
        "known_devices": [
          "sonoff zigbee dongle plus v2"
        ]
      },
      {
        "vid": "10C4",
        "pid": "EA60",
        "description": "*sonoff*plus*",
        "known_devices": [
          "sonoff zigbee dongle plus"
        ]
      },
      {
        "vid": "10C4",
        "pid": "EA60",
        "description": "*tubeszb*",
        "known_devices": [
          "TubesZB Coordinator"
        ]
      },
      {
        "vid": "1A86",
        "pid": "7523",
        "description": "*tubeszb*",
        "known_devices": [
          "TubesZB Coordinator"
        ]
      },
      {
        "vid": "1A86",
        "pid": "7523",
        "description": "*zigstar*",
        "known_devices": [
          "ZigStar Coordinators"
        ]
      },
      {
        "vid": "1CF1",
        "pid": "0030",
        "description": "*conbee*",
        "known_devices": [
          "Conbee II"
        ]
      },
      {
        "vid": "0403",
        "pid": "6015",
        "description": "*conbee*",
        "known_devices": [
          "Conbee III"
        ]
      },
      {
        "vid": "10C4",
        "pid": "8A2A",
        "description": "*zigbee*",
        "known_devices": [
          "Nortek HUSBZB-1"
        ]
      },
      {
        "vid": "0403",
        "pid": "6015",
        "description": "*zigate*",
        "known_devices": [
          "ZiGate+"
        ]
      },
      {
        "vid": "10C4",
        "pid": "EA60",
        "description": "*zigate*",
        "known_devices": [
          "ZiGate"
        ]
      },
      {
        "vid": "10C4",
        "pid": "8B34",
        "description": "*bv 2010/10*",
        "known_devices": [
          "Bitron Video AV2010/10"
        ]
      }
    ],
    "zeroconf": [
      {
        "type": "_esphomelib._tcp.local.",
        "name": "tube*"
      },
      {
        "type": "_zigate-zigbee-gateway._tcp.local.",
        "name": "*zigate*"
      },
      {
        "type": "_zigstar_gw._tcp.local.",
        "name": "*zigstar*"
      },
      {
        "type": "_uzg-01._tcp.local.",
        "name": "uzg-01*"
      },
      {
        "type": "_slzb-06._tcp.local.",
        "name": "slzb-06*"
      },
      {
        "type": "_xzg._tcp.local.",
        "name": "xzg*"
      },
      {
        "type": "_czc._tcp.local.",
        "name": "czc*"
      }
    ],
    "is_built_in": true
  },
  "setup_times": {
    "null": {
      "setup": 3.778300001044954e-05
    },
    "fa49229cae0d87878f17c51f696bd3bc": {
      "wait_import_platforms": -0.18912966400000641,
      "wait_base_component": -0.000585119999982453,
      "config_entry_setup": 10.108880099000004
    }
  },
  "data": {
    "config": {},
    "config_entry": {
      "created_at": "1970-01-01T00:00:00+00:00",
      "data": {
        "device": {
          "path": "/dev/serial/by-id/usb-Nabu_Casa_SkyConnect_v1.0_b4d0198438e2ed119e49eb5162c613ac-if00-port0",
          "flow_control": null,
          "baudrate": 115200
        },
        "radio_type": "ezsp"
      },
      "disabled_by": null,
      "domain": "zha",
      "entry_id": "fa49229cae0d87878f17c51f696bd3bc",
      "minor_version": 1,
      "modified_at": "1970-01-01T00:00:00+00:00",
      "options": {},
      "pref_disable_new_entities": false,
      "pref_disable_polling": false,
      "source": "user",
      "title": "SkyConnect v1.0, s/n: b4d0198438e2ed119e49eb5162c613ac - Nabu Casa",
      "unique_id": null,
      "version": 4
    },
    "application_state": {
      "node_info": {
        "nwk": 0,
        "ieee": "**REDACTED**",
        "logical_type": 0,
        "model": "SkyConnect v1.0",
        "manufacturer": "Nabu Casa",
        "version": "7.1.1.0 build 273"
      },
      "network_info": {
        "extended_pan_id": "**REDACTED**",
        "pan_id": 62393,
        "nwk_update_id": 3,
        "nwk_manager_id": 0,
        "channel": 11,
        "channel_mask": 134215680,
        "security_level": 5,
        "network_key": "**REDACTED**",
        "tc_link_key": {
          "key": [
            90,
            105,
            103,
            66,
            101,
            101,
            65,
            108,
            108,
            105,
            97,
            110,
            99,
            101,
            48,
            57
          ],
          "tx_counter": 106496,
          "rx_counter": 0,
          "seq": 0,
          "partner_ieee": "**REDACTED**"
        },
        "key_table": [],
        "children": [],
        "nwk_addresses": {},
        "stack_specific": {
          "ezsp": {
            "hashed_tclk": "6e6c43ab05dc38a98b6812c7f01612ca"
          }
        },
        "metadata": {
          "ezsp": {
            "stack_version": 9,
            "can_burn_userdata_custom_eui64": true,
            "can_rewrite_custom_eui64": false
          }
        },
        "source": "bellows@0.40.5"
      },
      "counters": {
        "ezsp_counters": {
          "MAC_RX_BROADCAST": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='MAC_RX_BROADCAST', _raw_value=3189, reset_count=30, _last_reset_value=102058)"
          },
          "MAC_TX_BROADCAST": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='MAC_TX_BROADCAST', _raw_value=294, reset_count=30, _last_reset_value=11190)"
          },
          "MAC_RX_UNICAST": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='MAC_RX_UNICAST', _raw_value=2478, reset_count=30, _last_reset_value=82666)"
          },
          "MAC_TX_UNICAST_SUCCESS": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='MAC_TX_UNICAST_SUCCESS', _raw_value=1681, reset_count=30, _last_reset_value=57473)"
          },
          "MAC_TX_UNICAST_RETRY": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='MAC_TX_UNICAST_RETRY', _raw_value=161, reset_count=30, _last_reset_value=10634)"
          },
          "MAC_TX_UNICAST_FAILED": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='MAC_TX_UNICAST_FAILED', _raw_value=17, reset_count=30, _last_reset_value=1170)"
          },
          "APS_DATA_RX_BROADCAST": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='APS_DATA_RX_BROADCAST', _raw_value=1, reset_count=30, _last_reset_value=125)"
          },
          "APS_DATA_TX_BROADCAST": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='APS_DATA_TX_BROADCAST', _raw_value=1, reset_count=30, _last_reset_value=125)"
          },
          "APS_DATA_RX_UNICAST": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='APS_DATA_RX_UNICAST', _raw_value=1550, reset_count=30, _last_reset_value=47520)"
          },
          "APS_DATA_TX_UNICAST_SUCCESS": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='APS_DATA_TX_UNICAST_SUCCESS', _raw_value=795, reset_count=30, _last_reset_value=28616)"
          },
          "APS_DATA_TX_UNICAST_RETRY": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='APS_DATA_TX_UNICAST_RETRY', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "APS_DATA_TX_UNICAST_FAILED": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='APS_DATA_TX_UNICAST_FAILED', _raw_value=1, reset_count=30, _last_reset_value=229)"
          },
          "ROUTE_DISCOVERY_INITIATED": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='ROUTE_DISCOVERY_INITIATED', _raw_value=48, reset_count=30, _last_reset_value=1895)"
          },
          "NEIGHBOR_ADDED": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='NEIGHBOR_ADDED', _raw_value=0, reset_count=30, _last_reset_value=10)"
          },
          "NEIGHBOR_REMOVED": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='NEIGHBOR_REMOVED', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "NEIGHBOR_STALE": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='NEIGHBOR_STALE', _raw_value=3, reset_count=30, _last_reset_value=163)"
          },
          "JOIN_INDICATION": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='JOIN_INDICATION', _raw_value=0, reset_count=30, _last_reset_value=1)"
          },
          "CHILD_REMOVED": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='CHILD_REMOVED', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "ASH_OVERFLOW_ERROR": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='ASH_OVERFLOW_ERROR', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "ASH_FRAMING_ERROR": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='ASH_FRAMING_ERROR', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "ASH_OVERRUN_ERROR": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='ASH_OVERRUN_ERROR', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "NWK_FRAME_COUNTER_FAILURE": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='NWK_FRAME_COUNTER_FAILURE', _raw_value=0, reset_count=30, _last_reset_value=35)"
          },
          "APS_FRAME_COUNTER_FAILURE": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='APS_FRAME_COUNTER_FAILURE', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "UTILITY": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='UTILITY', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "APS_LINK_KEY_NOT_AUTHORIZED": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='APS_LINK_KEY_NOT_AUTHORIZED', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "NWK_DECRYPTION_FAILURE": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='NWK_DECRYPTION_FAILURE', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "APS_DECRYPTION_FAILURE": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='APS_DECRYPTION_FAILURE', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "ALLOCATE_PACKET_BUFFER_FAILURE": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='ALLOCATE_PACKET_BUFFER_FAILURE', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "RELAYED_UNICAST": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='RELAYED_UNICAST', _raw_value=0, reset_count=30, _last_reset_value=2)"
          },
          "PHY_TO_MAC_QUEUE_LIMIT_REACHED": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='PHY_TO_MAC_QUEUE_LIMIT_REACHED', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "PACKET_VALIDATE_LIBRARY_DROPPED_COUNT": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='PACKET_VALIDATE_LIBRARY_DROPPED_COUNT', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "TYPE_NWK_RETRY_OVERFLOW": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='TYPE_NWK_RETRY_OVERFLOW', _raw_value=0, reset_count=30, _last_reset_value=1)"
          },
          "PHY_CCA_FAIL_COUNT": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='PHY_CCA_FAIL_COUNT', _raw_value=6, reset_count=30, _last_reset_value=311)"
          },
          "BROADCAST_TABLE_FULL": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='BROADCAST_TABLE_FULL', _raw_value=0, reset_count=30, _last_reset_value=52)"
          },
          "PTA_LO_PRI_REQUESTED": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='PTA_LO_PRI_REQUESTED', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "PTA_HI_PRI_REQUESTED": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='PTA_HI_PRI_REQUESTED', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "PTA_LO_PRI_DENIED": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='PTA_LO_PRI_DENIED', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "PTA_HI_PRI_DENIED": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='PTA_HI_PRI_DENIED', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "PTA_LO_PRI_TX_ABORTED": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='PTA_LO_PRI_TX_ABORTED', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "PTA_HI_PRI_TX_ABORTED": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='PTA_HI_PRI_TX_ABORTED', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "ADDRESS_CONFLICT_SENT": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='ADDRESS_CONFLICT_SENT', _raw_value=0, reset_count=30, _last_reset_value=0)"
          },
          "EZSP_FREE_BUFFERS": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='EZSP_FREE_BUFFERS', _raw_value=249, reset_count=30, _last_reset_value=0)"
          }
        },
        "controller_app_counters": {
          "unicast_rx": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='unicast_rx', _raw_value=49069, reset_count=0, _last_reset_value=0)"
          },
          "unicast_tx_success": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='unicast_tx_success', _raw_value=29411, reset_count=0, _last_reset_value=0)"
          },
          "broadcast_tx_success_unexpected": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='broadcast_tx_success_unexpected', _raw_value=126, reset_count=0, _last_reset_value=0)"
          },
          "broadcast_rx": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='broadcast_rx', _raw_value=121, reset_count=0, _last_reset_value=0)"
          },
          "unicast_tx_failure": {
            "__type": "<class 'zigpy.state.Counter'>",
            "repr": "Counter(name='unicast_tx_failure', _raw_value=230, reset_count=0, _last_reset_value=0)"
          }
        }
      },
      "broadcast_counters": {},
      "device_counters": {},
      "group_counters": {}
    },
    "energy_scan": {
      "11": 39.90320178295578,
      "12": 3.6632469452765037,
      "13": 4.69985354430736,
      "14": 3.2311094587038967,
      "15": 65.26028270288712,
      "16": 4.69985354430736,
      "17": 19.00785284282869,
      "18": 3.2311094587038967,
      "19": 1.7132450748239665,
      "20": 17.086630587133605,
      "21": 23.33483723001185,
      "22": 33.860880820104335,
      "23": 46.26944564832987,
      "24": 25.74050169409602,
      "25": 1.1664179210724432,
      "26": 88.70042934643088
    },
    "versions": {
      "bellows": "0.40.5",
      "zigpy": "0.66.0",
      "zigpy_deconz": "0.23.3",
      "zigpy_xbee": "0.20.2",
      "zigpy_znp": "0.12.4",
      "zigpy_zigate": "0.13.1",
      "zhaquirks": "0.0.121",
      "zha": "0.0.32"
    },
    "devices": [
      {
        "manufacturer": "Nabu Casa",
        "model": "SkyConnect v1.0",
        "logical_type": "Coordinator"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_ugaem1nb",
        "model": "TS0012",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_ugaem1nb",
        "model": "TS0012",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_ugaem1nb",
        "model": "TS0012",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_ugaem1nb",
        "model": "TS0012",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_bmzfjnbp",
        "model": "TS0011",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_1bwpjvlz",
        "model": "TS0203",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "Schneider Electric",
        "model": "CH/DIMMER/1",
        "logical_type": "Router"
      },
      {
        "manufacturer": "Schneider Electric",
        "model": "CH/DIMMER/1",
        "logical_type": "Router"
      },
      {
        "manufacturer": "_TZ3000_cehuw1lw",
        "model": "TS011F",
        "logical_type": "Router"
      },
      {
        "manufacturer": "_TZE200_bh3n6gk8",
        "model": "TS0601",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_cehuw1lw",
        "model": "TS011F",
        "logical_type": "Router"
      },
      {
        "manufacturer": "_TZ3000_cehuw1lw",
        "model": "TS011F",
        "logical_type": "Router"
      },
      {
        "manufacturer": "_TZE200_bh3n6gk8",
        "model": "TS0601",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZE200_bh3n6gk8",
        "model": "TS0601",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZE200_bh3n6gk8",
        "model": "TS0601",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZE200_bh3n6gk8",
        "model": "TS0601",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_cehuw1lw",
        "model": "TS011F",
        "logical_type": "Router"
      },
      {
        "manufacturer": "_TZ3000_wkai4ga5",
        "model": "TS0044",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_cehuw1lw",
        "model": "TS011F",
        "logical_type": "Router"
      },
      {
        "manufacturer": "_TZ3000_cehuw1lw",
        "model": "TS011F",
        "logical_type": "Router"
      },
      {
        "manufacturer": "_TZ3000_cehuw1lw",
        "model": "TS011F",
        "logical_type": "Router"
      },
      {
        "manufacturer": "Signify Netherlands B.V.",
        "model": "RDM002",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3000_cehuw1lw",
        "model": "TS011F",
        "logical_type": "Router"
      },
      {
        "manufacturer": "Signify Netherlands B.V.",
        "model": "RDM002",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZ3210_3ulg9kpo",
        "model": "TS0021",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZE200_bh3n6gk8",
        "model": "TS0601",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "_TZE200_bh3n6gk8",
        "model": "TS0601",
        "logical_type": "EndDevice"
      },
      {
        "manufacturer": "frient A/S",
        "model": "KEPZB-110",
        "logical_type": "EndDevice"
      }
    ]
  }
}

@brussene
Copy link

I seem to have the same problem. First I thought it was down to the quirk I used for one particular Aqara light, but after disabling quirks the problem (slow/failing zigbee network after a couple of hours) still persists. Only restarting the ZHA integration or HA all together helps.

Context information:

Home Assistant:
Core 2024.9.1
Supervisor 2024.09.1
Operating System 13.1
Frontend 20240906.0

ZHA with Sonoff Zigbee 3.0 USB Dongle E (EFR32MG21)
running firmware version: 7.4.3.0 build 0 (SiLabs)

see also: https://github.com/home-assistant/core/issues/125789#issuecomment-2347326713

@rwarner
Copy link

rwarner commented Sep 13, 2024

Coming back to this, still on 2024.8.4 however I rebooted like a few people noted and can concur that this fixes things for now again. If I get the timeouts and errors I've been seeing I'll try to grab debug logs. Also hoping to update to a 2024.9.x soon and see if this issues persist

@ecchodun
Copy link
Author

I've not received this error now in over a week. I did change the channel of my ZHA Hub to 24. The error just eventually stopped showing up. Perhaps it was interference that has now somehow subsided. Not completely sure.

@brussene
Copy link

Did a restart of ZHA and ran a debug log for a couple of hours and stopped it when ZHA became unresponsive again.
Towards the end of the logfile I am seeing this:

2024-09-13 20:54:04.602 DEBUG (MainThread) [zigpy.application] Max concurrency (8) reached, delaying request (66 enqueued)
2024-09-13 20:54:04.602 DEBUG (Thread-12) [aiosqlite] executing functools.partial(<built-in method execute of sqlite3.Connection object at 0x7f900d35c9a0>, 'UPDATE devices_v13\n                    SET last_seen=:ts\n                    WHERE ieee=:ieee AND :ts - last_seen > :min_update_delta', {'ts': 1726253644.600438, 'ieee': 84:b4:db:ff:fe:67:f9:82, 'min_update_delta': 30.0})
2024-09-13 20:54:04.604 DEBUG (Thread-12) [aiosqlite] operation functools.partial(<built-in method execute of sqlite3.Connection object at 0x7f900d35c9a0>, 'UPDATE devices_v13\n                    SET last_seen=:ts\n                    WHERE ieee=:ieee AND :ts - last_seen > :min_update_delta', {'ts': 1726253644.600438, 'ieee': 84:b4:db:ff:fe:67:f9:82, 'min_update_delta': 30.0}) completed
2024-09-13 20:54:04.606 DEBUG (Thread-12) [aiosqlite] executing functools.partial(<built-in method commit of sqlite3.Connection object at 0x7f900d35c9a0>)
2024-09-13 20:54:04.607 DEBUG (Thread-12) [aiosqlite] operation functools.partial(<built-in method commit of sqlite3.Connection object at 0x7f900d35c9a0>) completed
2024-09-13 20:54:05.591 DEBUG (bellows.thread_0) [bellows.ash] Received data 726ab1a96b2a7d334fa6944a25aa559249984e27b412ce6763e17e
2024-09-13 20:54:05.591 DEBUG (bellows.thread_0) [bellows.ash] Received frame DataFrame(frm_num=7, re_tx=0, ack_num=2, ezsp_frame=b'(\x90\x01?\x00\x06\xfd\xff\x00\x00\x00\x00\x00\x00\x00\x04\x00\x00\x1f\xff\x00\x00')
2024-09-13 20:54:05.591 DEBUG (bellows.thread_0) [bellows.ash] Sending frame AckFrame(res=0, ncp_ready=0, ack_num=0) + FLAG
2024-09-13 20:54:05.592 DEBUG (bellows.thread_0) [bellows.ash] Sending data  8070787e
2024-09-13 20:54:05.593 DEBUG (MainThread) [bellows.ezsp.protocol] Received command messageSentHandler: {'type': <EmberOutgoingMessageType.OUTGOING_BROADCAST: 6>, 'indexOrDestination': 65533, 'apsFrame': EmberApsFrame(profileId=0, clusterId=0, sourceEndpoint=0, destinationEndpoint=0, options=<EmberApsOption.APS_OPTION_SOURCE_EUI64: 1024>, groupId=0, sequence=31), 'messageTag': 255, 'status': <EmberStatus.SUCCESS: 0>, 'messageContents': b''}
2024-09-13 20:54:05.594 DEBUG (MainThread) [bellows.zigbee.application] Received messageSentHandler frame with [<EmberOutgoingMessageType.OUTGOING_BROADCAST: 6>, 65533, EmberApsFrame(profileId=0, clusterId=0, sourceEndpoint=0, destinationEndpoint=0, options=<EmberApsOption.APS_OPTION_SOURCE_EUI64: 1024>, groupId=0, sequence=31), 255, <EmberStatus.SUCCESS: 0>, b'']
2024-09-13 20:54:05.594 DEBUG (MainThread) [bellows.zigbee.application] Unexpected message send notification tag: (65533, 255)
2024-09-13 20:54:05.619 DEBUG (bellows.thread_0) [bellows.ash] Received data 026ab1a96b2a152283944a252a5592099c4e278554a867219a7e
2024-09-13 20:54:05.620 DEBUG (bellows.thread_0) [bellows.ash] Received frame DataFrame(frm_num=0, re_tx=0, ack_num=2, ezsp_frame=b'(\x90\x01?\x00\x00\x90\xda\x00\x00\x00\x80\x00\x00@\x00\x00\x00.\xb9f\x00')
2024-09-13 20:54:05.620 DEBUG (bellows.thread_0) [bellows.ash] Sending frame AckFrame(res=0, ncp_ready=0, ack_num=1) + FLAG
2024-09-13 20:54:05.620 DEBUG (bellows.thread_0) [bellows.ash] Sending data  8160597e
2024-09-13 20:54:05.621 DEBUG (MainThread) [bellows.ezsp.protocol] Received command messageSentHandler: {'type': <EmberOutgoingMessageType.OUTGOING_DIRECT: 0>, 'indexOrDestination': 55952, 'apsFrame': EmberApsFrame(profileId=0, clusterId=32768, sourceEndpoint=0, destinationEndpoint=0, options=<EmberApsOption.APS_OPTION_RETRY: 64>, groupId=0, sequence=46), 'messageTag': 185, 'status': <EmberStatus.DELIVERY_FAILED: 102>, 'messageContents': b''}
2024-09-13 20:54:05.621 DEBUG (MainThread) [bellows.zigbee.application] Received messageSentHandler frame with [<EmberOutgoingMessageType.OUTGOING_DIRECT: 0>, 55952, EmberApsFrame(profileId=0, clusterId=32768, sourceEndpoint=0, destinationEndpoint=0, options=<EmberApsOption.APS_OPTION_RETRY: 64>, groupId=0, sequence=46), 185, <EmberStatus.DELIVERY_FAILED: 102>, b'']
2024-09-13 20:54:05.625 DEBUG (MainThread) [zigpy.application] Previously delayed request is now running, delayed by 191.60s

Requests are getting queued and are running delayed?
Which is an accurate description of the symptoms I and the rest of my not so happy family are seeing when we try to turn or off a light.

Have the full log file available if needed, but it is 62 MB...

@dmulcahey
Copy link
Contributor

Zip the log and attach it here

@brussene
Copy link

@puddly
Copy link
Contributor

puddly commented Sep 14, 2024

The error just eventually stopped showing up. Perhaps it was interference that has now somehow subsided.

I would stay away from channel 24. It overlaps directly with WiFi channel 6 and if you have any APs in the vicinity that can automatically pick channels, it's only a matter of time before it does.

Requests are getting queued and are running delayed?

From your log, there is a constant stream of network address requests coming from a couple of devices on your network (mostly 0xf137 and 0xe6f0). These requests are being sent very quickly but the devices aren't listening for a response, causing requests to queue up.

Please open a separate issue and attach the same log file, your issue isn't related to this one.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
integration: zha waiting-for-diagnostics https://www.home-assistant.io/docs/configuration/troubleshooting/#debug-logs-and-diagnostics
Projects
None yet
Development

No branches or pull requests