Ikea integration needs to be reloaded every morning #56141

carloss66 · 2021-09-12T16:24:35Z

The problem

I have scripts to turn on or off Ikea light bulbs. One example is the Good Morning script. This script now fails to turn on the Ikea bulbs every morning. Nothing else Ikea related works in the morning, and the bulbs are greyed out in the HA user interface. For things to go back to normal, I have manually to reload the Ikea integration. That allows the integration to work until the end of the day, but the problem is back in the morning. The problem started with core-2021.9.1.

What is version of Home Assistant Core has the issue?

core-2021.9.6

What was the last working version of Home Assistant Core?

core-2021.8.8

What type of installation are you running?

Home Assistant OS

Integration causing the issue

IKEA TRÅDFRI

Link to integration documentation on our website

https://www.home-assistant.io/integrations/tradfri/

Example YAML snippet

alias: Good Morning
sequence:
  - data:
      entity_id: input_boolean.night_mode
    service: input_boolean.turn_off
  - data:
      entity_id: input_boolean.home_mode
    service: input_boolean.turn_on
  - data:
      brightness_pct: 15
      kelvin: 2700
    service: light.turn_on
    target:
      entity_id:
        - light.master_bedroom_left_lamp
        - light.master_bedroom_right_lamp
  - data:
      transition: 300
      brightness_pct: 75
    service: light.turn_on
    target:
      entity_id:
        - light.master_bedroom_left_lamp
        - light.master_bedroom_right_lamp
  - data:
      kelvin: 2700
      brightness_pct: 50
    service: light.turn_on
    target:
      entity_id:
        - light.living_room_left_lamp
        - light.living_room_right_lamp
  - service: switch.turn_on
    target:
      entity_id:
        - switch.kitchen_plug
        - switch.living_room_plug
mode: single

Anything in the logs that might be useful for us?

No response

Additional information

No response

probot-home-assistant · 2021-09-12T16:24:38Z

Hey there @janiversen, mind taking a look at this issue as it has been labeled with an integration (tradfri) you are listed as a code owner for? Thanks!
_{^{(message by CodeOwnersMention)}}

tradfri documentation
tradfri source
_{^{(message by IssueLinks)}}

janiversen · 2021-09-12T21:04:40Z

there must be an error of some kind in the log, without a hint it is not possible to locate the problem.

carloss66 · 2021-09-13T10:39:35Z

Logger: homeassistant.components.tradfri.base_class
Source: components/tradfri/base_class.py:24
Integration: IKEA TRÅDFRI (documentation, issues)
First occurred: 5:34:18 AM (1 occurrences)
Last logged: 5:34:18 AM

Unable to execute command <Command put ['15001', 65588]: {'3311': [{'5851': 38, '5708': 42861, '5707': 5168}]}>: ('There was an error with the request.', CredentialsMissingError('No suitable credentials for coaps://192.168.50.226:5684/15001/65588'))

janiversen · 2021-09-13T14:28:19Z

And that command works during the day? seems like a setup problems, that it does not have the IKEA gateway security code.

carloss66 · 2021-09-13T14:38:27Z

Yes that commands works perfectly after restarting the integration every morning. The changes in the September update broke this somehow since it was working fine before the update. I deleted and reinstalled the integration. Tomorrow morning I will find out if that fixes the problem.

janiversen · 2021-09-13T17:55:22Z

Problem is that I cannot see any relevant commits between 2021.8.8 - 2021.9.6
No real code changes, no library updates.
The only potential change seems to be sn IKEA gateway firmware update.

carloss66 · 2021-09-14T11:36:23Z

I understand. I just wanted to let you know that deleting and reinstalling the integration did not fix the problem. I still get the same error. As a workaround, I will create an automation to restart the HA core every morning.

janiversen · 2021-09-14T13:41:13Z

I am working on a fix that does it automatically, but it will take some time before it is in a release, so please use automation.

jkushner90 · 2021-10-13T00:49:23Z

As a work around until this issue is resolved I have resorted to using the homekit controller plugin to control the blinds. I tried pairing directly in ZHA but had many issues with slowness with the blinds. Ended up simply pairing the Tradfi hub via homekit instead. Was able to replicate my issue very easily by unplugging the ikea hub. HA would become unresponsive until I restarted the ikea integration. Just tested and that is still happening but the blinds continues to work via the homekit integration. Sorry if this has been discussed before but hoping it can help others in similar situation.

carloss66 · 2021-10-14T14:50:12Z

The comment from jkushner90 made me realize what is causing the problem. If the Tradfri hub loses power or connectivity to the network, the HA integration stops working and needs to be reloaded. In my case I found that the factory settings on my Asus router were configured to reboot the router every day at midnight. That was causing the Ikea integration to stop working every morning. I now reboot the router only on Sundays at midnight and shortly after restart the HA core. No problems since I started doing that.

jkushner90 · 2021-10-14T15:55:57Z

I’m glad the info helped! Hit on the exact topic in a way on a different issue thread. 42563# . Wrote about how low end routers could be causing issues with this integration. Just a dropped connection seems to kill the service. If you are looking to test some other options out I would highly recommend the HomeKit plugin. Very easy to setup with the ikea hub and also gives battery status working very well. Not sure I’ll even switch back when this is up and running but time will tell.

janiversen · 2021-10-14T16:12:14Z

Seems I now have something testable, which makes it factors easier to make a bug fix.

JvDrunen · 2021-11-02T11:52:16Z

any updates? i am having the same issues. but i need to reload the integration several times a day.
i noticed that this issues got more worse after the latest update from ikea
https://ww8.ikea.com/ikeahomesmart/releasenotes/releasenotes.html

Mariusthvdb · 2021-11-02T11:59:23Z

experiencing the same thing, thought it to be the latest dev/beta cycle, as posted in Discord #beta.

2021-11-01 22:53:42 WARNING (MainThread) [pytradfri.api.aiocoap_api] Protocol is shutdown, cancelling command: 192.168.1.99 <Command get ['15011', '15012']>
2021-11-01 22:53:43 ERROR (MainThread) [homeassistant.components.tradfri.base_class] Unable to execute command <Command put ['15001', 65641]: {'3312': [{'5850': 0}]}>: ('There was an error with the request.', CredentialsMissingError('No suitable credentials for coaps://192.168.1.99:5684/15001/65641'))

showing regularly in the logs

JvDrunen · 2021-11-02T12:10:35Z

my logs:

`
021-10-31 22:36:48 ERROR (MainThread) [homeassistant] Error doing job: Task exception was never retrieved
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/components/tradfri/base_class.py", line 37, in wrapper
await func(command)
File "/usr/local/lib/python3.9/site-packages/pytradfri/api/aiocoap_api.py", line 168, in request
result = await self._execute(api_commands)
File "/usr/local/lib/python3.9/site-packages/pytradfri/api/aiocoap_api.py", line 122, in _execute
await self._observe(api_command)
File "/usr/local/lib/python3.9/site-packages/pytradfri/api/aiocoap_api.py", line 185, in _observe
pr, r = await self._get_response(msg)
File "/usr/local/lib/python3.9/site-packages/pytradfri/api/aiocoap_api.py", line 96, in _get_response
r = await pr.response
File "/usr/local/lib/python3.9/site-packages/aiocoap/protocol.py", line 731, in _run_outer
await cls._run(app_request, response, weak_observation, protocol, log)
File "/usr/local/lib/python3.9/site-packages/aiocoap/protocol.py", line 783, in _run
blockresponse = await blockrequest.response
aiocoap.error.LibraryShutdown

2021-10-31 22:36:48 WARNING (MainThread) [pytradfri.api.aiocoap_api] Protocol is shutdown, cancelling command: 172.30.55.14 <Command get ['15011', '15012']>
....
2021-10-31 22:36:48 WARNING (MainThread) [pytradfri.api.aiocoap_api] Protocol is shutdown, cancelling command: 172.30.55.14 <Command put ['15001', 65545]: {'3311': [{'5850': 1}]}>
.....
2021-10-31 22:36:48 ERROR (MainThread) [homeassistant.components.tradfri.base_class] Unable to execute command <Command put ['15001', 65554]: {'3311': [{'5850': 1}]}>: ('There was an error with the request.', CredentialsMissingError('No suitable credentials for coaps://5684/15001/65554'))
`

carloss66 · 2021-11-02T15:18:36Z

I can confirm that the latest Ikea update made this situation worse, the integration now breaks many times a day. Yesterday I installed the Hoobs 3.3.5 docker image, moved the Ikea bulbs there, and then used the Homekit Controller integration to get the bulbs back on HA. So far so good.

janiversen · 2021-11-02T21:02:39Z

@Mariusthvdb 2021.11 should actually catch this and restart the protocol automatically after about 1minute.

janiversen · 2021-11-02T21:05:39Z

@JvDrunen you probably have had a network problem that caused the shutdown (there should be something earlier in the log).

Just for information my production installation have now run for 2 weeks without a single down period.

Mariusthvdb · 2021-11-02T21:38:55Z

@Mariusthvdb 2021.11 should actually catch this and restart the protocol automatically after about 1minute.

I do hope so, although I started getting these issues while on dev 2021.11 ...

Mariusthvdb · 2021-11-03T06:37:02Z

well, definitely no automatic restarts whatsoever. Manual is the only way this gets (temporarily) fixed.

maybe this needs to be logged at the pytradfri library too:

how come there's no issue open there.. fixed that ;-)

JvDrunen · 2021-11-03T09:50:00Z

@JvDrunen you probably have had a network problem that caused the shutdown (there should be something earlier in the log).

Just for information my production installation have now run for 2 weeks without a single down period.

No Network issues on my side.
i have Cleaned all files and configs from Hass. (leftover config file and yaml entry)
also removed the integration and rebooted.
After that i re-added the integration again. (gui only)
This morning the lights where still responding.
So i will wait if the error comes back again.

peltsippi · 2021-11-03T15:32:11Z

Having this issue also. Seemed to correlate with latest IKEA gateway software update. Need to restart integration multiple times a day.

Gateway SW 1.16.26

JvDrunen · 2021-11-03T15:44:46Z

@JvDrunen you probably have had a network problem that caused the shutdown (there should be something earlier in the log).
Just for information my production installation have now run for 2 weeks without a single down period.

No Network issues on my side. i have Cleaned all files and configs from Hass. (leftover config file and yaml entry) also removed the integration and rebooted. After that i re-added the integration again. (gui only) This morning the lights where still responding. So i will wait if the error comes back again.

No fix. Still needs to reload multiple time

peltsippi · 2021-11-03T19:37:20Z

Having this issue also. Seemed to correlate with latest IKEA gateway software update. Need to restart integration multiple times a day.

Gateway SW 1.16.26

I just checked and integration was cleanly added from GUI, nothing in config files and so on.

Not sure if Ikea sw updates are rolled out gradually and IMHO without gateway sw version info narrowing down the problem will be really hard.

carloss66 · 2021-11-05T13:22:11Z

Release 21.11.0 fixed this problem.

Mariusthvdb · 2021-11-05T13:47:59Z

tbh, I fear not....

as a matter of fact I have been experiencing more and more startup issue too now:

2021-11-05 11:43:25 WARNING (MainThread) [homeassistant.bootstrap] Waiting on integrations to complete setup: tradfri
2021-11-05 11:44:25 WARNING (MainThread) [homeassistant.bootstrap] Waiting on integrations to complete setup: tradfri
2021-11-05 11:45:25 WARNING (MainThread) [homeassistant.bootstrap] Waiting on integrations to complete setup: tradfri
2021-11-05 11:45:44 WARNING (MainThread) [homeassistant.bootstrap] Setup timed out for stage 2 - moving forward
2021-11-05 11:46:30 WARNING (MainThread) [homeassistant.bootstrap] Waiting on integrations to complete setup: tradfri
2021-11-05 11:47:30 WARNING (MainThread) [homeassistant.bootstrap] Waiting on integrations to complete setup: tradfri
2021-11-05 11:48:30 WARNING (MainThread) [homeassistant.bootstrap] Waiting on integrations to complete setup: tradfri

keeping the complete startup in a stranglehold. Only to be released after more than 10 minutes.... Not on each restart though, so a bit hard to analyze

yep.confirmed again: still there, seems to be getting worse on 2021.12 dev. really troublesome this is becoming.

Shouldn't we upscale this issue somehow? a major core integration being so flawed it is practically starting to be utmost unreliable should trigger core dev attention.

janiversen · 2021-11-12T10:31:19Z

Can we please stop this #metoo, if you want to report a bug, please do it properly according to our template….these comments do not help anybody on the contrary !

Please remember we are a bunch of volunteers, and the big majority of volunteers submit a PR because they have an itch (bug) which they solve. Precious few care about helping in general.

I too am a volunteer, and I try (sometimes very hard) to help users that have a problem when I see they try to help solve the problem. Users that claim #metoo or submit messagees without logs etc are noise that makes me put the issue on hold and do something more rewarding.

So maybe keep the noise in the forum, and let the content here be based on fact like logs etc.

just my 2cent.

janiversen · 2021-11-12T10:33:59Z

Sorry for the non-fact based message, but I am seriously considering leaving the tradfri integration, and do more rewarding tasks.

Mariusthvdb · 2021-11-13T14:33:18Z

there is definitely something odd going on. yesterday my Tradfri system was not responding, even to commands in the Tradfri app. I was able to reload the integration in HA. After which the Tradfri app could control the devices back again. Couldn't find anything in the logs at that time.

Today something a like happened, but now I saw this in the HA log:

2021-11-13 14:12:56 ERROR (MainThread) [homeassistant] Error doing job: Task exception was never retrieved
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/tradfri/__init__.py", line 141, in async_keep_alive
    await api(gateway.get_gateway_info())
  File "/usr/local/lib/python3.9/site-packages/pytradfri/api/aiocoap_api.py", line 198, in request
    result = await self._execute(api_commands)
  File "/usr/local/lib/python3.9/site-packages/pytradfri/api/aiocoap_api.py", line 166, in _execute
    _, res = await self._get_response(msg)
  File "/usr/local/lib/python3.9/site-packages/pytradfri/api/aiocoap_api.py", line 106, in _get_response
    pr_resp = await pr_req.response
  File "/usr/local/lib/python3.9/site-packages/aiocoap/protocol.py", line 731, in _run_outer
    await cls._run(app_request, response, weak_observation, protocol, log)
  File "/usr/local/lib/python3.9/site-packages/aiocoap/protocol.py", line 783, in _run
    blockresponse = await blockrequest.response
  File "/usr/local/lib/python3.9/site-packages/aiocoap/protocol.py", line 313, in send
    request_interface.request(plumbing_request)
  File "/usr/local/lib/python3.9/site-packages/aiocoap/tokenmanager.py", line 243, in request
    self.outgoing_requests[key] = request
TypeError: 'NoneType' object does not support item assignment

dont think this error was posted already here?

this was a more serious issue though because I had to restart the Tradfri bridge. without that, the app nor the HA integration were able to control the devices. The 3 leds on the bridge were lit ok.

Hope this helps and adds to the issue

Mariusthvdb · 2021-11-13T16:18:07Z

Happening again, no way to
control Tradfri either in App or Ha. Tradfri app won't even pass the initial connecting screen.

logged:

Logger: homeassistant.components.tradfri.base_class
Source: components/tradfri/base_class.py:41
Integration: IKEA TRÅDFRI (documentation, issues)
First occurred: 17:03:18 (4 occurrences)
Last logged: 17:08:07

Unable to execute command <Command put ['15001', 65641]: {'3312': [{'5850': 1}]}>: {"r":"07"}
Unable to execute command <Command put ['15001', 65719]: {'3311': [{'5850': 1}]}>: ('There was an error with the request.', CredentialsMissingError('No suitable credentials for coaps://192.168.1.99:5684/15001/65719'))
Unable to execute command <Command put ['15001', 65720]: {'15025': [{'5900': 50}]}>: ('There was an error with the request.', CredentialsMissingError('No suitable credentials for coaps://192.168.1.99:5684/15001/65720'))
Unable to execute command <Command put ['15001', 65641]: {'3312': [{'5850': 1}]}>: ('There was an error with the request.', CredentialsMissingError('No suitable credentials for coaps://192.168.1.99:5684/15001/65641'))

Could reload Tradfri integration in Ha: App comes back, Ha ok again.

The Ha Tradfri integration keeps the full Tradfri system from operating at the moment.

This is Ha 2021.11.3

Getting worse by the day.

janiversen · 2021-11-13T18:08:19Z

Actually it tells you what the problem are
“ No suitable credentials for coaps://192.168.1.99”
did the ikea gateway change ip address?
It is very likely the same problem with the app.

It might be worse every day, especially since I am taking a break from the integration, after my last 2 PR (that would have solved the reload) was in reality rejected. Maybe another developer will take over.

peltsippi · 2021-11-13T20:16:56Z

Actually it tells you what the problem are “ No suitable credentials for coaps://192.168.1.99” did the ikea gateway change ip address? It is very likely the same problem with the app.

I am having same errors and my IKEA gateway has fixed ip configured on my internal DHCP.

Had to reboot ha 3 times today in a row before all started working again.

Ps I am really sorry that your PRs got rejected. I really appreciate your effort for trying to fix this quickly.

Mariusthvdb · 2021-11-13T22:07:17Z

And yet again, now showing

Logger: pytradfri.api.aiocoap_api
Source: /usr/local/lib/python3.9/site-packages/pytradfri/api/aiocoap_api.py:168 
First occurred: 17:08:07 (11 occurrences) 
Last logged: 23:04:46

Protocol is shutdown, cancelling command: 192.168.1.99 <Command put ['15001', 65709]: {'3311': [{'5850': 0}]}>
Protocol is shutdown, cancelling command: 192.168.1.99 <Command put ['15001', 65721]: {'15025': [{'5900': 0}]}>
Protocol is shutdown, cancelling command: 192.168.1.99 <Command put ['15001', 65641]: {'3312': [{'5850': 1}]}>
Protocol is shutdown, cancelling command: 192.168.1.99 <Command get ['15011', '15012']>
Protocol is shutdown, cancelling command: 192.168.1.99 <Command put ['15001', 65714]: {'3311': [{'5851': 0, '5712': 50}]}>

to be followed by:

Logger: coap
Source: /usr/local/lib/python3.9/site-packages/aiocoap/messagemanager.py:197 
First occurred: 23:08:14 (1 occurrences) 
Last logged: 23:08:14

Received Type.ACK from <aiocoap.transports.tinydtls.DTLSClientConnection object at 0x7f99e908b0>, but could not match it to a running exchange.

Btw, my Tradfri bridge has been on up .99 for 4 years now ...

Mariusthvdb · 2021-11-13T22:12:30Z

Actually it tells you what the problem are

“ No suitable credentials for coaps://192.168.1.99”

did the ikea gateway change ip address?

It is very likely the same problem with the app.

It might be worse every day, especially since I am taking a break from the integration, after my last 2 PR (that would have solved the reload) was in reality rejected. Maybe another developer will take over.

Was this when @MartinHjelmare asked you to change some code? He's always very precise, as we in the end all profit from.

Please do not leave, you are priceless for us . And we truly need you

Mariusthvdb · 2021-11-14T14:26:18Z

just another thought (and no more than that, because there are no docs on it as far as I know), and I tried to think beyond the box..... could it be there is some upper limit to the connected devices on the Ikea Bridge?

Things started to go haywire in my setup a couple of releases ago, but maybe..... that coincided with me adding 2 Starkvind air purifiers (that currently don't work too well I Ha to start with).

If either they reached the max amount of devices, or if these particular devices cause trouble, that might be a thing to investigate?

update
suppose the documented upper limit per App (which ofc isnt the same as the Bridge but ets take it at that for now) is 50 devices. My setup is nearing that indeed, so I took out a few unused devices, just to be within specs. (Again, not that any error message hinted in that direction, but just to be sure). Unfortunately, the same scenario keeps happening during the daytime. Figured some temporary fix is needed, and until the HA integration behaves better, will test this automation:

  - alias: Reload Trafdri integration
    id: Reload Trafdri integration
    trigger:
      platform: time_pattern
      hours: /1
    condition:
      condition: time
      after: input_datetime.alarmclock_wd
      before: input_datetime.sleeptime_today
    action:
      service: script.reload_tradfri_integration

or more precise maybe:

  - alias: Reload Trafdri integration
    id: Reload Trafdri integration
    trigger:
      - platform: event
        event_type: system_log_event
        event_data:
          level: WARNING
        id: observation
      - platform: event
        event_type: system_log_event
        event_data:
          level: ERROR
        id: failed
    condition:
      condition: or
      conditions:
        - >
          {{'[homeassistant.components.tradfri.base_class] Observation failed for'
            in trigger.event.data.message and trigger.id == 'observation'}}
        - >
          {{'[homeassistant.components.tradfri] Keep-alive failed'
           in trigger.event.data.message and trigger.id == 'failed'}}

    action:
      - service: script.reload_tradfri_integration
      - service: system_log.write
        data:
          message: >
            Ikea integration was reloaded because of {{trigger.id}} with message:
            {{trigger.event.data.message}}
          level: warning
          logger: homeassistant.components.tradfri

Mariusthvdb · 2021-11-19T21:38:32Z

so found some more logs showing us the need to reload the integration, posted in #59392 (comment) too

suppose these spread Tradfri issues dont help in making clear the integration currently is bordering breaking Ha. Hoe can be bring this to the attention of the core dev team without tagging?

fwiw, this seems to catch the most prominent issues, and automate the reloading:

  - alias: Reload Tradfri integration
    id: Reload Tradfri integration
    mode: restart
    trigger:
      - platform: event
        event_type: system_log_event
        event_data:
          level: WARNING
        id: observation
      - platform: event
        event_type: system_log_event
        event_data:
          level: ERROR
        id: failed
    condition:
      condition: or
      conditions:
        - >
          {{'tradfri.base_class] Observation failed for'
            in trigger.event.data.message[0]}}
        - >
          {{'[tradfri] Keep-alive failed'
           in trigger.event.data.message[0]}}
        - >
          {{'Error received in UDP connection under DTLS' in trigger.event.data.message[0]}}
    action:
      - service: system_log.write
        data:
          message: >
            Ikea Tradfri '{{trigger.id}}' issue logged, reloading integration
          level: warning
          logger: homeassistant.components.tradfri
      - service: script.reload_tradfri_integration
      - service: system_log.write
        data:
          message: >
            Ikea Tradfri integration was reloaded because of {{trigger.id}}
          level: warning
          logger: homeassistant.components.tradfri
      - service: persistent_notification.create
        data:
          title: >
            {{trigger.event.data.level}}: Tradfri reloaded
          message: >
            {{now().timestamp()|timestamp_custom('%X')}}: Ikea Tradfri integration was
              reloaded because of {{trigger.id}}:
              Message: {{trigger.event.data.message[0]}},
              Logger: {{trigger.event.data.name}},
              Source: {{trigger.event.data.source}},
              Level: {{trigger.event.data.level}}

Mariusthvdb · 2021-11-25T20:09:52Z

keeping this alive. still happening on 2021.12.0.dev20211124 which should use pytradfri 7.2.0.

RosemaryOrchard · 2021-11-25T20:30:12Z

I have also seen this issue with similar logs. I didn't realise that 50 is the maximum number of devices on the gateway, but that's the number I (now) have. I'll try pairing some things to my Zigbee controller instead and seeing if the issue goes away.

Mariusthvdb · 2021-11-25T20:57:01Z

tbh, thats what I did, and it didn't help... I fear its more basic then that.

osmaa · 2021-11-29T08:26:58Z

My Trådfri gateway with 41 devices loses connection to Home Assistant sometimes multiple times a day - I've had this problem for months. I used to reboot the whole RPi running HA until I realized I could try just reloading the integration. When I do, the queued actions to the lights all trigger in sequence, which could mean lights flash a lot if it was down for some time.

@Mariusthvdb what is in script.reload_tradfri_integration your automation refers to?

HA core 2021.11.5 on Home Assistant OS 6.6

Possibly related log messages, though these don't appear every time the integration is stuck.

Logger: homeassistant.components.tradfri.base_class
Source: components/tradfri/base_class.py:41 
Integration: IKEA TRÅDFRI (documentation, issues) 
First occurred: November 28, 2021, 7:32:48 PM (838 occurrences) 
Last logged: 9:12:50 AM

Unable to execute command <Command put ['15001', 65580]: {'3311': [{'5851': 43, '5712': 50, '5708': 65279, '5707': 50243}]}>: {"r":"09"}
Unable to execute command <Command put ['15001', 65580]: {'3311': [{'5851': 43, '5712': 50, '5708': 65279, '5707': 51335}]}>: {"r":"09"}
Unable to execute command <Command put ['15001', 65538]: {'3311': [{'5850': 0}]}>: {"r":"09"}
Unable to execute command <Command put ['15001', 65580]: {'3311': [{'5851': 43, '5712': 50, '5708': 65279, '5707': 52428}]}>: {"r":"09"}
Unable to execute command <Command put ['15001', 65580]: {'3311': [{'5851': 43, '5712': 50, '5708': 65279, '5707': 53520}]}>: {"r":"09"}


Logger: pytradfri.api.aiocoap_api
Source: /usr/local/lib/python3.9/site-packages/pytradfri/api/aiocoap_api.py:168 
First occurred: November 28, 2021, 7:32:47 PM (33 occurrences) 
Last logged: 9:12:25 AM

Protocol is shutdown, cancelling command: 192.168.133.42 <Command put ['15001', 65543]: {'3311': [{'5711': 442, '5712': 100}]}>
Protocol is shutdown, cancelling command: 192.168.133.42 <Command get ['15011', '15012']>
Protocol is shutdown, cancelling command: 192.168.133.42 <Command put ['15001', 65580]: {'3311': [{'5851': 92, '5712': 50, '5708': 65279, '5707': 52428}]}>


Logger: homeassistant.core
Source: components/tradfri/base_class.py:39 
First occurred: November 28, 2021, 7:32:47 PM (1 occurrences) 
Last logged: November 28, 2021, 7:32:47 PM

Error executing service: <ServiceCall light.turn_on (c:cf770e6926ec1359a4e6a4510ce964f8): entity_id=['light.makkarin_valo'], params=color_temp=442, transition=10.0>
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/core.py", line 1511, in catch_exceptions
    await coro_or_task
  File "/usr/src/homeassistant/homeassistant/core.py", line 1530, in _execute_service
    await handler.job.target(service_call)
  File "/usr/src/homeassistant/homeassistant/helpers/entity_component.py", line 213, in handle_service
    await self.hass.helpers.service.entity_service_call(
  File "/usr/src/homeassistant/homeassistant/helpers/service.py", line 667, in entity_service_call
    future.result()  # pop exception if have
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 863, in async_request_call
    await coro
  File "/usr/src/homeassistant/homeassistant/helpers/service.py", line 704, in _handle_entity_call
    await result
  File "/usr/src/homeassistant/homeassistant/components/light/__init__.py", line 496, in async_handle_light_on_service
    await light.async_turn_on(**filter_turn_on_params(light, params))
  File "/usr/src/homeassistant/homeassistant/components/tradfri/light.py", line 270, in async_turn_on
    await self._api(command)
  File "/usr/src/homeassistant/homeassistant/components/tradfri/base_class.py", line 39, in wrapper
    await func(command)
  File "/usr/local/lib/python3.9/site-packages/pytradfri/api/aiocoap_api.py", line 198, in request
    result = await self._execute(api_commands)
  File "/usr/local/lib/python3.9/site-packages/pytradfri/api/aiocoap_api.py", line 166, in _execute
    _, res = await self._get_response(msg)
  File "/usr/local/lib/python3.9/site-packages/pytradfri/api/aiocoap_api.py", line 106, in _get_response
    pr_resp = await pr_req.response
  File "/usr/local/lib/python3.9/site-packages/aiocoap/protocol.py", line 731, in _run_outer
    await cls._run(app_request, response, weak_observation, protocol, log)
  File "/usr/local/lib/python3.9/site-packages/aiocoap/protocol.py", line 783, in _run
    blockresponse = await blockrequest.response
  File "/usr/local/lib/python3.9/site-packages/aiocoap/protocol.py", line 313, in send
    request_interface.request(plumbing_request)
  File "/usr/local/lib/python3.9/site-packages/aiocoap/tokenmanager.py", line 243, in request
    self.outgoing_requests[key] = request
TypeError: 'NoneType' object does not support item assignment

RosemaryOrchard · 2021-11-29T12:05:25Z

Last week I pared down the number of devices paired to my hub from 50 to 29 (and somehow it went back up to 30, definite flakiness on the IKEA hub side). As the hub was not good at telling Home Assistant it had fewer devices, I removed the integration and re-added it. Since then I have only had one dropout. So it's possible (though far from definite) that the higher number of devices connected to the hub was causing the issue.

Mariusthvdb · 2021-11-29T14:51:51Z

Think I will give that a try too, who knows.... Though here, the integration did take out the devices I had deleted from within the app correctly

as for the log messages: this is the order of things I now see, and note that my automatic Integration restart is logged too, possibly causing several of the other log entries:

2021-11-29 15:31:32 WARNING (MainThread) [coap] Error received in UDP connection under DTLS: [Errno 111] Connection refused
2021-11-29 15:31:32 WARNING (MainThread) [homeassistant.components.tradfri] Ikea Tradfri 'observation' issue logged, reloading integration
2021-11-29 15:31:32 WARNING (MainThread) [pytradfri.api.aiocoap_api] Protocol is shutdown, cancelling command: 192.168.1.99 <Command get ['15011', '15012']>
2021-11-29 15:31:32 WARNING (MainThread) [pytradfri.api.aiocoap_api] Protocol is shutdown, cancelling command: 192.168.1.99 <Command get ['15011', '15012']>
2021-11-29 15:31:32 WARNING (MainThread) [pytradfri.api.aiocoap_api] Protocol is shutdown, cancelling command: 192.168.1.99 <Command get ['15011', '15012']>
2021-11-29 15:31:32 WARNING (MainThread) [pytradfri.api.aiocoap_api] Protocol is shutdown, cancelling command: 192.168.1.99 <Command get ['15011', '15012']>
2021-11-29 15:31:32 WARNING (MainThread) [coap] Error received in UDP connection under DTLS: [Errno 111] Connection refused
2021-11-29 15:31:42 WARNING (MainThread) [homeassistant.components.tradfri] Ikea Tradfri 'observation' issue logged, reloading integration
2021-11-29 15:31:52 WARNING (MainThread) [homeassistant.components.tradfri] Ikea Tradfri integration was reloaded because of observation
2021-11-29 15:32:02 WARNING (MainThread) [homeassistant.config_entries] Config entry '192.168.1.99' for tradfri integration not ready yet: ('Request timed out.', TimeoutError()); Retrying in background
2021-11-29 15:32:12 WARNING (MainThread) [homeassistant.config_entries] Config entry '192.168.1.99' for tradfri integration not ready yet: ('Request timed out.', TimeoutError()); Retrying in background
2021-11-29 15:33:49 ERROR (MainThread) [homeassistant.config_entries] Error setting up entry 192.168.1.99 for cover
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/config_entries.py", line 311, in async_setup
    result = await component.async_setup_entry(hass, self)  # type: ignore
  File "/usr/src/homeassistant/homeassistant/components/cover/__init__.py", line 165, in async_setup_entry
    return await component.async_setup_entry(entry)
  File "/usr/src/homeassistant/homeassistant/helpers/entity_component.py", line 162, in async_setup_entry
    raise ValueError("Config entry has already been setup!")
ValueError: Config entry has already been setup!
2021-11-29 15:33:49 ERROR (MainThread) [homeassistant.config_entries] Error setting up entry 192.168.1.99 for fan
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/config_entries.py", line 311, in async_setup
    result = await component.async_setup_entry(hass, self)  # type: ignore
  File "/usr/src/homeassistant/homeassistant/components/fan/__init__.py", line 214, in async_setup_entry
    return await component.async_setup_entry(entry)
  File "/usr/src/homeassistant/homeassistant/helpers/entity_component.py", line 162, in async_setup_entry
    raise ValueError("Config entry has already been setup!")
ValueError: Config entry has already been setup!
2021-11-29 15:33:49 ERROR (MainThread) [homeassistant.config_entries] Error setting up entry 192.168.1.99 for light
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/config_entries.py", line 311, in async_setup
    result = await component.async_setup_entry(hass, self)  # type: ignore
  File "/usr/src/homeassistant/homeassistant/components/light/__init__.py", line 538, in async_setup_entry
    return await component.async_setup_entry(entry)
  File "/usr/src/homeassistant/homeassistant/helpers/entity_component.py", line 162, in async_setup_entry
    raise ValueError("Config entry has already been setup!")
ValueError: Config entry has already been setup!
2021-11-29 15:33:49 ERROR (MainThread) [homeassistant.config_entries] Error setting up entry 192.168.1.99 for sensor
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/config_entries.py", line 311, in async_setup
    result = await component.async_setup_entry(hass, self)  # type: ignore
  File "/usr/src/homeassistant/homeassistant/components/sensor/__init__.py", line 131, in async_setup_entry
    return await component.async_setup_entry(entry)
  File "/usr/src/homeassistant/homeassistant/helpers/entity_component.py", line 162, in async_setup_entry
    raise ValueError("Config entry has already been setup!")
ValueError: Config entry has already been setup!
2021-11-29 15:33:49 ERROR (MainThread) [homeassistant.config_entries] Error setting up entry 192.168.1.99 for switch
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/config_entries.py", line 311, in async_setup
    result = await component.async_setup_entry(hass, self)  # type: ignore
  File "/usr/src/homeassistant/homeassistant/components/switch/__init__.py", line 79, in async_setup_entry
    return await component.async_setup_entry(entry)
  File "/usr/src/homeassistant/homeassistant/helpers/entity_component.py", line 162, in async_setup_entry
    raise ValueError("Config entry has already been setup!")
ValueError: Config entry has already been setup!

@osmaa my script is:

script:

  reload_tradfri_integration:
    alias: Reload Tradfri integration
    mode: restart
    sequence:
      service: homeassistant.reload_config_entry
      data:
        entry_id: 37702840aa084ed4af2155b0811b1951

find the right entry_id in the core.config_entries

peltsippi · 2021-11-30T21:01:25Z

Just got behaviour that might be connected to the issue.

Tried to switch on a switch and it did not work because integration was stuck again (20 minutes after automated integration reload). Then I restarted homeassistant and switch instantly reacted and turned on during restart before Integration was reloaded. There was nothing else turning on the switch except my manual toggle through UI.

Sorry no logs or anything because reset wipes everything on my setup. But this is something one can test next time integration freezes and see if functionality is similar for everyone.

Mariusthvdb · 2021-12-14T20:00:44Z

Check https://ww8.ikea.com/ikeahomesmart/releasenotes/releasenotes.html and see improvement . Seems to no longer lockup ? ( some lights don’t respond) but the HA interface remains responsive ? #fingerscrossed

peltsippi · 2021-12-15T05:36:32Z

Actually my light bulbs were updated 2 days ago(noticed from bulbs restarting) and I updated ha yesterday and no issues for now.

peltsippi · 2021-12-18T12:02:53Z

Been testing since and only issue I've had is the old usual: if trådfri gateway is restarted, ha needs also to be restarted or integration breaks.

No other issues with anything so worksforme at least for now.

github-actions · 2022-03-26T13:08:10Z

There hasn't been any activity on this issue recently. Due to the high number of incoming GitHub notifications, we have to clean some of the old issues, as many of them have already been resolved with the latest updates.
Please make sure to update to the latest Home Assistant version and check if that solves the issue. Let us know if that works for you by adding a comment 👍
This issue has now been marked as stale and will be closed if no further activity occurs. Thank you for your contributions.

probot-home-assistant bot added the integration: tradfri label Sep 12, 2021

probot-home-assistant bot assigned janiversen Sep 12, 2021

Mariusthvdb mentioned this issue Nov 3, 2021

Ikea integration needs to be reloaded home-assistant-libs/pytradfri#377

Closed

Mariusthvdb mentioned this issue Nov 6, 2021

Tradfri integration blocking HA startup #59223

Closed

janiversen mentioned this issue Nov 12, 2021

Reload tradfri protocol if keep_alive fails #59577

Closed

22 tasks

Mariusthvdb mentioned this issue Nov 15, 2021

Reload Tradfri is needed multiple times during daytime #59708

Closed

janiversen mentioned this issue Nov 20, 2021

Update CODEOWNERS for tradfri #60023

Merged

22 tasks

janiversen removed their assignment Nov 20, 2021

Mariusthvdb mentioned this issue Nov 25, 2021

IKEA hub looses connection #40612

Closed

janiversen mentioned this issue Dec 5, 2021

Add timeout support to tradfri #61055

Closed

22 tasks

github-actions bot added the stale label Mar 26, 2022

github-actions bot closed this as completed Apr 2, 2022

github-actions bot locked and limited conversation to collaborators May 2, 2022

Ikea integration needs to be reloaded every morning #56141

Ikea integration needs to be reloaded every morning #56141

Comments

carloss66 commented Sep 12, 2021

The problem

What is version of Home Assistant Core has the issue?

What was the last working version of Home Assistant Core?

What type of installation are you running?

Integration causing the issue

Link to integration documentation on our website

Example YAML snippet

Anything in the logs that might be useful for us?

Additional information

probot-home-assistant bot commented Sep 12, 2021

janiversen commented Sep 12, 2021

carloss66 commented Sep 13, 2021

janiversen commented Sep 13, 2021

carloss66 commented Sep 13, 2021

janiversen commented Sep 13, 2021

carloss66 commented Sep 14, 2021

janiversen commented Sep 14, 2021

jkushner90 commented Oct 13, 2021

carloss66 commented Oct 14, 2021

jkushner90 commented Oct 14, 2021

janiversen commented Oct 14, 2021

JvDrunen commented Nov 2, 2021

Mariusthvdb commented Nov 2, 2021

JvDrunen commented Nov 2, 2021 • edited

carloss66 commented Nov 2, 2021

janiversen commented Nov 2, 2021

janiversen commented Nov 2, 2021

Mariusthvdb commented Nov 2, 2021

Mariusthvdb commented Nov 3, 2021 • edited

JvDrunen commented Nov 3, 2021

peltsippi commented Nov 3, 2021

JvDrunen commented Nov 3, 2021

peltsippi commented Nov 3, 2021

carloss66 commented Nov 5, 2021

Mariusthvdb commented Nov 5, 2021 • edited

janiversen commented Nov 12, 2021

janiversen commented Nov 12, 2021

Mariusthvdb commented Nov 13, 2021

Mariusthvdb commented Nov 13, 2021 • edited

janiversen commented Nov 13, 2021

peltsippi commented Nov 13, 2021

Mariusthvdb commented Nov 13, 2021 • edited

Mariusthvdb commented Nov 13, 2021 • edited

Mariusthvdb commented Nov 14, 2021 • edited

Mariusthvdb commented Nov 19, 2021 • edited

Mariusthvdb commented Nov 25, 2021

RosemaryOrchard commented Nov 25, 2021

Mariusthvdb commented Nov 25, 2021

osmaa commented Nov 29, 2021

RosemaryOrchard commented Nov 29, 2021

Mariusthvdb commented Nov 29, 2021 • edited

peltsippi commented Nov 30, 2021

Mariusthvdb commented Dec 14, 2021

peltsippi commented Dec 15, 2021

peltsippi commented Dec 18, 2021

github-actions bot commented Mar 26, 2022

JvDrunen commented Nov 2, 2021 •

edited

Mariusthvdb commented Nov 3, 2021 •

edited

Mariusthvdb commented Nov 5, 2021 •

edited

Mariusthvdb commented Nov 13, 2021 •

edited

Mariusthvdb commented Nov 13, 2021 •

edited

Mariusthvdb commented Nov 13, 2021 •

edited

Mariusthvdb commented Nov 14, 2021 •

edited

Mariusthvdb commented Nov 19, 2021 •

edited

Mariusthvdb commented Nov 29, 2021 •

edited