-
Notifications
You must be signed in to change notification settings - Fork 12
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Multicast container causing feedback loops #1
Comments
I can't reproduce that issue. Maybe you have also other mdns repeater running and end up in a loop? You can use |
I've checked this as well and cannot see this in my network (using multiple VLANs and additional repeaters between those as well). |
From Repeating over and over again
|
Looks also like supervisor recreated the container with the original image this morning. |
You should check this IP address. This plugin does not more than just copy the multicast broadcast for mDNS over to the hassio network. Also, DHCP is working on Broadcast, not Multicast. That is a pretty common process that is used on many firewalls/gateways. You need to fix your Network issue or just run Home Assistant Core. The Supervisor will still try to fix the plugin every time. It could be also a Kernel issue on the system in which you run the Supervisor. Give us more details about your host. |
Those IP addresses are the adapters on the router, Router is Ubiquiti Edgerouter X Host info:
Let me know if you want any specific details. Thanks for helping. |
Ok, so just checked my router, it has an mdns repeater as well turn on for my vlans. If I turn it off I can start up the multicast container and everything is fine. But this is not a solution. I now will not have mdns across my vlans. I think its definitely gotten into a loop with this |
Multicast is also getting stuck in a loop against
This docker log is also running my server out of space by how fast it's flowing. if relevant, mdns-repeater is running of a Ubiquiti EdgeRouter X. |
So exact same situation and setup as I have. I disabled the repeater on the router for now as we don't have control of which services the supervisor runs. |
I had the same issue as you. I did a dirty downgrade. But now when i'm trying to update HA it gives me errors: Edit: Managed to fix the error of multicast plugin with a reinstall of supervisor. Now my network is slow again and the plugin eats up my diskspace. |
Same issue as you guys. Deleting this log every second day, but my 32 gig sd card is full after 24 hours again at least. Running similar network configuration. Very annoying currently. If multicast would be casting not only from wlan0/eth0 to hassio
but instead do multicast between eth0 wlan0 and hassio, that would be awesome. |
Same issue. |
When I downgrade to multicast_hassio:1 my network works as usual. After the downgrade I can't update HA or Supervisor. This is the log. I have Mikrotik router and Unifi APs.
|
Same issue for me, using unifi gateway and switches with multiple vlans Edit: |
I have been looking into the mdns-repeater that you are using. Options maybe:
I turned on my router mdns-repeater and ran the multicast container with a bash entrypoint then ran
I think the users who have this issue are the ones with vlans set up and have more knowledge about the networks so having the |
Awaiting a structural solution (which is really needed as mdns-repeater should NOT be listening on all ports as it results in unwanted mdns-announcements across vlans) i've added a static route to 8.8.8.8/32 towards my loopback interface. That way the hassio-mcast container forwards mdns-announcements on all hassio host interface to the docker-network (which is fine with me) and the hosts' loopback (which is wrong, but doesn't hurt too much at the moment). |
I'm glad I found this post. I'm also having same issue. Initially, I stated noticing my hard drive writing logs non-stop and experiencing chromecast problem. I also run UniFi equipments with multiple vlans and mDNS enabled in the controller. At least, I found some workaround for the time being. Thanks. |
My issue was caused by having another reflector (avahi) on the network across the same two interfaces as hassio. Since I had that reflector now properly configured, there was no longer a need for hassio to have two interfaces: I removed hassio's second interface and configured my router to allow traffic from hassio to the other network. The router and my own set up reflector are now all that is needed for hassio to reach the second network (dedicated iot network for poorly secured devices, no internet access for example, and a few hosts, like hassio allowed to access that network). I no longer have issues, so that's maybe worth something. For me it feels more properly set up this way. |
That will not work for all cases though. |
Agree with Jesserockz; I absolutely love HA, but the forced push of this multicast repeater without any form of either disabling it nor customizing it is a wrong move imho. I'm the first to admit my situation is a-typical and actually unwanted, but at the moment I'm forced to have a second network exposed within my HA-running machine. I understand, and fully respect, that the maintainers can't nor want to support every single possible scenario HA is run in/on, but every forced functionality should be accompanied by a means to interact/influence it, even if its just disabling it (and accepting the corresponding consequences). I hope @frenck or @pvizeli can respond on their thoughts soon. I'm not a programmer (network guy for profession) so don't feel comfortable to write a pull-request by myself. If someone however can point me in the right direction how I can either define a user-facing option in HA or an admin-facing option on CLI, I'm willing to do an attempt. |
@mbrackjr If you like more control, please use Home Assistant Container instead. |
@frenck Thanks for responding. I was somehow afraid to get this type of feedback based on similar comments when the manual hassio install method was originally pulled. I don't want to end up in a discussion of right or wrong; you're one of the primary maintainers of this wonderful project. So if this is the formal statement, I have no option than to 'live with it'. I do believe however I'm representative of a small percentage of still very happy users of hass.io that is trying to be positively critical in making the product even better. Your own 'about me' seems to me you're self-critical as well, so I sincerely hope you can value my feedback here, rather than dismissing it. I'm perfectly fine for supervisor to manage my HA stuff and it hasn't given me any problems so far. This multicast-container has, simply because its intended use (get multicast network announcements into HA in support of service-discovery) is not the provided use (repeating all inbound multicast to all other interfaces). The fact it works 'for most', is simply due to the fact that 'most' installations of "Home Assistant Supervised" are using a single network interface. For the outliers/exceptions the solution is not fit-for-purpose and that should not be considered 'good enough' for anyone serious about providing qualitative software, which I believe you are (given your extremely well documented add-ons of the past). Again, I hope this comes across with its intent; to point out a flaw in the intended use of the provided solution, hoping you're able to help out (either by programming or providing some guidance). Not as negative or critical to your intentions. Thanks for listening/reading. Manfred |
@mbrackjr We are always open for PRs. I'm sorry that you don't like the response, however, starting with "but the forced push of this multicast repeater without any form of either disabling" is fine, but just saying if you want manual control, this isn't the right system for you. |
I've been seeing the same. I rebuilt the docker image and injected it into my Home Assistant setup. (A torturous process lol) and ...
I was about to make a PR but I see that @pvizeli has made some changes whilst I was 'messing around' lol. |
I am also on Unifi (and EdgeRouter), my workaround fixed the issue for me, see my previous comment (Jan 25). |
I've approached this in a different way. As long as HA is still able to find or address devices in other subnets / V-LANs it does not need to be multihomed. I'll describe my specific situation. While it might not help everyone, it might help some: I have two major subnets, both on different V-LANs created on UniFi equipment. One is my "home" network, the other is for IoT devices. My control devices (smartphones, computers etc) live on the home network, Chromecast Audios and other renderers live on the IoT network. With HA having interfaces on both network I saw the flooding everyone has issues with. USG does not take kindly to that. But with HA only being present in either one of the network I need the USGs mDNS repeater to make the Chromecasts available in the home network - which is unreliable in itself. But that a USG issue, or rather a Google issue. So the idea of having a reliable mDNS repeater is good - it's just that HA is not that. Solution: I moved HA to the home network and found a different mDNS repeater: https://github.com/scyto/multicast-relay I hope this helps someone. Edit: This solves one problem with Chromecast Audio in particular: Groups. Those usually fall apart across subnets when only using Unifis repeater. I can now use those across subnets. |
I experienced this same issue with openwrt and disabling ipv6 on my router fixed it. |
I already have ipv6 turned off, but I also have different home network setup. |
Having same issue. Restarting my USG after restarting Home Assistant seems to take the load away. However I do hope we'll see a structural solution soon. OK I dived a bit more into this issue. Since the untagged VLAN is not needed for any of the Home Assistant stuff, can I somehow drop everything that the Home Assistant Blue copies on there when it's coming towards my USG (A LAN-out drop rule????) and will that stop my USG from have high CPU load? Or should I simply remove the untagged VLAN from the interface/network port with Home Assistant Blue. Will the Unfii controller still see my network devices then? |
Well, limiting my Hass Blue to only 1 VLAN does not fix the issue. So probably I don't understand the issue. |
Would the team to open to a pull request to allow this container to be configured and/or disabled? |
@jesserockz did you ever find a solution/workaround for your problem? |
@joshuaspence no. I have since moved my install to a Blue so it does not apply to be personally anymore. But basically you cannot use multiple network interfaces (or vlans) on the host running supervised HA because of this issue. |
You won't get anywhere by mentioning them 😉 |
I won't be submitting a pull request as I have an alternative solution to my problem. The only reason I want/need multiple network interfaces on Home Assistant is so that Home Assistant would see DHCP requests on all of my subnets, which is needed for DHCP discovery to work. Most of my integrations rely on mDNS rather than DHCP for discovery and the Unifi mDNS Repeater is working well for this. I realized that the TPLink integration supports another form of discovery, which involves broadcasting on UDP port 9999. I have setup https://github.com/britannic/ubnt-bcast-relay on my USG and Home Assistant can now discover TPLink devices. |
Ah, DHCP discovery, did not think of that and Dont think any of my devices use that. |
Yeah. Another solution I considered was to run the DHCP server add-on on Home Assistant and have my USG relay DHCP requests to Home Assistant but I chose not to do this for two reasons:
|
@joshuaspence (or anyone else in this thread), multicast plugin version
|
@agners Still testing but one observation so far is that there is a lot of mDNS traffic generated still. It looks like Home Assistant is advertising a whole bunch of services for
|
Apart from that, it seems to work I think. I am going to go back to stable though because I already have a workaround and the logs above make me think this still isn't working as I would have expected. |
I couldn't figure out where Home Assistant is advertising itself via mDNS but interestingly those
|
I had hit the same problem which had overwhelmed the network printer on my network. While debugging this I came across the mdns storm on my network which seems to have completely overwhelmed my printer. I have since updated my hassio_multicast from the beta channel as you specified and it has fixed my issue. I am using the edgerouter x with multiple vlans and the mdns repeater enabled on the router. I had come across a similar issue a couple of years ago too - https://community.home-assistant.io/t/mdns-flood/223415 |
I've been without multicast feedback loop network issue for almost 19 months now, until 3 days ago, around 5am local time multicast traffic jumped to almost 500bytes/sec from 15bytes/sec. I've placed multicast bytes/sec monitoring for about 6 months now. One common denominator when my network gets hit with multicast feedback loop, is I've stopped updating both raspbian OS and Home assistant. This time I haven't updated it for about 3 months now (raspbian + HA) at the same time. |
Those do not seem to be caused by the multicast plug-in.
That might be related to the primary network device auto detection in Core (see https://www.home-assistant.io/integrations/network/). Try selecting the right interface manually to see if that improves. While there might be still something odd, it seems to me that those messages are "genuine" and not reflected/amplified by the multicast plug-in. |
Here too, this might be some additional messages, not really a feedback loop. Can you check what kind of messages those are? |
@agners I did try selecting the primary network interface instead of relying on the auto-detection but it didn't help. I believe the problem I described is caused by the multicast plugin as it stopped immediately when I stopped the multicast container. I think what I observed was a loop, just not necessarily a positive feedback loop. |
@joshuaspence ok, you have the latest |
Yes |
@agners |
When the network is in trouble, this seems to be happening.... Dec 02 15:37:58 homeassistant systemd-resolved[389]: Detected conflict on homeassistant223041.local IN A 192.168.XX.66 |
Since getting up this morning, devices on my network could not get an IP address.
I notice on my server that
hassio_supervisor
andhassio_multicast
were created8 hours ago
.Looking at my router there was a constant TX rate of about 8Mbps to my
IoT
andGuest
vlans coming from mylan
vlan.No device on my network could get a DHCP reservation unless I stopped the
hassio_multicast
container which also halted the extra traffic transferring between the vlans.Of course
hassio_supervisor
just starts the multicast container back up again and the issue is back.I have had to tag a local dummy empty docker image with
homeassistant/amd64-hassio-multicast:2
to resolve this for now.The text was updated successfully, but these errors were encountered: