Service Discovery Helper
A UDP Broadcast forwarder
(c) Chris Holman, 2013
If you operate a network with more than one VLAN or LAN segment, then UDP broadcast discovery won't just work across your entire network. Enter, Service Discovery Helper (SDH).
Many programs use UDP broadcasts to discover their servers/peers. SDH forwards these UDP broadcasts between networks, enabling discovery functionality where it would not usually work.
SDH will listen on the specified network interfaces for UDP broadcasts on specified ports and retransmit the packets on remaining network interfaces. It uses a whitelist for UDP ports that it will forward, so you can be sure that you will not accidentally forward DHCP or SSDP to every other VLAN.
The use case that inspired this tool is large LAN parties, where you may have hundreds (or thousands!) of PCs on one network. Operating this many PCs on one broadcast domain introduces a number of issues, and is considered probably not the best practice. The normal solution to this is to segment the network in to a number of VLANs on their own subnet, such that there are a much smaller number of PCs in one broadcast domain. But then game server discovery doesn't work!
See GAMES.md for a list of tested games.
- Linux (or maybe BSD or other *nix environment)
- gcc or similar (apt-get install build-essential)
- libpcap and libpcap-dev
- Root privilges
- 2 or more local network interfaces
Trunk all of your VLANs to a PC somewhere. (Consult switch documentation)
sudo modprobe 8021q sudo ip link add link eth0 name eth0.2 type vlan id 2 # Repeat for each VLAN you have # Edit the configuration files (ports and interfaces are the defaults) make sudo ./sdh-proxy [-p ports-file -i interfaces-file [-d] ] [-h]
- -p ports-file: List of ports are read from ports-file. Port ranges can be specified by using a hyphen, eg 10-50
- -i interfaces-file: List of interfaces are read from interfaces-file.
- -a : Listen on all PCAP supported interfaces (except USB and "any")
- -r : Enable rate limiting per source IP+destination UDP port combination
- -t nnn : Set rate limiter to nnn ms. Defaults to 1000ms. Implies -r
- -l : Turns on Stat logging (log RX/TX/DROP Packets to stats.log)
- -d : Turns on debug (doesn't do much yet
- -h : Shows this help
Multiple port or interface files can be specified.
Example port and interface files are given.
Only one instance of SDH should run on each VLAN. If more than one instance is run on the same PC, broadcasts will be retransmitted n times. If more than one copy is run on more than one PC, and there are shared VLANs, a broadcast loop and flood will happen.
Rate limiting can be enabled with a command line flag. It is strongly recommended that you enable this, unless you're 100% confident that you know what you're doing and you won't accidentally cause a loop. See below for a brief rate limting explanation.
Important information regarding a segault: if run the application and you get crash on start, try splitting your ports file up in to multiple files and running multiple instances of SDH. This bug needs some love, but the workaround is simple .
If you do not want to trunk every VLAN to one point on your network, you may create a bridging VLAN and run multiple instances of SDH. Consider the bridging VLAN is 100, and the user networks are VLANs 101, 102, 103 and 104. Run two instances of SDH, one connected to VLANs 100, 101 and 102, and the second instance connected to VLANs 100, 103 and 104. Packets broadcast on to the bridging VLAN will be rebroadcast again by other instances of SDH. The bridging VLAN could also be a VPN or similar.
Rate limiting is an optional feature that can be used for mostly-effective damage control in the event of a network loop, and preventing spammy programs from affecting your entire network.
Every packet that is considered for retransmission has its source IP address and destination UDP port compared to a list of recent packets. If that same pair of source IP and destination port have been retransmitted within the last timeout period, then the packet is dropped.
The use of this combination means that when, eg, the Steam server browser sends broadcasts on each of ports 27015 to 27020, it will not trigger the rate limiter. But, if there is a network loop or a very spammy program, the same IP+port combination will be seen many times in a short period, and the rate limiter will drop all but 1 instance of the packet in every timeout period.
The default timeout is 1000ms, which is more than enough to prevent a loop from forming if the circumstances for it to happen arise, and is small enough that it should not interfere with any legitimate discovery applications.
-l flag to enable logging of statistics to a file. Then
use this script
to ingest the data in to InfluxDB.
Thanks to Solariz from DreamHack for this feature!
What SDH does do
- Copy/retransmit ethernet frames containing UDP broadcast packets on whitelisted ports between network interfaces
- Optionally enforce a rate limit to prevent a network flood in the case of a loop
What SDH does not do
- Routing. This is not a router. Your non-UDP-broadcast IP traffic will still need a normal router to move between LAN segments.
- Ethernet bridging. I guess technically it could be considered an ethernet bridge, but only one that forwards very incredibly selectively.
- Intelligent retransmission decisions. A malicious user could flood your network with targetted traffic. A future feature could be a rate limiter to avoid flooding a gigabit of traffic across the network.
- Source verification. Neither source IP or MAC address are verified. A future feature could be to ensure that the source IP address is within the subnet of the interface it was detected on, but this would prevent multi-hop broadcasts.
The most important bit out of that is: this tool does not carry your game/application traffic. Broadcasts are (usually) only used for network announcement and discovery. Your game client will send a discovery broadcast packet (ie, host to everyone), which SDH will retransmit. The game server will reply with a unicast (ie, host to host). Unicast is not broadcast, and will not be retransmitted by SDH. The unicast packets will go via the path they would have if SDH was not running.
What problems might SDH not fix?
Your program might have a serious case of the bad programmer, and cannot deal with "LAN" clients being on different subnets.
What has this been used for?
PAX Aus 2016 PC area
We finally used this at an event - PAX Aus 2016 PC area.
it seemed to work pretty well. One VLAN apparently had some trouble discovering servers, but I did not get to investigate at the time, >so can't rule out individual PC problems, switch misconfiguration or bug in the application.
DREAMHACK Ger 2016 LAN area
We used it at DHDE17 too. 1.500 users run very well on a enabled rate limiting at -t 750. Tested and added several games to the ports, after adding a bunch of ports the SDH crashed on memory exhaust but could be fixed by enabling the pcap optimized compile in code.
To do list
- Detect whether the broadcast is going to 255.255.255.255 or to the last address in the subnet (eg, 10.0.0.255). If the latter, rewrite the address for the new subnet. Current implementation leaves address as is. Means it only works if it gets sent to 255.255.255.255. Making this change would require either detection or configuration of what IP range each interface used.
- Not segfaulting if not run with libpcap capture permissions (eg, root)
- Fix segfault when providing a large ports file
Ideas for someone who might find them useful to implement:
- Verify sender by ARP before retransmitting a frame
- Detect loops by watching for duplicate frames from the same source (this may be problematic, as some applications generate identical frames every time)
Published under the MIT license. See LICENSE for licensing information. Please email me if you use this, I'd love to know <3