New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Bridged with 1Gb Interface - Connection drops #5
Comments
Since both 10G NICs are interconnected, it could be a line issue on each of them, not exactly on ubuntu side. |
I can almost always restart the link by: If I just try ipconfig /renew /release on the Windows machine the prompt will hang forever. Everytime the link is up it is negotiated at 10gb. I build a new cat6 last night with no difference. I also plugged from my router 10gb card to the Windows 10 PC Intel integrated 1Gb NIC. No connection drops while in 1Gb mode. I plugged back into the Asus card for 10gb link, and got a disconnect right away. When this disconnect happens, the windows troubleshooter will usually say gateway lost as well. Edit1: If there is disconnect, it will never reconnect automatically. I have to manually reconnect the cable or disable and re enable to Windows PC Asus adapter. |
Just updated both of my AQN-107's to the latest firmware posted on station-drivers. I used Windows 10 to do it. Put them both back in and will see if this fixes the issue. New ethtool -i: driver: atlantic |
After a few days of using the newer firmware, the issue seems to be much less frequent, but still present. About every 24-48 hours the NIC in the router goes unresponsive. Doing more research today I noticed this in my ifconfig: enp1s0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500 Notice it does not say RUNNING. The other interface in the bridge as well as the bridge itself both report running still, but the Asus 10Gb NIC shown above does not. What can I do to further troubleshoot this issue? The only thing that seems to work now is a restart of the router PC. I also uncovered these messages during boot: May 02 00:06:09 kknd kernel: pcieport 0000:00:1c.4: AER: Corrected error received: 0000:00:1c.4 Now that I have noticed this error that is present with every boot, I will try to run the Ubuntu router PC with the boot option pci=noaer. If there is no improvement I will try pci=nomsi. If anyone else has any suggestions I'd love to hear them. |
Didn't mean to close it sorry. |
Can you give more details on your router PC hardware? |
I just tried ifconfig enp1s0 down then up, it did restore the link. When I got home today the link was down but this successfully recovered the connection. The router PC is a ROG Strix Z370-Gaming-Wifi-AC Motherboard. It has a i3 8350k intel CPU with 32GB of RAM. In the PCI-E I have the Asus XG-C100C 10Gb NIC as well as an intel 1Gb NIC. Attached is the output you requested. Also I have set pci=noaer in an attempt to fix the intermittent connection drop. This appears to have no effect, except to suppress error messages from the PCI bus during boot. 00:00.0 Host bridge: Intel Corporation 8th Gen Core Processor Host Bridge/DRAM Registers (rev 08) 00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x16) (rev 08) (prog-if 00 [Normal decode]) 00:02.0 VGA compatible controller: Intel Corporation 8th Gen Core Processor Gaussian Mixture Model (prog-if 00 [VGA controller]) 00:14.0 USB controller: Intel Corporation 200 Series/Z370 Chipset Family USB 3.0 xHCI Controller (prog-if 30 [XHCI]) 00:16.0 Communication controller: Intel Corporation 200 Series PCH CSME HECI #1 00:17.0 SATA controller: Intel Corporation 200 Series PCH SATA controller [AHCI mode] (prog-if 01 [AHCI 1.0]) 00:1b.0 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port #17 (rev f0) (prog-if 00 [Normal decode]) 00:1c.0 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port #1 (rev f0) (prog-if 00 [Normal decode]) 00:1c.2 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port #3 (rev f0) (prog-if 00 [Normal decode]) 00:1c.4 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port #5 (rev f0) (prog-if 00 [Normal decode]) 00:1d.0 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port #9 (rev f0) (prog-if 00 [Normal decode]) 00:1f.0 ISA bridge: Intel Corporation Z370 Chipset LPC/eSPI Controller 00:1f.2 Memory controller: Intel Corporation 200 Series/Z370 Chipset Family Power Management Controller 00:1f.4 SMBus: Intel Corporation 200 Series/Z370 Chipset Family SMBus Controller 00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (2) I219-V 01:00.0 Ethernet controller: Aquantia Corp. AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion] (rev 02) 03:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection 05:00.0 USB controller: ASMedia Technology Inc. Device 2142 (prog-if 30 [XHCI]) |
I have the same problem without Bridge: Linux 5.10.0-18-amd64 #1 SMP Debian 5.10.140-1 (2022-09-02) x86_64 GNU/Linux [ 1276.025828] atlantic 0000:01:00.0 eth0: atlantic: link change old 10000 new 0 driver: atlantic 00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Root Complex 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 PCIe GPP Bridge [6:0] (prog-if 00 [Normal decode]) 00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 PCIe GPP Bridge [6:0] (prog-if 00 [Normal decode]) 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Internal PCIe GPP Bridge 0 to Bus A (prog-if 00 [Normal decode]) 00:08.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Internal PCIe GPP Bridge 0 to Bus B (prog-if 00 [Normal decode]) 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 61) 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51) 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 0 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 1 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 2 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 3 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 4 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 5 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 6 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 7 01:00.0 Ethernet controller: Aquantia Corp. AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion] (rev 02) 02:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 43bc (rev 02) (prog-if 30 [XHCI]) 02:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] Device 43b8 (rev 02) (prog-if 01 [AHCI 1.0]) 02:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b3 (rev 02) (prog-if 00 [Normal decode]) 03:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) (prog-if 00 [Normal decode]) 03:05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) (prog-if 00 [Normal decode]) 03:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) (prog-if 00 [Normal decode]) 03:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) (prog-if 00 [Normal decode]) 07:00.0 SCSI storage controller: HighPoint Technologies, Inc. RocketRAID 230x 4 Port SATA-II Controller (rev 02) 08:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Raven Ridge [Radeon Vega Series / Radeon Vega Mobile Series] (rev c8) (prog-if 00 [VGA controller]) 08:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Raven/Raven2/Fenghuang HDMI/DP Audio Controller 08:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor 08:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Raven USB 3.1 (prog-if 30 [XHCI]) 08:00.4 USB controller: Advanced Micro Devices, Inc. [AMD] Raven USB 3.1 (prog-if 30 [XHCI]) 09:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 61) (prog-if 01 [AHCI 1.0]) |
I might be having similar problems:
Should I try to update the firmware? |
I built a router based on Ubuntu 18.04. I've got 3 NIC's in this router PC. Asus XG-C100C, intel integrated 1Gb plus a 1 port Intel NIC in a PCIE slot.
The integrated NIC is plugged into my fibre modem, and the Asus and Intel PCIE cards are bridged together. This works pretty well, but I often get random disconnects on the Asus XG 10Gb card. It is plugged into my Windows 10 PC which also has an Asus XG-C100C NIC to facilitate 10Gb transfers between my windows PC and the Ubuntu router.
I've disabled LRO and GRO, enabled STP and set MTU to 9000 for all bridges and their interfaces. None of these have made any difference. Last night I discovered this driver and decided to try it instead of the driver available on the Aquantia website. Both drivers exhibit this issue.
Any hints on troubleshooting and narrowing down the problem would be appreciated. Thanks for all your hard work this driver appears to get slightly better throughput than the Aquantia provided driver. Attached is the output of journalctl when this disconnect happens.
I've also made a post on reddit, here is a link to that as well, may have some useful information.
https://www.reddit.com/r/HomeNetworking/comments/be1boe/ubuntu_server_1804_router_bridged_aqn107/
Edit: Output of ethtool -i
The text was updated successfully, but these errors were encountered: