-
Notifications
You must be signed in to change notification settings - Fork 706
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
wizard: WAN over PPPOE - default Route is not set correctly #2186
Comments
Brilliant report! |
I'm having exactly the same issue after a fresh install of 18.1 (nano) with a PPPoE connection. |
Same on 18.1.4? If you want I can build a Nano image based on the latest code. |
Possibly a silly question but: Where can I get 18.1.4? The downloads I'm using are labelled just 18.1. I originally had most things working fine until I discovered port forwarding wasn't working properly, so I did all the updates that were available followed by a reboot, but the system didn't come up after that. Then I tried a fresh install (of 18.1) and encountered this problem. EDIT: I've just installed 18.1 from ISO in a virtual machine which also exhibited the same problem. Using the console I ran "route change default" and specified my ISP's gateway, which allowed me to then update to 18.1.4. I then rebooted. The gateway seems to be correct now, so it does look like 18.1.4 fixes this. |
We don't have images for all 18.1.x releases as time to do QA is traded for pushing weekly updates. They are, however, sporadically released o fix image-based issues. :) I'll provide a 18.1.4 Nano in a bit. Amd64 I guess? |
Yes, Amd64 please. Thank you for taking the time to do this. |
Sure, no problem. Here it is: https://pkg.opnsense.org/FreeBSD:11:amd64/snapshots/OPNsense-201803131410-LibreSSL-nano-amd64.img.bz2 |
Just to update on this - I'm now on OPNsense 18.1.5 and the problem has been resolved. It's possible to upgrade from versions affected with the problem by manually adjusting the default route via the shell. I can't remember the exact commands I used now as it was a couple of weeks ago but it was along the lines of: route delete default For the gateway address - it was either my pppoe address, or the upstream gateway I used. With the default gateway changed, it's then possible to upgrade and then the above commands aren't needed again :) |
Looks like it was related to this fix: f4c5e21047 more or less relating to these to changes in 18.1.4 https://github.com/opnsense/changelog/blob/9f33a2a0623addbb7378e568893af032b8ffd0db/doc/18.1/18.1.4#L10-L11 We'll issue new images based on the upcoming 18.1.6 to replace the current 18.1 ones. Please close if you feel this is solved completely. :) Thanks, |
@JackTrapper if you have time to test we'd highly appreciate it. image for 18.1.6 are 2 weeks out and we want to get this right. 👍 |
I'd tried the 18.1.5 DVD snapshot a few days ago, but it wouldn't boot off the USB stick (because it's a DVD snapshot). I also tried the earlier linked snapshot a few weeks ago, and it also wouldn't boot. I was simply going to wait for another round of official releases before trying again. Is there a "vga" snapshot around anywhere? Edit: I tried burning it to 3 different USB sticks. Rufus swears up and down that supports bootable ISO images. It could be related to the other issue with images that i debugged. |
@JackTrapper sorry for the delay, here's a VGA based on the upcoming 18.1.6 https://pkg.opnsense.org/FreeBSD:11:amd64/snapshots/OPNsense-201804070632-OpenSSL-vga-amd64.img.bz2 |
Same problem. The default route is configured to go out the physical WAN interface, rather than out the PPPoE interface:
You can compare the equivalent from pfSense:
I realize this is all deep inside OpenBSD, and we have no idea what the OpenBSD networking subsystem is doing, or why. But is there some log file available through the WebGUI that would help? |
Do you have the System log during that transition? A lot of messages were added since 18.1 to help debug.
… On 8. Apr 2018, at 16:47, JackTrapper ***@***.***> wrote:
Same problem. The default route is configured to go out the physical WAN interface, rather than out the PPPoE interface:
Proto Destination Gateway Flags Use MTU Netif Netif (name)
ipv4 default link#2 U 2455696 1500 re0
ipv4 [WAN IP] link#7 UHS 0 16384 lo0
ipv4 127.0.0.1 link#3 UH 211 16384 lo0
ipv4 192.168.1.0/24 link#1 U 13915 1500 em0 lan
ipv4 192.168.1.1 link#1 UHS 0 16384 lo0
ipv4 [gateway IP] link#7 UH 92 1492 pppoe0 wan
ipv4 [ISP DNS 1] [Gateway IP] UGHS 120 1492 pppoe0 wan
ipv4 [ISP DNS 2] [Gateway IP] UGHS 28 1492 pppoe0 wan
You can compare the equivalent from pfSense:
Destination Gateway Flags Use Mtu Netif
default [Gateway IP] UGS 16599 1492 pppoe0
127.0.0.1 link#6 UH 28 16384 lo0
192.168.1.0/24 link#1 U 29989 1500 em0
192.168.1.1 link#1 UHS 0 16384 lo0
[WAN IP] link#7 UHS 0 16384 lo0
[Gateway IP] link#7 UH 1230 1492 pppoe0
[ISP DNS 1] [Gateway IP] UGHS 0 1492 pppoe0
[ISP DNS 2] [Gateway IP] UGHS 0 1492 pppoe0
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub, or mute the thread.
|
Before i plug in the USB to try the LiveCD again (and lose my Internet), can you confirm exactly now to navigate to the log you're interested in? I noticed a few logs pages; but i didn't see very many. And they were spread out under various features, rather than collected in one place. |
System: Log File. Search for "ROUTING" in the input field. |
After initial setup:
Disconnected and Re-connecting the WAN interface:
|
It looks normal, unfortunately, always using pppoe0 except for rc.bootup, which is prior to wizard use although you probably configured re0 as WAN instead of using the automatic default re1? I'm not sure if that changes things. And speaking of the wizard, is that a general issue with PPPoE setup on your end or just the wizard misbehaving? What happens after a persistent reboot? There needs to be a sort of baseline to when it works and when it doesn't and we don't have that except that although there are problems with PPPoE it should work better than this in any case. It looks like a transient bug and I focused on operational issues... Before you enter the wizard, would you mind deleting the following file?
Cheers, |
The machine has only two interfaces:
Usually that's how i (manually) configure them. This time i was too late pressing the keys, and it guessed right anyway. (In other words, i don't know what re1 would be, or why such a thing would come up).
As far as i know the Wizard executed properly. The PPPoE connection on the WAN adapter does connect and does function (if i force ping to use the PPPoE interface, i can ping Google, 8.8.8.8, and everyone else on the Internet).
This is all from a Live USB stick; i can't have it over-write my router's actual hard drive - because then i lose my current pfSense. :( I never actually tried it before; but i always assume that a Live USB (like a Live CD) loses all it's configuration after reboot. Can it actually persistently run off a USB stick? |
@JackTrapper yes, you can use a nano image for that, it is read-write after boot and configuration persists |
(you can even use the nano to install your running configuration afterwards from the console, run "opnsense-installer") |
Ok, the VGA image does not persist settings between reboots; the initial setup wizard starts. I'll try a nano image tomorrow. |
Where are you finding these latest snapshots from? The earlier links are gone. Is there a place people should be going to find them? |
All prior snapshot images are obsolete because of https://forum.opnsense.org/index.php?topic=7987.0 or see our main mirror for direct download https://pkg.opnsense.org/releases/18.1/ |
Noticed a strange thing with the Javascript, the subnet selection was not deactivated.
|
This bug is still present in the official 18.1.6 release, nano and dvd releases tested. |
Sure, it could be because it was fixed in 18.1.9, not 18.1.6. |
Ok, that's great and sorry for not realizing this. |
We don't usually do 18.1.x image releases, but if you let me know which image/arch you are looking for I can assemble one no problem. :) |
If you could build an amd64 nano 18.1.9 or 18.1.10 img it would be great, thanks.. |
The issue is still present. I tried to get an updated version; but was told they're gone. So i was going to wait for a new version to come out so i could re-re-recreate the issue again. |
@Crisr here you go https://pkg.opnsense.org/FreeBSD:11:amd64/snapshots/OPNsense-18.1.10-OpenSSL-nano-amd64.img.bz2 @JackTrapper All coding help, asking for new images or in-depth analysis is highly appreciated. The fix that went in after 18.1.6 is a likely candidate, but my hands are tied in verifying a working setup without having a PPPoE setup. |
Thank you fichtner! |
I have seen it say no default route set before but everything seems okay, if I could get an image for amd64 for a usb stick that can be installed on an A10 that would be great and much appreciated as always and I can help test as well ??.
The earliest I could have a look at will be next Monday though
…________________________________
From: Crisr <notifications@github.com>
Sent: Wednesday, June 27, 2018 9:10:51 PM
To: opnsense/core
Cc: Subscribed
Subject: Re: [opnsense/core] wizard: WAN over PPPOE - default Route is not set correctly (#2186)
Thank you fichtner!
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub<#2186 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ADddQsGFsOjMcCm_NKdHoa-Qu3w2KRaAks5uA9i7gaJpZM4SAwD0>.
|
Well, the bug is still open in 18.1.10 No way to have a working opnsense router if you have a pppoe internet config using normal installation procedures. It could probably be fixed with some command line instructions but I don't have the knowledge to understand what I'm doing at that level. I've tried 2 installation procedures:
Variant 1: Variant 2: |
I'm clearly unable to fix this. Making room for somebody to step up. @L1ghtn1ng image here https://pkg.opnsense.org/FreeBSD:11:amd64/snapshots/OPNsense-18.1.10-OpenSSL-serial-amd64.img.bz2 |
Thanks for the image, I have pppoe and even though I have seen this in the logs where it says it cannot set route it works fine, as I have stayed or seems to as I am none the wiser and get internet.
What I think would be a idea is to one under the ISP's in question that everyone is using. Getting packed traces of what is coming in to OPNsense and see what we get from comparing the packet dumps.
From: Crisr
Sent: Wednesday 27 June, 22:26
Subject: Re: [opnsense/core] wizard: WAN over PPPOE - default Route is not set correctly (#2186)
To: opnsense/core
Cc: J.Townsend, Comment
Well, the bug is still open in 18.1.10
No way to have a working opnsense router if you have a pppoe internet config using normal installation procedures. It could probably be fixed with some command line instructions but I don't have the knowledge to understand what I'm doing at that level.
It's kind of amazing that such a showstopper bug seems to be carried over so many builds with no fix, probably there are not many using pppoe configurations to connect to the ISPs
I've tried 2 installation procedures:
flashed the usb stick boot the image and then
Variant 1:
2a: set interfaces from command line
2b: set lan ip from command line
2c: access web interface and start setup wizard, setup pppoe config.
2d: access dashboard and check bot lan and wan are up an running (correct IPs loaded, traceroute working).
2e: bug is open: no route to lan clients, no internet access
Variant 2:
2a: wait for the boot to finish and make sure that LAN interface and opnsense box IP is the default 192.168.1.1 in the command line after boot
2b: access web interface and start setup wizard, setup pppoe config.
2c: access dashboard and check bot lan and wan are up an running (correct IPs loaded, traceroute working).
2d: bug is open: no route to lan clients, no internet access
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub<#2186 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ADddQuWCBjRffMJ1f2cFXXmn082vUhMIks5uA-pVgaJpZM4SAwD0>.
|
Update: Well, it seems to be working after all.. don't know what caused it to begin working, however I can list what steps I took after booting for the 1st time:
So yeah, don't know what has happened, don't know if it was something I did or did badly in the beginning, but so far it's working. |
From what I understand this issue is about the wizard's way of setting up PPPoE which is reported to be wrong here, but this does not mean setup of PPPoE is wrong in general, which is part of why this is difficult to pin down without the actual setup and going through the trouble of inspecting what changed between wizard and manual steps. |
Is it possible to rewrite the wizard to do the commands that we know to work when it's done manually? This in turn fix the issue once and for all?
…________________________________
From: Franco Fichtner <notifications@github.com>
Sent: Thursday, June 28, 2018 6:43:41 PM
To: opnsense/core
Cc: J.Townsend; Mention
Subject: Re: [opnsense/core] wizard: WAN over PPPOE - default Route is not set correctly (#2186)
From what I understand this issue is about the wizard's way of setting up PPPoE which is reported to be wrong here, but this does not mean setup of PPPoE is wrong in general, which is part of why this is difficult to pin down without the actual setup and going through the trouble of inspecting what changed between wizard and manual steps.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<#2186 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ADddQmW_DkUAH6kZeu6JdsNIMS1Nmrv3ks5uBQe9gaJpZM4SAwD0>.
|
Has anyone tried 18.7 then? |
I downloaded 18.7 and I tried it this morning. Same problem. The default route is configured to go out the physical WAN interface, rather than out the PPPoE interface: OPNSense (System -> Routes -> Status)
You can compare the equivalent from pfSense: pfSense (Diagnosics -> Routes)
If you try to ping to the Internet it will fail: But if you force the use of the PPPoE interface, it works: I realize this is all deep inside |
This issue has been automatically timed-out (after 180 days of inactivity). For more information about the policies for this repository, If someone wants to step up and work on this issue, |
Version
OPNsense 18.1-amd64
FreeBSD 11.1-RELEASE-p6
OpenSSL 1.0.2n 7 Dec 2017
Failure history
Background
The default route is set to go the physical WAN port, rather than the PPPoE virtual port:
Steps to reproduce
Start fresh, and run the configuration wizard
Welcome to OPNSense! Starting wizard.
General information.
Time Server Information.
Configure WAN Interface
Configure LAN Interface
Set Admin Web GUI Password
Reload Configuration
Finished initial configuration!
How are the routes
So now it is setup. Lets check the routes
System -> Routes -> Status
So it's using the wrong interface as the default route. Lets try pinging.
Interfaces -> Diagnostics -> Ping
Host: 8.8.8.8
IP Protocol: IPv4
Source Address:
Default
Count: 3
Fails. Lets force use of the WAN (i.e. pppoe0) interface:
Host: 8.8.8.8
IP Protocol: IPv4
Source Address: WAN
Count: 3
So if i force the use of the interface, the packets will go. It just doesn't realize the default route.
Disconnect and reconnect PPPoE
Lets try forcing a disconnect and reconnect of the PPPoE interface
Interfaces -> Overview -> WAN Interface (wan, pppoe0)
Status: up
PPPOE: up
Disconnect
Status: down
PPPoE: down
Connect
Status: up
PPPoE: up
And check the routes again
Still the wrong route. What about pinging again
Interface -> Diagnostics -> Ping
Host: 8.8.8.8
IP Protocol: IPv4
Source Address: Default
Count: 3
Nope, still cannot ping using the default gateway.
Disable and re-enable the WAN interface
Lets disable the interface:
Interfaces -> [WAN]
[x]
Enable Interface[ ]
Enable InterfaceAnd re-enable it:
[ ]
Enable Interface[x]
Enable InterfaceAnd check the routes again:
System -> Routes -> Status
Still the wrong route. And ping still fails:
Interfaces -> Diagnostics -> Ping
Host: 8.8.8.8
IP Protocol: IPv4
Source Address: Default
Count: 3
And again if i force the use of PPPoE interface directly, it works:
Host: 8.8.8.8
IP Protocol: IPv4
Source Address: WAN
Count: 3
Even though the PPPoE interface is up, the default interface is out the physical WAN port - with traffic going nowhere.
System -> Routes -> Status
Even though my PPPoE interface is up
System -> Gateways -> Status
If you compare that to pfSense:
The text was updated successfully, but these errors were encountered: