Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

pfdhcplistener: Segfaulting when keepalived transitions quickly from backup/master/backup #1737

Closed
julsemaan opened this issue Oct 5, 2016 · 2 comments
Closed

pfdhcplistener: Segfaulting when keepalived transitions quickly from backup/master/backup #1737

julsemaan opened this issue Oct 5, 2016 · 2 comments
Assignees
@julsemaan
Labels
Type: Bug
Milestone
PacketFence-7.0

Comments

@julsemaan
Copy link
Collaborator

pfdhcplistener segfaults during quick down/up/down of keepalived interfaces

Syslog line:

Oct  4 23:42:25 pf-zammitcorp kernel: pfdhcplistener[11660]: segfault at 3b ip 00007efca39dea1f sp 00007ffd512eec70 error 4 in libperl.so[7efca3926000+162000]

Full syslog around that time:

Oct  4 23:42:22 pf-zammitcorp Keepalived_vrrp[12989]: VRRP_Instance(172.23.30.12) Transition to MASTER STATE
Oct  4 23:42:22 pf-zammitcorp Keepalived_vrrp[12989]: VRRP_Instance(172.21.30.12) Transition to MASTER STATE
Oct  4 23:42:22 pf-zammitcorp Keepalived_vrrp[12989]: VRRP_Instance(172.22.30.12) Transition to MASTER STATE
Oct  4 23:42:23 pf-zammitcorp Keepalived_vrrp[12989]: VRRP_Instance(172.23.30.12) Entering MASTER STATE
Oct  4 23:42:23 pf-zammitcorp Keepalived_vrrp[12989]: Remote SMTP server [0.0.0.0]:25 connected.
Oct  4 23:42:23 pf-zammitcorp Keepalived_vrrp[12989]: VRRP_Instance(172.21.30.12) Entering MASTER STATE
Oct  4 23:42:23 pf-zammitcorp Keepalived_vrrp[12989]: Remote SMTP server [0.0.0.0]:25 connected.
Oct  4 23:42:23 pf-zammitcorp Keepalived_vrrp[12989]: VRRP_Instance(172.22.30.12) Entering MASTER STATE
Oct  4 23:42:23 pf-zammitcorp Keepalived_vrrp[12989]: Remote SMTP server [0.0.0.0]:25 connected.
Oct  4 23:42:23 pf-zammitcorp Keepalived_vrrp[12989]: SMTP alert successfully sent.
Oct  4 23:42:23 pf-zammitcorp Keepalived_vrrp[12989]: SMTP alert successfully sent.
Oct  4 23:42:23 pf-zammitcorp Keepalived_vrrp[12989]: SMTP alert successfully sent.
Oct  4 23:42:24 pf-zammitcorp ntpd[2019]: Listen normally on 377 eth1.10 172.21.30.10 UDP 123
Oct  4 23:42:24 pf-zammitcorp ntpd[2019]: Listen normally on 378 eth1.8 172.23.30.10 UDP 123
Oct  4 23:42:24 pf-zammitcorp ntpd[2019]: Listen normally on 379 eth1.9 172.22.30.10 UDP 123
Oct  4 23:42:24 pf-zammitcorp Keepalived_vrrp[12989]: VRRP_Instance(172.23.30.12) Received higher prio advert
Oct  4 23:42:24 pf-zammitcorp Keepalived_vrrp[12989]: VRRP_Instance(172.23.30.12) Entering BACKUP STATE
Oct  4 23:42:24 pf-zammitcorp Keepalived_vrrp[12989]: Remote SMTP server [0.0.0.0]:25 connected.
Oct  4 23:42:24 pf-zammitcorp Keepalived_vrrp[12989]: VRRP_Instance(172.21.30.12) Received higher prio advert
Oct  4 23:42:24 pf-zammitcorp Keepalived_vrrp[12989]: VRRP_Instance(172.21.30.12) Entering BACKUP STATE
Oct  4 23:42:24 pf-zammitcorp Keepalived_vrrp[12989]: Remote SMTP server [0.0.0.0]:25 connected.
Oct  4 23:42:24 pf-zammitcorp Keepalived_vrrp[12989]: VRRP_Instance(172.22.30.12) Received higher prio advert
Oct  4 23:42:24 pf-zammitcorp Keepalived_vrrp[12989]: VRRP_Instance(172.22.30.12) Entering BACKUP STATE
Oct  4 23:42:24 pf-zammitcorp Keepalived_vrrp[12989]: Remote SMTP server [0.0.0.0]:25 connected.
Oct  4 23:42:24 pf-zammitcorp Keepalived_vrrp[12989]: SMTP alert successfully sent.
Oct  4 23:42:24 pf-zammitcorp Keepalived_vrrp[12989]: SMTP alert successfully sent.
Oct  4 23:42:24 pf-zammitcorp Keepalived_vrrp[12989]: SMTP alert successfully sent.
Oct  4 23:42:25 pf-zammitcorp kernel: pfdhcplistener[11660]: segfault at 3b ip 00007efca39dea1f sp 00007ffd512eec70 error 4 in libperl.so[7efca3926000+162000]
Oct  4 23:42:25 pf-zammitcorp kernel: device eth1.9 left promiscuous mode
Oct  4 23:42:25 pf-zammitcorp monit[2144]: 'packetfence-pfdhcplistener_eth1.9' process is not running
Oct  4 23:42:26 pf-zammitcorp ntpd[2019]: Deleting interface #379 eth1.9, 172.22.30.10#123, interface stats: received=0, sent=0, dropped=0, active_time=2 secs
Oct  4 23:42:26 pf-zammitcorp ntpd[2019]: Deleting interface #378 eth1.8, 172.23.30.10#123, interface stats: received=0, sent=0, dropped=0, active_time=2 secs
Oct  4 23:42:26 pf-zammitcorp ntpd[2019]: Deleting interface #377 eth1.10, 172.21.30.10#123, interface stats: received=0, sent=0, dropped=0, active_time=2 secs
Oct  4 23:42:26 pf-zammitcorp monit[2144]: 'packetfence-pfdhcplistener_eth1.9' trying to restart
Oct  4 23:42:26 pf-zammitcorp monit[2144]: 'packetfence-pfdhcplistener_eth1.9' start: /usr/local/pf/sbin/pfdhcplistener

Nothing really interesting in pfdhcplistener.log except this recurring warning:

Oct 04 23:42:25 pfdhcplistener(12009) ERROR: Use of uninitialized value in string eq at /usr/local/pf/lib/pf/cluster.pm line 339.
 (pf::cluster::is_vip_running)
@julsemaan julsemaan added this to the +1 (patch release) milestone Oct 5, 2016
@julsemaan julsemaan self-assigned this Oct 5, 2016
@julsemaan
Copy link
Collaborator Author

Core dumps have been enabled on the affected setup. This is happening every night so we should have an analyzable dump fairly quickly

@julsemaan
Copy link
Collaborator Author

can't seem to have an analyzable core dump for this and pfdhcplistener stopped misbehaving there

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@julsemaan julsemaan

Labels
Type: Bug
Projects
None yet
Milestone
PacketFence-7.0
Development

No branches or pull requests
2 participants
@extrafu @julsemaan