Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

YSFReflector crashed very often #258

Open
W3KIT-910 opened this issue Mar 28, 2021 · 21 comments
Open

YSFReflector crashed very often #258

W3KIT-910 opened this issue Mar 28, 2021 · 21 comments

Comments

@W3KIT-910
Copy link

Running YSFReflector, I have ran into the reflector went down very often. Most of the time right after users unlinked. Here is the log right before it went down. Not sure what to look for. YSFReflector is running on VPS along with an XLX reflector.
M: 2021-03-28 02:36:52.296 Currently linked repeaters/gateways:
M: 2021-03-28 02:36:52.296 W3KIT : 80.130.105.174:32780 1/60
M: 2021-03-28 02:36:52.296 W3KIT : 16.131.105.174:4260 1/60
M: 2021-03-28 02:36:52.296 W3AFA : 240.131.105.174:4260 0/60
M: 2021-03-28 02:36:52.296 : 96.134.105.174:32780 3/60
M: 2021-03-28 02:36:52.296 HS1ZHY : 32.135.105.174:32780 3/60
M: 2021-03-28 02:37:20.874 Received end of transmission
M: 2021-03-28 02:37:23.507 Received data from HS1ZHY to ALL at HS1ZHY
M: 2021-03-28 02:37:55.516 Received end of transmission
M: 2021-03-28 02:37:57.095 Received data from HS9AWO to ALL at HS9AWO
M: 2021-03-28 02:38:04.396 Received end of transmission
M: 2021-03-28 02:38:08.531 Removing (144.121.98.161:32780) unlinked
M: 2021-03-28 02:38:09.323 Removing ▒▒i▒RV (144.121.98.161:32780) unlinked
free(): double free detected in tcache 2
I: 2021-03-28 02:52:28.148 Opening YSF network connection
I: 2021-03-28 02:52:28.148 Opening UDP port on 42000
I: 2021-03-28 02:52:28.149 Opening UDP port on 42000

Thank you, W3KIT / HS0ZOE

@DU8BL
Copy link

DU8BL commented Mar 29, 2021

Running YSFReflector, I have ran into the reflector went down very often. Most of the time right after users unlinked. Here is the log right before it went down. Not sure what to look for. YSFReflector is running on VPS along with an XLX reflector.
M: 2021-03-28 02:36:52.296 Currently linked repeaters/gateways:
M: 2021-03-28 02:36:52.296 W3KIT : 80.130.105.174:32780 1/60
M: 2021-03-28 02:36:52.296 W3KIT : 16.131.105.174:4260 1/60
M: 2021-03-28 02:36:52.296 W3AFA : 240.131.105.174:4260 0/60
M: 2021-03-28 02:36:52.296 : 96.134.105.174:32780 3/60
M: 2021-03-28 02:36:52.296 HS1ZHY : 32.135.105.174:32780 3/60
M: 2021-03-28 02:37:20.874 Received end of transmission
M: 2021-03-28 02:37:23.507 Received data from HS1ZHY to ALL at HS1ZHY
M: 2021-03-28 02:37:55.516 Received end of transmission
M: 2021-03-28 02:37:57.095 Received data from HS9AWO to ALL at HS9AWO
M: 2021-03-28 02:38:04.396 Received end of transmission
M: 2021-03-28 02:38:08.531 Removing (144.121.98.161:32780) unlinked
M: 2021-03-28 02:38:09.323 Removing ▒▒i▒RV (144.121.98.161:32780) unlinked
free(): double free detected in tcache 2
I: 2021-03-28 02:52:28.148 Opening YSF network connection
I: 2021-03-28 02:52:28.148 Opening UDP port on 42000
I: 2021-03-28 02:52:28.149 Opening UDP port on 42000

Thank you, W3KIT / HS0ZOE

Encountering same issue as above

M: 2021-03-27 15:10:05.113 Removing DX8WMG (80.139.88.149:32780) disappeared
M: 2021-03-27 15:10:05.113 Removing DX8WMG (80.139.88.149:32780) disappeared
M: 2021-03-27 15:10:42.310 Removing 0ŽX•ÞU (144.141.88.149:33036) disappeared

@W3KIT-910
Copy link
Author

Yes, still happening. Not sure how to fix it :D Thanks to YSFRfelector sending out email notifying "Your YSF Reflector is DEAD" :D

● YSFReflector.service - YSFReflector W3KIT
Loaded: loaded (/etc/systemd/system/YSFReflector.service; enabled; vendor preset: enabled)
Active: failed (Result: signal) since Wed 2021-03-31 10:58:23 EDT; 2min 19s ago
Process: 5477 ExecStart=/usr/local/bin/YSFReflector /etc/YSFReflector.ini (code=killed, signal=ABRT)
Main PID: 5477 (code=killed, signal=ABRT)

Mar 31 10:57:34 w3kit-xlx1 YSFReflector[5477]: M: 2021-03-31 14:57:34.213 : 0.149.0.2:6063 11/60
Mar 31 10:57:34 w3kit-xlx1 YSFReflector[5477]: M: 2021-03-31 14:57:34.315 Received data from HS8AFA to ALL at W3KIT
Mar 31 10:57:54 w3kit-xlx1 YSFReflector[5477]: M: 2021-03-31 14:57:54.927 Received end of transmission
Mar 31 10:58:04 w3kit-xlx1 YSFReflector[5477]: M: 2021-03-31 14:58:04.026 Received data from W3KIT-KIT to ALL at W3KIT
Mar 31 10:58:14 w3kit-xlx1 YSFReflector[5477]: M: 2021-03-31 14:58:14.546 Received end of transmission
Mar 31 10:58:17 w3kit-xlx1 YSFReflector[5477]: M: 2021-03-31 14:58:17.922 Received data from HS8AFA to ALL at W3KIT
Mar 31 10:58:23 w3kit-xlx1 YSFReflector[5477]: M: 2021-03-31 14:58:23.120 Removing (0.149.0.2:6063) disappeared
Mar 31 10:58:23 w3kit-xlx1 YSFReflector[5477]: free(): double free detected in tcache 2
Mar 31 10:58:23 w3kit-xlx1 systemd[1]: YSFReflector.service: Main process exited, code=killed, status=6/ABRT
Mar 31 10:58:23 w3kit-xlx1 systemd[1]: YSFReflector.service: Failed with result 'signal'.

@N6DOZ
Copy link

N6DOZ commented Apr 1, 2021

I went around this issue, as a temporary fix by adding a couple of lines in the /etc/systemd/system/ysfreflector.service - telling it to restart if the reflector dies. Here's my whole service script (bolded added lines):

[Unit]
Description=YSFReflector

[Service]
Type=forking
ExecStart=/ysfreflector/YSFReflector /ysfreflector/YSFReflector.ini
Restart=always
RestartSec=3

[Install]
WantedBy=multi-user.target
Alias=ysfreflector.service


Running...

Operating System: Debian GNU/Linux 10 (buster)
Kernel: Linux 4.19.0-16-amd64
Architecture: x86-64

YSFReflector version 20210215

@W3KIT-910
Copy link
Author

@ N6DOZ, thank you OM. When I get a chance I will be adding those two lines in the service.

You have seen this error in the past? I have 2 YSFReflectors running, one with XLX and one standalone. Both are on the different locations and different OS but I have seen the error on both.

@N6DOZ
Copy link

N6DOZ commented Apr 1, 2021

@W3KIT-910 most welcome. Hope it works out for you.

I have the current YSFReflector rolled out on four different installations. I've tried it with and without an XLX reflector, as well as with Debian 9 (stretch)—the behavior is the same. Every 4-5 hours, the YSFReflector would just die and I would get a notification from YSFReflector-Registry that the reflector(s) are down.

The previous version/install had no issue at all on both Debian 9 and 10. I'm kicking myself because I didn't keep the old installation somewhere. Take care and 7-3.

@W3KIT-910
Copy link
Author

Someone somewhere have to know something. Having a separate test YSF reflector up and running Debian 9, 10 also Ubuntu 20.04. YSFReflector revision 20210215, They all crashed pretty much the same way, 99% of the time when user is leaving / unlinked from the reflector.

@N6DOZ
Copy link

N6DOZ commented Apr 2, 2021

@W3KIT-910 showed me the branches:
https://github.com/g4klx/YSFClients/branches/all

Ended up rolling back to 5 months ago, until a new version comes out. Thank you @W3KIT-910. 7-3 N6DOZ.

@yodasands
Copy link

I am also having this issue. I have tried installing on multiple raspberry pi’s and Ubuntu 16.04. It disconnects within a few hours and I need to reboot the device to bring it back online.

Thank you and 73

@K9JTV
Copy link

K9JTV commented Apr 27, 2021

I am having the same problem with a YSFReflector instance on a Raspberry-Pi 3B+. This is my first attempt at setting up a reflector, and I'm not well versed in Linux. I thought I would set up the workaround listed above by N6DOZ, but when I browse to /etc/systemd/system/, there is no ysfreflector.service file. Has anyone identified the problem with this? Also, what do I need to do to implement ysfreflector.service?

Thanks and 73,
-Jeff, K9JTV

@yodasands
Copy link

yodasands commented Apr 27, 2021 via email

@K9JTV
Copy link

K9JTV commented Apr 27, 2021

Can you or anyone tell me where I can find last year's version?

TIA,
-Jeff, K9JTV

I have played with it on several different platforms and it persists across all of them. I haven’t found a solid work around that keeps the reflector running consistently.  My reflectors are running a version from last year. Until this issue is resolved I doubt anyone will have luck getting a stable reflector setup on this version. 73’s Dan - W7DJS

On Apr 26, 2021, 5:07 PM -0700, Jeff Snodgrass @.***>, wrote: I am having the same problem with a YSFReflector instance on a Raspberry-Pi 3B+. This is my first attempt at setting up a reflector, and I'm not well versed in Linux. I thought I would set up the workaround listed above by N6DOZ, but when I browse to /etc/systemd/system/, there is no ysfreflector.service file. Has anyone identified the problem with this? Also, what do I need to do to implement ysfreflector.service? Thanks and 73, -Jeff, K9JTV — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe.

@DU8BL
Copy link

DU8BL commented Apr 27, 2021 via email

@N6DOZ
Copy link

N6DOZ commented Apr 27, 2021

I've been using this fork from OE1KBC for a few weeks on several reflectors I operate.
https://github.com/oe1kbc/YSFClients

Uptime of 2 weeks and 3 days so far. Aside from the double logging of nodes issue, it works and quite stable. However, I'll try what DV8AWC suggested as well.
https://github.com/g4klx/YSFClients/tree/035249b5e09848882a0ce4b0f37f772fc097591f

This is what I did.

  • Left the current installation intact
  • Stoped the process > systemctl stop ysfreflector.service
  • Renamed current installed executable > mv /ysfrelfector/YSFReflector /ysfreflector/YSFReflector-20210215
  • Went into home directory > cd ~
  • Downloaded the code > wget https://github.com/g4klx/YSFClients/archive/035249b5e09848882a0ce4b0f37f772fc097591f.zip
  • Unzipped it > unzip 035249b.zip
  • Renamed the directory mv YSFClients-035249b5e09848882a0ce4b0f37f772fc097591f to YSFClients-0352
  • Went into the YSFReflector directory > cd YSFClients-0352/YSFReflector
  • Executed compile > make clean all
  • Copied new executable to the ysf directory > cp YSFReflector /ysfreflector/
  • Ran it > systemctl restart ysfreflector.service

Running YSFReflector Version: 20201124 on a test environment and look at that, no double logging, however it does come with the IP address bug where all connected nodes have the same IP address ;). Let's see how it works and if it's good, I'll roll it out on the production live reflectors.

Hope that helps @K9JTV Jeff and thanks to @dv8awc for pointing out where the exact commit was (this was the version I had running the longest before I moved my cloud servers around).

Good luck to all. 7-3 N6DOZ

@K9JTV
Copy link

K9JTV commented Apr 27, 2021

Well my system wasn't configured quite like yours but I fumbled through everything by trial and error and got it patched and back up and running. Now to see if it drops offline again.

Thanks N6DOZ and everyone for your help.

-Jeff, K9JTV

@dg9vh
Copy link
Contributor

dg9vh commented Apr 27, 2021

Another try could be using https://github.com/iu5jae/pYSFReflector meanwhile...

Also vy stable and easy to install.

73 de Kim
DG9VH

@K9JTV
Copy link

K9JTV commented Apr 28, 2021

Been up over 16 hours without a drop out. That's the longest I've ever been up. Maybe this is fixed for now!

Thanks again everyone,

-Jeff, K9JTV

@yodasands
Copy link

yodasands commented Apr 28, 2021 via email

@K9JTV
Copy link

K9JTV commented Apr 28, 2021

Jeff, Which version are you using? Dan

On Apr 27, 2021, 5:49 PM -0700, Jeff Snodgrass @.***>, wrote: Been up over 16 hours without a drop out. That's the longest I've ever been up. Maybe this is fixed for now! Thanks again everyone, -Jeff, K9JTV — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe.

The one that N6DOZ listed above:

https://github.com/g4klx/YSFClients/archive/035249b5e09848882a0ce4b0f37f772fc097591f.zip

-Jeff, K9JTV

@DU8BL
Copy link

DU8BL commented Apr 28, 2021 via email

@W3KIT-910
Copy link
Author

I went the version 20200429 and it has been solid. I am sure I am missing some bugs fixed or features. But at least this version was the most stable for me, no email from YSF registration site for weeks. Reflector only goes down when I am taking down myself, not crashed on it own.

Currently I am testing the one that Kim posted, it is a Python version from IU5JAE.

So far so good, have not testing it long enough to say one way or the other.

73, Kit

@K9JTV
Copy link

K9JTV commented Apr 29, 2021

Been up for over 48 hours now without a dropout. I would say it's fixed. Thanks for the help.

-Jeff

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants