PDU's discovery of outlet banks, but banks then are removed after being polled #5881

Closed
jsdurling opened this Issue Feb 13, 2017 · 13 comments

Comments

Projects
None yet
5 participants
@jsdurling

DO NOT DELETE THIS INFORMATION.

Please read this information carefully.

GitHub issues is for bugs, please do not post issues asking for help or how to do X, Y or Z.
You can use our irc channel ##librenms on freenode to ask questions or our community site.
If you have a feature request please post this on our community site.

Please confirm each of the sections below by putting an x in the box like [x].

  • [X ] Is your install up to date? Updating your install
    Please do not submit an issue if your install is not up to date within the last 24 hours or on a stable monthly release.

  • [X ] Please include all of the information between the ==================================== section of ./validate.php which you can run from the cli.
    Component | Version
    --------- | -------
    LibreNMS | 4ef0a2d
    DB Schema | 163
    PHP | 7.0.14
    MySQL | 5.5.52-MariaDB
    RRDTool | 1.4.8
    SNMP | NET-SNMP 5.7.2

  • Please provide ALL info asked for here.

  • Please provide as much detail as possible.

I had numerous PDU's that were reporting the bank1, bank2, and total polling properly up until midnight on Feb 3. Since them, I can manually run a discovery and the bank1, bank2, and bank total shows up, and the poller will poll them, but after a period of time, the PDU banks are missing. Across all the PDU's/

https://gist.github.com/jsdurling/36de6269ded3f5a7f6196f297cda1531

@laf

This comment has been minimized.

Show comment
Hide comment
@laf

laf Feb 13, 2017

Member

You haven't provided the information we ask for and instead have provided snippets which are of no use to us.

Member

laf commented Feb 13, 2017

You haven't provided the information we ask for and instead have provided snippets which are of no use to us.

@jviersel

This comment has been minimized.

Show comment
Hide comment
@jviersel

jviersel Feb 20, 2017

Contributor

I experience the same problem with ipoman powerbars. I discovered the sensors are removed during discovery-process for all scanned powerbars, except the last one. If i use a pattern for the hostname while running discovery.php, only the last matching hostname keeps it sensors. When i use an exact hostname, all sensors are added (probably because there's just one hostname in the list of matches).

Workaround for the problem: use discovery-wrapper.py instead of discovery.php in your cronjob. discovery-wrapper.py runs discovery.php with just one hostname at a time.

Contributor

jviersel commented Feb 20, 2017

I experience the same problem with ipoman powerbars. I discovered the sensors are removed during discovery-process for all scanned powerbars, except the last one. If i use a pattern for the hostname while running discovery.php, only the last matching hostname keeps it sensors. When i use an exact hostname, all sensors are added (probably because there's just one hostname in the list of matches).

Workaround for the problem: use discovery-wrapper.py instead of discovery.php in your cronjob. discovery-wrapper.py runs discovery.php with just one hostname at a time.

@laf

This comment has been minimized.

Show comment
Hide comment
@laf

laf Feb 20, 2017

Member

We need the info asked for in point 3 above, in this situation with two hosts run at the same time to see the data.

Member

laf commented Feb 20, 2017

We need the info asked for in point 3 above, in this situation with two hosts run at the same time to see the data.

@jviersel

This comment has been minimized.

Show comment
Hide comment
@jviersel

jviersel Feb 20, 2017

Contributor

Here's the output of discovery.php for 2 hosts: discovery.txt

I expect the output of discovery.php to be enough, as the issue is discovery-related. If you also need the output of poller.php, please let me know.

Contributor

jviersel commented Feb 20, 2017

Here's the output of discovery.php for 2 hosts: discovery.txt

I expect the output of discovery.php to be enough, as the issue is discovery-related. If you also need the output of poller.php, please let me know.

@jsdurling

This comment has been minimized.

Show comment
Hide comment
@jsdurling

jsdurling Feb 22, 2017

Yeah, I totally missed what you needed, it was right in front of my face, but I just didn't realize what you were asking for. :-/

So, attached are the needed files. My sincere apologies.

pdu.discovery.txt
pdu.poller.txt
pdu.snmpbulkwalk.txt

Yeah, I totally missed what you needed, it was right in front of my face, but I just didn't realize what you were asking for. :-/

So, attached are the needed files. My sincere apologies.

pdu.discovery.txt
pdu.poller.txt
pdu.snmpbulkwalk.txt

laf added a commit to laf/librenms that referenced this issue Feb 23, 2017

@laf

This comment has been minimized.

Show comment
Hide comment
@laf

laf Feb 23, 2017

Member

@jviersel I don't think your issue is the same, please test: #5983

Member

laf commented Feb 23, 2017

@jviersel I don't think your issue is the same, please test: #5983

@murrant

This comment has been minimized.

Show comment
Hide comment
@murrant

murrant Feb 24, 2017

Member

Neither of these snmpbulkwalks are correct. You need the . (dot) at the end of the command:
snmpbulkwalk -OUneb -v2c -c COMMUNITY HOSTNAME .

Member

murrant commented Feb 24, 2017

Neither of these snmpbulkwalks are correct. You need the . (dot) at the end of the command:
snmpbulkwalk -OUneb -v2c -c COMMUNITY HOSTNAME .

@jsdurling

This comment has been minimized.

Show comment
Hide comment
@jsdurling

jsdurling Feb 24, 2017

Attaching the correct bulkwalk.

pdu.snmpbulkwalk.txt

Attaching the correct bulkwalk.

pdu.snmpbulkwalk.txt

@jsdurling

This comment has been minimized.

Show comment
Hide comment
@jsdurling

jsdurling Feb 27, 2017

Using the discovery-wrapper.py rather than the standard discovery.php in my crond job appears to fix this. I'll do some additional testing.

Using the discovery-wrapper.py rather than the standard discovery.php in my crond job appears to fix this. I'll do some additional testing.

@wdst-gcet

This comment has been minimized.

Show comment
Hide comment
@wdst-gcet

wdst-gcet Feb 28, 2017

We have noticed something similar with our Eaton PDUs. When we discover them using the capture feature in the web UI all the outlets show up. But after a few hours the outlets are deleted. We see this activity in the event viewer.

screen shot 2017-02-27 at 7 49 13 pm

We have noticed something similar with our Eaton PDUs. When we discover them using the capture feature in the web UI all the outlets show up. But after a few hours the outlets are deleted. We see this activity in the event viewer.

screen shot 2017-02-27 at 7 49 13 pm

@laf laf added Needs-Verification and removed Wontfix labels Mar 1, 2017

@laf

This comment has been minimized.

Show comment
Hide comment
@laf

laf Mar 1, 2017

Member

@jviersel can you test the patch I linked to above as I think that will fix your problem.

Member

laf commented Mar 1, 2017

@jviersel can you test the patch I linked to above as I think that will fix your problem.

@laf

This comment has been minimized.

Show comment
Hide comment
@laf

laf Mar 5, 2017

Member

Pretty sure this is now resolved.

Member

laf commented Mar 5, 2017

Pretty sure this is now resolved.

@laf laf closed this Mar 5, 2017

laf added a commit that referenced this issue Mar 6, 2017

fix: Refactor ipoman cache code to use pre-cache in sensors #5881 (#5983
)

* fix: Refactor ipoman cache code to use pre-cache in sensors #5881

* added missing file
@lock

This comment has been minimized.

Show comment
Hide comment
@lock

lock bot May 17, 2018

This thread has been automatically locked since there has not been any recent activity after it was closed.

lock bot commented May 17, 2018

This thread has been automatically locked since there has not been any recent activity after it was closed.

@librenms librenms locked as resolved and limited conversation to collaborators May 17, 2018

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.