Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow Re-indexing of Devices to be Scheduled #3578

Closed
troyfreytag opened this issue May 27, 2020 · 4 comments
Closed

Allow Re-indexing of Devices to be Scheduled #3578

troyfreytag opened this issue May 27, 2020 · 4 comments
Labels
automation Automation related issue enhancement General tag for an enhancement poller Data Collection related issue resolved A fixed issue
Milestone

Comments

@troyfreytag
Copy link

Feature Request

Is your feature request related to a problem? Please describe

Automatic re-indexing of devices using the index-count re-index method on data queries does not work for us, and we rarely reboot devices. The issue with the index-count method is that most of our devices do not handle the interface index count OID correctly and report a different value than the actual number of interfaces returned by the SNMP - Interface Statistics data query.

Describe the solution you'd like

We would like a method of scheduling a re-index of a device, that can be per device or tied to a device template, based on timing and not an event. For example, we would like to have devices that the interface index count changes frequently re-index once a day while other devices would automatically re-index once a week.

Describe alternatives you've considered

An alternate solution we tried for the data query index-count method was removing the index count OID from the interfaces.xml file and letting Cacti count the number of returned rows instead. This worked for some devices, but caused more problems on others. A large number of devices return additional info (Ex. Interface Descriptions or IP Addresses) that are not necessarily tied to an ifIndex. Each piece of additional info is given its own row and adds to the row count.

From what I gathered by testing, without the interface count OID in the XML file, the index-count method compares only the number of rows returned when polling the IfIndex OID tree to the total number of rows returned when processing the data query, which includes the extra rows added by additional info. As a result, our devices still re-index every poling cycle.

For now, we periodically go through our devices and re-index them manually.

@troyfreytag troyfreytag added the enhancement General tag for an enhancement label May 27, 2020
@netniV netniV added the poller Data Collection related issue label May 27, 2020
@netniV netniV added this to the v1.3.0 milestone May 27, 2020
@netniV
Copy link
Member

netniV commented May 27, 2020

Seems reasonable. First step, would be introducing the ability to set a global schedule, then introduce template/device level option overrides.

@netniV
Copy link
Member

netniV commented Aug 16, 2020

One thing that a recent comment has highlighted is that this could end up generating lots of new data sources and graphs if automatic creation is enabled with automation.

@vbarahona
Copy link

One thing that a recent comment has highlighted is that this could end up generating lots of new data sources and graphs if automatic creation is enabled with automation.

True. Actually in my environment that will be the desired behavior as we decide which interface graph using ifDesc. So if there is a change in ifDesc we have to reindex manually. It will be very appreciated including a timing policy for reindexing.

@TheWitness TheWitness added the automation Automation related issue label Jan 4, 2021
@TheWitness TheWitness modified the milestones: v1.3.0, v1.2.23 Oct 17, 2022
TheWitness added a commit that referenced this issue Nov 18, 2022
Scheduled Automatic Re-indexing of Devices
@TheWitness TheWitness added the resolved A fixed issue label Nov 18, 2022
@TheWitness
Copy link
Member

This is resolved. Review the commit and provide comments. Basically midnight or so on select frequencies and days.

@netniV netniV changed the title Scheduled Automatic Re-indexing of Devices Allow Re-indexing of Devices to be Scheduled Dec 31, 2022
@github-actions github-actions bot locked and limited conversation to collaborators Apr 2, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
automation Automation related issue enhancement General tag for an enhancement poller Data Collection related issue resolved A fixed issue
Projects
None yet
Development

No branches or pull requests

4 participants