Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Devices may experience constant reindexing #2380

Closed
oshiewan opened this issue Feb 7, 2019 · 10 comments
Closed

Devices may experience constant reindexing #2380

oshiewan opened this issue Feb 7, 2019 · 10 comments
Labels
3rd Party Bug 3rd party bug bug Undesired behaviour resolved A fixed issue

Comments

@oshiewan
Copy link
Contributor

oshiewan commented Feb 7, 2019

In the update_reindex_cache function within lib/poller.php if the reindex method is Index Count we get the number of indexes from a query against host_snmp_cache but the logic is slightly flawed, at least for some devices I have.

                        /* the assert_value counts the number of distinct indexes currently available in host_snmp_cache
                         * we do NOT make use of <oid_num_indexes> or the like!
                         * this works, even if no <oid_num_indexes> was given
                         */
                        $assert_value = cacti_sizeof(db_fetch_assoc_prepared('SELECT ' . SQL_NO_CACHE . ' snmp_index
                                FROM host_snmp_cache
                                WHERE host_id = ?
                                AND snmp_query_id = ?
                                GROUP BY snmp_index',
                                array($host_id, $data_query_id)));

Now this query returns more values than <oid_num_indexes> or by an snmpwalk for indexes.

Example:

snmpwalk -v 2c -c something 10.6.15.195 .1.3.6.1.2.1.2.1.0
IF-MIB::ifNumber.0 = INTEGER: 33

snmpwalk -v 2c -c something 10.6.15.195 .1.3.6.1.2.1.2.2.1.1
IF-MIB::ifIndex.262 = INTEGER: 262
IF-MIB::ifIndex.390 = INTEGER: 390
IF-MIB::ifIndex.514 = INTEGER: 514
IF-MIB::ifIndex.642 = INTEGER: 642
IF-MIB::ifIndex.770 = INTEGER: 770
IF-MIB::ifIndex.898 = INTEGER: 898
IF-MIB::ifIndex.1026 = INTEGER: 1026
IF-MIB::ifIndex.1154 = INTEGER: 1154
IF-MIB::ifIndex.1282 = INTEGER: 1282
IF-MIB::ifIndex.1410 = INTEGER: 1410
IF-MIB::ifIndex.1538 = INTEGER: 1538
IF-MIB::ifIndex.1666 = INTEGER: 1666
IF-MIB::ifIndex.1794 = INTEGER: 1794
IF-MIB::ifIndex.1922 = INTEGER: 1922
IF-MIB::ifIndex.2050 = INTEGER: 2050
IF-MIB::ifIndex.2178 = INTEGER: 2178
IF-MIB::ifIndex.2306 = INTEGER: 2306
IF-MIB::ifIndex.2434 = INTEGER: 2434
IF-MIB::ifIndex.2562 = INTEGER: 2562
IF-MIB::ifIndex.2690 = INTEGER: 2690
IF-MIB::ifIndex.2818 = INTEGER: 2818
IF-MIB::ifIndex.2946 = INTEGER: 2946
IF-MIB::ifIndex.3074 = INTEGER: 3074
IF-MIB::ifIndex.3202 = INTEGER: 3202
IF-MIB::ifIndex.3330 = INTEGER: 3330
IF-MIB::ifIndex.3458 = INTEGER: 3458
IF-MIB::ifIndex.3585 = INTEGER: 3585
IF-MIB::ifIndex.3713 = INTEGER: 3713
IF-MIB::ifIndex.3841 = INTEGER: 3841
IF-MIB::ifIndex.3969 = INTEGER: 3969
IF-MIB::ifIndex.4102 = INTEGER: 4102
IF-MIB::ifIndex.4230 = INTEGER: 4230
IF-MIB::ifIndex.4358 = INTEGER: 4358
[/usr/share/cacti]

snmpwalk -v 2c -c something 10.6.15.195 .1.3.6.1.2.1.2.2.1.1 | wc -l
33

All 33, but using the function it gets 34.

MariaDB [cacti]> select snmp_index from host_snmp_cache where host_id=6961 AND snmp_query_id=1 group by snmp_index;
+------------+
| snmp_index |
+------------+
| 1026 |
| 1154 |
| 128 |
| 1282 |
| 1410 |
| 1538 |
| 1666 |
| 1794 |
| 1922 |
| 2050 |
| 2178 |
| 2306 |
| 2434 |
| 2562 |
| 262 |
| 2690 |
| 2818 |
| 2946 |
| 3074 |
| 3202 |
| 3330 |
| 3458 |
| 3585 |
| 3713 |
| 3841 |
| 390 |
| 3969 |
| 4102 |
| 4230 |
| 4358 |
| 514 |
| 642 |
| 770 |
| 898 |
+------------+
34 rows in set (0.00 sec)

If I add a bit more info, the cause can be seen, we are getting an index for an ifIP entry as well

MariaDB [cacti]> select snmp_index, field_name from host_snmp_cache where host_id=6961 AND snmp_query_id=1 group by snmp_index;
+------------+------------+
| snmp_index | field_name |
+------------+------------+
| 1026 | ifAlias |
| 1154 | ifAlias |
| 128 | ifIP |
| 1282 | ifAlias |
| 1410 | ifAlias |
| 1538 | ifAlias |
| 1666 | ifAlias |
| 1794 | ifAlias |
| 1922 | ifAlias |
| 2050 | ifAlias |
| 2178 | ifAlias |
| 2306 | ifAlias |
| 2434 | ifAlias |
| 2562 | ifAlias |
| 262 | ifAlias |
| 2690 | ifAlias |
| 2818 | ifAlias |
| 2946 | ifAlias |
| 3074 | ifAlias |
| 3202 | ifAlias |
| 3330 | ifAlias |
| 3458 | ifAlias |
| 3585 | ifAlias |
| 3713 | ifAlias |
| 3841 | ifAlias |
| 390 | ifAlias |
| 3969 | ifAlias |
| 4102 | ifAlias |
| 4230 | ifAlias |
| 4358 | ifAlias |
| 514 | ifAlias |
| 642 | ifAlias |
| 770 | ifAlias |
| 898 | ifAlias |
+------------+------------+
34 rows in set (0.00 sec)

Suggested fix is to tweak the query to use the sort_field from host_snmp_query as well? Might not be the most elegant solution, I'm sure someone could come up with something better.

MariaDB [cacti]> select snmp_index from host_snmp_cache WHERE host_id=6961 AND snmp_query_id=1 and field_name=(SELECT sort_field from host_snmp_query where host_id=6961 and snmp_query_id=1) group by snmp_index;
+------------+
| snmp_index |
+------------+
| 1026 |
| 1154 |
| 1282 |
| 1410 |
| 1538 |
| 1666 |
| 1794 |
| 1922 |
| 2050 |
| 2178 |
| 2306 |
| 2434 |
| 2562 |
| 262 |
| 2690 |
| 2818 |
| 2946 |
| 3074 |
| 3202 |
| 3330 |
| 3458 |
| 3585 |
| 3713 |
| 3841 |
| 390 |
| 3969 |
| 4102 |
| 4230 |
| 4358 |
| 514 |
| 642 |
| 770 |
| 898 |
+------------+
33 rows in set (0.00 sec)

Correct values now returned.

@cigamit
Copy link
Member

cigamit commented Feb 7, 2019

Fantastic find. I was just reviewing another bug yesterday and found some other interesting behavior with some queries in Cacti, that due to their unneeded complexity sometimes create results that are unexpected.

@oshiewan
Copy link
Contributor Author

oshiewan commented Feb 7, 2019

I don't like to raise issues without working out why it didn't work. Working on a couple of other problems using remote pollers/reindexing

cigamit added a commit that referenced this issue Feb 7, 2019
reindex constantly triggered for some devices
@cigamit
Copy link
Member

cigamit commented Feb 7, 2019

Please test the latest update. This is the most efficient way to resolve the issue I think.

@cigamit cigamit added bug Undesired behaviour resolved A fixed issue labels Feb 7, 2019
@oshiewan
Copy link
Contributor Author

oshiewan commented Feb 8, 2019

This gives exactly the same result as earlier.

MariaDB [cacti]> select distinct snmp_index from host_snmp_cache where host_id=6961 and snmp_query_id=1 and snmp_index != "";
+------------+
| snmp_index |
+------------+
| 1026 |
| 1154 |
| 1282 |
| 1410 |
| 1538 |
| 1666 |
| 1794 |
| 1922 |
| 2050 |
| 2178 |
| 2306 |
| 2434 |
| 2562 |
| 262 |
| 2690 |
| 2818 |
| 2946 |
| 3074 |
| 3202 |
| 3330 |
| 3458 |
| 3585 |
| 3713 |
| 3841 |
| 390 |
| 3969 |
| 4102 |
| 4230 |
| 4358 |
| 514 |
| 642 |
| 770 |
| 898 |
| 128 |
+------------+
34 rows in set (0.01 sec)

It still has an snmp_index value for ifIP query so it's still 34 instead of 33.

@cigamit
Copy link
Member

cigamit commented Feb 8, 2019

Well, there is another problem then, you should not be getting an IP address returned for an index that does not exist. Do a verbose query of the device. If you can post the output here. You can copy the entire verbose query contents by clicking the copy link at the top of the verbose query output. Obfuscate as you feel appropriate.

@oshiewan
Copy link
Contributor Author

oshiewan commented Feb 8, 2019

Full output is pasted below, but to summarise, it returns an ifIP entry for 127.0.0.1 with an index of 128. It doesn't spit out that index in a walk for anything else such as ifIndex as it's "not interesting", but does respond if you directly query the snmp_index.
-> snmpwalk -v 2c -c something 10.6.15.195 .1.3.6.1.2.1.31.1.1.1.1.128
IF-MIB::ifName.128 = STRING: InLoopBack0

I'd say this is probably because it's an old outdated switch so might not happen for many people. I'm just lucky that way.


Data Query Debug Information
Total: 0.000000, Delta: 0.000000, Running Data Query [1].
Total: 0.000000, Delta: 0.000000, Found Type = '3' [SNMP Query].
Total: 0.000000, Delta: 0.000000, Found data query XML file at '/usr/share/cacti/resource/snmp_queries/interface.xml'
Total: 0.010000, Delta: 0.000000, XML file parsed ok.
Total: 0.020000, Delta: 0.020000, Executing SNMP get for num of indexes @ '.1.3.6.1.2.1.2.1.0' Index Count: 33
Total: 0.260000, Delta: 0.240000, Executing SNMP walk for list of indexes @ '.1.3.6.1.2.1.2.2.1.1' Index Count: 33
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.262' value: '262'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.390' value: '390'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.514' value: '514'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.642' value: '642'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.770' value: '770'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.898' value: '898'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.1026' value: '1026'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.1154' value: '1154'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.1282' value: '1282'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.1410' value: '1410'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.1538' value: '1538'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.1666' value: '1666'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.1794' value: '1794'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.1922' value: '1922'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.2050' value: '2050'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.2178' value: '2178'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.2306' value: '2306'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.2434' value: '2434'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.2562' value: '2562'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.2690' value: '2690'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.2818' value: '2818'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.2946' value: '2946'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.3074' value: '3074'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.3202' value: '3202'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.3330' value: '3330'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.3458' value: '3458'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.3585' value: '3585'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.3713' value: '3713'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.3841' value: '3841'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.3969' value: '3969'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.4102' value: '4102'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.4230' value: '4230'
Total: 0.260000, Delta: 0.000000, Index found at OID: '.1.3.6.1.2.1.2.2.1.1.4358' value: '4358'
Click to show Data Query output for field 'ifIndex'
Total: 0.260000, Delta: 0.000000, Located input field 'ifIndex' [walk]
Total: 0.480000, Delta: 0.220000, Executing SNMP walk for data @ '.1.3.6.1.2.1.2.2.1.1'
Found item [ifIndex='262'] index: 262 [from value]
Found item [ifIndex='390'] index: 390 [from value]
Found item [ifIndex='514'] index: 514 [from value]
Found item [ifIndex='642'] index: 642 [from value]
Found item [ifIndex='770'] index: 770 [from value]
Found item [ifIndex='898'] index: 898 [from value]
Found item [ifIndex='1026'] index: 1026 [from value]
Found item [ifIndex='1154'] index: 1154 [from value]
Found item [ifIndex='1282'] index: 1282 [from value]
Found item [ifIndex='1410'] index: 1410 [from value]
Found item [ifIndex='1538'] index: 1538 [from value]
Found item [ifIndex='1666'] index: 1666 [from value]
Found item [ifIndex='1794'] index: 1794 [from value]
Found item [ifIndex='1922'] index: 1922 [from value]
Found item [ifIndex='2050'] index: 2050 [from value]
Found item [ifIndex='2178'] index: 2178 [from value]
Found item [ifIndex='2306'] index: 2306 [from value]
Found item [ifIndex='2434'] index: 2434 [from value]
Found item [ifIndex='2562'] index: 2562 [from value]
Found item [ifIndex='2690'] index: 2690 [from value]
Found item [ifIndex='2818'] index: 2818 [from value]
Found item [ifIndex='2946'] index: 2946 [from value]
Found item [ifIndex='3074'] index: 3074 [from value]
Found item [ifIndex='3202'] index: 3202 [from value]
Found item [ifIndex='3330'] index: 3330 [from value]
Found item [ifIndex='3458'] index: 3458 [from value]
Found item [ifIndex='3585'] index: 3585 [from value]
Found item [ifIndex='3713'] index: 3713 [from value]
Found item [ifIndex='3841'] index: 3841 [from value]
Found item [ifIndex='3969'] index: 3969 [from value]
Found item [ifIndex='4102'] index: 4102 [from value]
Found item [ifIndex='4230'] index: 4230 [from value]
Found item [ifIndex='4358'] index: 4358 [from value]
Click to show Data Query output for field 'ifOperStatus'
Total: 0.490000, Delta: 0.000000, Located input field 'ifOperStatus' [walk]
Total: 0.730000, Delta: 0.240000, Executing SNMP walk for data @ '.1.3.6.1.2.1.2.2.1.8'
Found item [ifOperStatus='Up'] index: 262 [from value]
Found item [ifOperStatus='Up'] index: 390 [from value]
Found item [ifOperStatus='Down'] index: 514 [from value]
Found item [ifOperStatus='Down'] index: 642 [from value]
Found item [ifOperStatus='Down'] index: 770 [from value]
Found item [ifOperStatus='Down'] index: 898 [from value]
Found item [ifOperStatus='Up'] index: 1026 [from value]
Found item [ifOperStatus='Up'] index: 1154 [from value]
Found item [ifOperStatus='Up'] index: 1282 [from value]
Found item [ifOperStatus='Up'] index: 1410 [from value]
Found item [ifOperStatus='Up'] index: 1538 [from value]
Found item [ifOperStatus='Up'] index: 1666 [from value]
Found item [ifOperStatus='Up'] index: 1794 [from value]
Found item [ifOperStatus='Up'] index: 1922 [from value]
Found item [ifOperStatus='Up'] index: 2050 [from value]
Found item [ifOperStatus='Up'] index: 2178 [from value]
Found item [ifOperStatus='Down'] index: 2306 [from value]
Found item [ifOperStatus='Down'] index: 2434 [from value]
Found item [ifOperStatus='Down'] index: 2562 [from value]
Found item [ifOperStatus='Down'] index: 2690 [from value]
Found item [ifOperStatus='Down'] index: 2818 [from value]
Found item [ifOperStatus='Down'] index: 2946 [from value]
Found item [ifOperStatus='Down'] index: 3074 [from value]
Found item [ifOperStatus='Down'] index: 3202 [from value]
Found item [ifOperStatus='Down'] index: 3330 [from value]
Found item [ifOperStatus='Down'] index: 3458 [from value]
Found item [ifOperStatus='Down'] index: 3585 [from value]
Found item [ifOperStatus='Down'] index: 3713 [from value]
Found item [ifOperStatus='Down'] index: 3841 [from value]
Found item [ifOperStatus='Up'] index: 3969 [from value]
Found item [ifOperStatus='Up'] index: 4102 [from value]
Found item [ifOperStatus='Up'] index: 4230 [from value]
Found item [ifOperStatus='Up'] index: 4358 [from value]
Click to show Data Query output for field 'ifDescr'
Total: 0.730000, Delta: 0.000000, Located input field 'ifDescr' [walk]
Total: 0.980000, Delta: 0.250000, Executing SNMP walk for data @ '.1.3.6.1.2.1.2.2.1.2'
Found item [ifDescr='NULL0'] index: 262 [from value]
Found item [ifDescr='Aux0/0'] index: 390 [from value]
Found item [ifDescr='Ethernet0/1'] index: 514 [from value]
Found item [ifDescr='Ethernet0/2'] index: 642 [from value]
Found item [ifDescr='Ethernet0/3'] index: 770 [from value]
Found item [ifDescr='Ethernet0/4'] index: 898 [from value]
Found item [ifDescr='Ethernet0/5'] index: 1026 [from value]
Found item [ifDescr='Ethernet0/6'] index: 1154 [from value]
Found item [ifDescr='Ethernet0/7'] index: 1282 [from value]
Found item [ifDescr='Ethernet0/8'] index: 1410 [from value]
Found item [ifDescr='Ethernet0/9'] index: 1538 [from value]
Found item [ifDescr='Ethernet0/10'] index: 1666 [from value]
Found item [ifDescr='Ethernet0/11'] index: 1794 [from value]
Found item [ifDescr='Ethernet0/12'] index: 1922 [from value]
Found item [ifDescr='Ethernet0/13'] index: 2050 [from value]
Found item [ifDescr='Ethernet0/14'] index: 2178 [from value]
Found item [ifDescr='Ethernet0/15'] index: 2306 [from value]
Found item [ifDescr='Ethernet0/16'] index: 2434 [from value]
Found item [ifDescr='Ethernet0/17'] index: 2562 [from value]
Found item [ifDescr='Ethernet0/18'] index: 2690 [from value]
Found item [ifDescr='Ethernet0/19'] index: 2818 [from value]
Found item [ifDescr='Ethernet0/20'] index: 2946 [from value]
Found item [ifDescr='Ethernet0/21'] index: 3074 [from value]
Found item [ifDescr='Ethernet0/22'] index: 3202 [from value]
Found item [ifDescr='Ethernet0/23'] index: 3330 [from value]
Found item [ifDescr='Ethernet0/24'] index: 3458 [from value]
Found item [ifDescr='GigabitEthernet1/1'] index: 3585 [from value]
Found item [ifDescr='GigabitEthernet1/2'] index: 3713 [from value]
Found item [ifDescr='GigabitEthernet1/3'] index: 3841 [from value]
Found item [ifDescr='GigabitEthernet1/4'] index: 3969 [from value]
Found item [ifDescr='Vlan-interface10'] index: 4102 [from value]
Found item [ifDescr='Vlan-interface11'] index: 4230 [from value]
Found item [ifDescr='Vlan-interface2222'] index: 4358 [from value]
Click to show Data Query output for field 'ifName'
Total: 0.980000, Delta: 0.000000, Located input field 'ifName' [walk]
Total: 1.220000, Delta: 0.230000, Executing SNMP walk for data @ '.1.3.6.1.2.1.31.1.1.1.1'
Found item [ifName='NULL0'] index: 262 [from value]
Found item [ifName='Aux0/0'] index: 390 [from value]
Found item [ifName='Ethernet0/1'] index: 514 [from value]
Found item [ifName='Ethernet0/2'] index: 642 [from value]
Found item [ifName='Ethernet0/3'] index: 770 [from value]
Found item [ifName='Ethernet0/4'] index: 898 [from value]
Found item [ifName='Ethernet0/5'] index: 1026 [from value]
Found item [ifName='Ethernet0/6'] index: 1154 [from value]
Found item [ifName='Ethernet0/7'] index: 1282 [from value]
Found item [ifName='Ethernet0/8'] index: 1410 [from value]
Found item [ifName='Ethernet0/9'] index: 1538 [from value]
Found item [ifName='Ethernet0/10'] index: 1666 [from value]
Found item [ifName='Ethernet0/11'] index: 1794 [from value]
Found item [ifName='Ethernet0/12'] index: 1922 [from value]
Found item [ifName='Ethernet0/13'] index: 2050 [from value]
Found item [ifName='Ethernet0/14'] index: 2178 [from value]
Found item [ifName='Ethernet0/15'] index: 2306 [from value]
Found item [ifName='Ethernet0/16'] index: 2434 [from value]
Found item [ifName='Ethernet0/17'] index: 2562 [from value]
Found item [ifName='Ethernet0/18'] index: 2690 [from value]
Found item [ifName='Ethernet0/19'] index: 2818 [from value]
Found item [ifName='Ethernet0/20'] index: 2946 [from value]
Found item [ifName='Ethernet0/21'] index: 3074 [from value]
Found item [ifName='Ethernet0/22'] index: 3202 [from value]
Found item [ifName='Ethernet0/23'] index: 3330 [from value]
Found item [ifName='Ethernet0/24'] index: 3458 [from value]
Found item [ifName='GigabitEthernet1/1'] index: 3585 [from value]
Found item [ifName='GigabitEthernet1/2'] index: 3713 [from value]
Found item [ifName='GigabitEthernet1/3'] index: 3841 [from value]
Found item [ifName='GigabitEthernet1/4'] index: 3969 [from value]
Found item [ifName='Vlan-interface10'] index: 4102 [from value]
Found item [ifName='Vlan-interface11'] index: 4230 [from value]
Found item [ifName='Vlan-interface2222'] index: 4358 [from value]
Click to show Data Query output for field 'ifAlias'
Total: 1.220000, Delta: 0.000000, Located input field 'ifAlias' [walk]
Total: 1.560000, Delta: 0.340000, Executing SNMP walk for data @ '.1.3.6.1.2.1.31.1.1.1.18'
Found item [ifAlias='HUAWEI, Quidway Series, NULL0 Interface'] index: 262 [from value]
Found item [ifAlias='HUAWEI, Quidway Series, Aux0/0 Interface'] index: 390 [from value]
Found item [ifAlias='connection to FE mgt card chassis1'] index: 514 [from value]
Found item [ifAlias='connection to FE mgt card chassis3'] index: 642 [from value]
Found item [ifAlias='connection to FE mgt card chassis5'] index: 770 [from value]
Found item [ifAlias='connection to FE mgt card chassis7'] index: 898 [from value]
Found item [ifAlias='console server (switch2 only'] index: 1026 [from value]
Found item [ifAlias='sw1 sw2 crossover for backend vlan'] index: 1154 [from value]
Found item [ifAlias='sw1 sw2 crossover for frontend'] index: 1282 [from value]
Found item [ifAlias='sw1 sw2 crossover for frontend'] index: 1410 [from value]
Found item [ifAlias='sw1 sw2 crossover for frontend'] index: 1538 [from value]
Found item [ifAlias='sw1 sw2 crossover for frontend'] index: 1666 [from value]
Found item [ifAlias='sw1 sw2 crossover for frontend'] index: 1794 [from value]
Found item [ifAlias='sw1 sw2 crossover for frontend'] index: 1922 [from value]
Found item [ifAlias='sw1 sw2 crossover for frontend'] index: 2050 [from value]
Found item [ifAlias='sw1 sw2 crossover for frontend'] index: 2178 [from value]
Found item [ifAlias='crossover to either sw3 or sw4 backend'] index: 2306 [from value]
Found item [ifAlias='crossover to either sw3 or sw4 frontend'] index: 2434 [from value]
Found item [ifAlias='crossover to either sw3 or sw4 frontend'] index: 2562 [from value]
Found item [ifAlias='crossover to either sw3 or sw4 frontend'] index: 2690 [from value]
Found item [ifAlias='crossover to either sw3 or sw4 frontend'] index: 2818 [from value]
Found item [ifAlias='crossover to either sw3 or sw4 frontend'] index: 2946 [from value]
Found item [ifAlias='crossover to either sw3 or sw4 frontend'] index: 3074 [from value]
Found item [ifAlias='crossover to either sw3 or sw4 frontend'] index: 3202 [from value]
Found item [ifAlias='WWP connection for terminated HE traffic'] index: 3330 [from value]
Found item [ifAlias='WWP connection for wholesale HE traffic'] index: 3458 [from value]
Found item [ifAlias='DSLAM C1 slot 8'] index: 3585 [from value]
Found item [ifAlias='DSLAM C3 slot 8'] index: 3713 [from value]
Found item [ifAlias=''] index: 3841 [from value]
Found item [ifAlias='MSAN slot 3'] index: 3969 [from value]
Found item [ifAlias='HUAWEI, Quidway Series, Vlan-interface10 Interface'] index: 4102 [from value]
Found item [ifAlias='voice traffic to MSAN'] index: 4230 [from value]
Found item [ifAlias='TUK_emhinck_MGMT'] index: 4358 [from value]
Click to show Data Query output for field 'ifType'
Total: 1.560000, Delta: 0.000000, Located input field 'ifType' [walk]
Total: 1.830000, Delta: 0.270000, Executing SNMP walk for data @ '.1.3.6.1.2.1.2.2.1.3'
Found item [ifType='other'] index: 262 [from value]
Found item [ifType='ppp'] index: 390 [from value]
Found item [ifType='ethernetCsmacd'] index: 514 [from value]
Found item [ifType='ethernetCsmacd'] index: 642 [from value]
Found item [ifType='ethernetCsmacd'] index: 770 [from value]
Found item [ifType='ethernetCsmacd'] index: 898 [from value]
Found item [ifType='ethernetCsmacd'] index: 1026 [from value]
Found item [ifType='ethernetCsmacd'] index: 1154 [from value]
Found item [ifType='ethernetCsmacd'] index: 1282 [from value]
Found item [ifType='ethernetCsmacd'] index: 1410 [from value]
Found item [ifType='ethernetCsmacd'] index: 1538 [from value]
Found item [ifType='ethernetCsmacd'] index: 1666 [from value]
Found item [ifType='ethernetCsmacd'] index: 1794 [from value]
Found item [ifType='ethernetCsmacd'] index: 1922 [from value]
Found item [ifType='ethernetCsmacd'] index: 2050 [from value]
Found item [ifType='ethernetCsmacd'] index: 2178 [from value]
Found item [ifType='ethernetCsmacd'] index: 2306 [from value]
Found item [ifType='ethernetCsmacd'] index: 2434 [from value]
Found item [ifType='ethernetCsmacd'] index: 2562 [from value]
Found item [ifType='ethernetCsmacd'] index: 2690 [from value]
Found item [ifType='ethernetCsmacd'] index: 2818 [from value]
Found item [ifType='ethernetCsmacd'] index: 2946 [from value]
Found item [ifType='ethernetCsmacd'] index: 3074 [from value]
Found item [ifType='ethernetCsmacd'] index: 3202 [from value]
Found item [ifType='ethernetCsmacd'] index: 3330 [from value]
Found item [ifType='ethernetCsmacd'] index: 3458 [from value]
Found item [ifType='gigabitEthernet'] index: 3585 [from value]
Found item [ifType='gigabitEthernet'] index: 3713 [from value]
Found item [ifType='gigabitEthernet'] index: 3841 [from value]
Found item [ifType='gigabitEthernet'] index: 3969 [from value]
Found item [ifType='l3ipvlan'] index: 4102 [from value]
Found item [ifType='l3ipvlan'] index: 4230 [from value]
Found item [ifType='l3ipvlan'] index: 4358 [from value]
Click to show Data Query output for field 'ifSpeed'
Total: 1.830000, Delta: 0.000000, Located input field 'ifSpeed' [walk]
Total: 2.060000, Delta: 0.230000, Executing SNMP walk for data @ '.1.3.6.1.2.1.2.2.1.5'
Found item [ifSpeed='0'] index: 262 [from value]
Found item [ifSpeed='0'] index: 390 [from value]
Found item [ifSpeed='0'] index: 514 [from value]
Found item [ifSpeed='0'] index: 642 [from value]
Found item [ifSpeed='0'] index: 770 [from value]
Found item [ifSpeed='0'] index: 898 [from value]
Found item [ifSpeed='100000000'] index: 1026 [from value]
Found item [ifSpeed='100000000'] index: 1154 [from value]
Found item [ifSpeed='100000000'] index: 1282 [from value]
Found item [ifSpeed='100000000'] index: 1410 [from value]
Found item [ifSpeed='100000000'] index: 1538 [from value]
Found item [ifSpeed='100000000'] index: 1666 [from value]
Found item [ifSpeed='100000000'] index: 1794 [from value]
Found item [ifSpeed='100000000'] index: 1922 [from value]
Found item [ifSpeed='100000000'] index: 2050 [from value]
Found item [ifSpeed='100000000'] index: 2178 [from value]
Found item [ifSpeed='0'] index: 2306 [from value]
Found item [ifSpeed='0'] index: 2434 [from value]
Found item [ifSpeed='0'] index: 2562 [from value]
Found item [ifSpeed='0'] index: 2690 [from value]
Found item [ifSpeed='0'] index: 2818 [from value]
Found item [ifSpeed='0'] index: 2946 [from value]
Found item [ifSpeed='0'] index: 3074 [from value]
Found item [ifSpeed='0'] index: 3202 [from value]
Found item [ifSpeed='0'] index: 3330 [from value]
Found item [ifSpeed='0'] index: 3458 [from value]
Found item [ifSpeed='0'] index: 3585 [from value]
Found item [ifSpeed='0'] index: 3713 [from value]
Found item [ifSpeed='0'] index: 3841 [from value]
Found item [ifSpeed='1000000000'] index: 3969 [from value]
Found item [ifSpeed='0'] index: 4102 [from value]
Found item [ifSpeed='0'] index: 4230 [from value]
Found item [ifSpeed='0'] index: 4358 [from value]
Click to show Data Query output for field 'ifHighSpeed'
Total: 2.060000, Delta: 0.000000, Located input field 'ifHighSpeed' [walk]
Total: 2.290000, Delta: 0.230000, Executing SNMP walk for data @ '.1.3.6.1.2.1.31.1.1.1.15'
Found item [ifHighSpeed='0'] index: 262 [from value]
Found item [ifHighSpeed='0'] index: 390 [from value]
Found item [ifHighSpeed='0'] index: 514 [from value]
Found item [ifHighSpeed='0'] index: 642 [from value]
Found item [ifHighSpeed='0'] index: 770 [from value]
Found item [ifHighSpeed='0'] index: 898 [from value]
Found item [ifHighSpeed='100'] index: 1026 [from value]
Found item [ifHighSpeed='100'] index: 1154 [from value]
Found item [ifHighSpeed='100'] index: 1282 [from value]
Found item [ifHighSpeed='100'] index: 1410 [from value]
Found item [ifHighSpeed='100'] index: 1538 [from value]
Found item [ifHighSpeed='100'] index: 1666 [from value]
Found item [ifHighSpeed='100'] index: 1794 [from value]
Found item [ifHighSpeed='100'] index: 1922 [from value]
Found item [ifHighSpeed='100'] index: 2050 [from value]
Found item [ifHighSpeed='100'] index: 2178 [from value]
Found item [ifHighSpeed='0'] index: 2306 [from value]
Found item [ifHighSpeed='0'] index: 2434 [from value]
Found item [ifHighSpeed='0'] index: 2562 [from value]
Found item [ifHighSpeed='0'] index: 2690 [from value]
Found item [ifHighSpeed='0'] index: 2818 [from value]
Found item [ifHighSpeed='0'] index: 2946 [from value]
Found item [ifHighSpeed='0'] index: 3074 [from value]
Found item [ifHighSpeed='0'] index: 3202 [from value]
Found item [ifHighSpeed='0'] index: 3330 [from value]
Found item [ifHighSpeed='0'] index: 3458 [from value]
Found item [ifHighSpeed='0'] index: 3585 [from value]
Found item [ifHighSpeed='0'] index: 3713 [from value]
Found item [ifHighSpeed='0'] index: 3841 [from value]
Found item [ifHighSpeed='1000'] index: 3969 [from value]
Found item [ifHighSpeed='0'] index: 4102 [from value]
Found item [ifHighSpeed='0'] index: 4230 [from value]
Found item [ifHighSpeed='0'] index: 4358 [from value]
Click to show Data Query output for field 'ifHwAddr'
Total: 2.290000, Delta: 0.000000, Located input field 'ifHwAddr' [walk]
Total: 2.560000, Delta: 0.260000, Executing SNMP walk for data @ '.1.3.6.1.2.1.2.2.1.6'
Found item [ifHwAddr='00:00:00:00:00:00'] index: 262 [from value]
Found item [ifHwAddr='00:00:00:00:00:00'] index: 390 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 514 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 642 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 770 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 898 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 1026 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 1154 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 1282 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 1410 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 1538 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 1666 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 1794 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 1922 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 2050 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 2178 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 2306 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 2434 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 2562 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 2690 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 2818 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 2946 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 3074 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 3202 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 3330 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 3458 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 3585 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 3713 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 3841 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B0'] index: 3969 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:BA'] index: 4102 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:BB'] index: 4230 [from value]
Found item [ifHwAddr='00:0F:E2:1C:7D:B2'] index: 4358 [from value]
Click to show Data Query output for field 'ifIP'
Total: 2.560000, Delta: 0.000000, Located input field 'ifIP' [walk]
Total: 2.600000, Delta: 0.040000, Executing SNMP walk for data @ '.1.3.6.1.2.1.4.20.1.2'
Found item [ifIP='10.x.x.195'] index: 4358 [from regexp oid parse]
Found item [ifIP='10.x.x.43'] index: 4102 [from regexp oid parse]
Found item [ifIP='10.x.x.12'] index: 4230 [from regexp oid parse]
Found item [ifIP='127.0.0.1'] index: 128 [from regexp oid parse]
Total: 2.630000, Delta: 0.040000, Checking for Sort Field change. No changes detected.
Total: 2.630000, Delta: 0.000000, Update Data Query Sort Cache complete
Total: 2.950000, Delta: 0.320000, Index Association with Local Data complete
Total: 2.960000, Delta: 0.000000, No Index Changes Detected, Skipping Re-Index and Poller Cache Re-population
Total: 3.000000, Delta: 0.040000, Automation Executing for Data Query complete
Total: 3.000000, Delta: 0.000000, Plugin hooks complete

@cigamit
Copy link
Member

cigamit commented Feb 8, 2019

Okay, we've established a few things here:

  1. It's a Huawei device
  2. They are not following the SNMP standard (aka they are not presenting the loopback interface as a regular interface), but presenting it as a registered IP.

Can you open a ticket with them and try to get them to fix their snmp agent? If not, I guess we can introduce a new feature to cleans bad data. It would be very subjective though.

Let us know what you find. We will keep this open. Preserve your workaround for now.

@oshiewan
Copy link
Contributor Author

oshiewan commented Feb 8, 2019

The device is out of support, and other newer Huawei devices do not respond in this same way, so I will stick to my workaround. Thanks!

@cigamit
Copy link
Member

cigamit commented Feb 8, 2019

Well, that sucks. You should still be able to poke them in the eye though? I guess you won't be able to download updated firmware. I'm guessing that's the issue now right? Either way, poke them in the eye.

@oshiewan
Copy link
Contributor Author

oshiewan commented Feb 8, 2019

No newer firmware available, also we'll shortly decommission all these old switches, but we are using a lot of new Huawei ones so sadly we can't poke them in the eye. Just have to bitch about them behind their back.

@cigamit cigamit added the 3rd Party Bug 3rd party bug label Feb 9, 2019
@cigamit cigamit closed this as completed Feb 9, 2019
@netniV netniV changed the title reindex constantly triggered for some devices Devices may experience constant reindexing Feb 24, 2019
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Jun 30, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
3rd Party Bug 3rd party bug bug Undesired behaviour resolved A fixed issue
Projects
None yet
Development

No branches or pull requests

2 participants