Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

InfluxDB write error #9

Closed
vkosilko opened this issue Oct 14, 2016 · 1 comment
Closed

InfluxDB write error #9

vkosilko opened this issue Oct 14, 2016 · 1 comment

Comments

@vkosilko
Copy link
Contributor

vkosilko commented Oct 14, 2016 •
edited

Can't find collected data in influxdb.
Collector files:
https://drive.google.com/open?id=0B0rkzfzNglIwaTlFaG05OVowM2s
Logs says that data was sent, but influx database is empty.
Tried to change remote influxdb to local, creation of new database. Nothing helped.

Standart output:

#./snmpcollector
INFO[2016-10-14 12:48:44] set Default directories : 
   - Exec: /opt/snmpcollector
   - Config: /opt/snmpcollector/conf
   -Logs: /opt/snmpcollector/log

DEBU[2016-10-14 12:48:44] {General:{LogDir:./log LogLevel:debug} Database:{Type:sqlite3 Host: Name:snmpcollector User: Pass: SQLLogFile:sql.log Debug:1 x:<nil>} Selfmon:{Enabled:true Freq:60 Prefix:gvm ExtraTags:[instance=snmpcollector01] Influx:<nil> runtimeStatsRunning:false TagMap:map[] bps:<nil>} Metrics:map[] Measurements:map[] MFilters:map[] GetGroups:map[] SnmpDevice:map[] Influxdb:map[] HTTP:{Port:8090 AdminUser:adm1 AdminPassword:adm1pass}} 
DEBU[2016-10-14 12:48:44] Database config: &{Type:sqlite3 Host: Name:snmpcollector User: Pass: SQLLogFile:sql.log Debug:1 x:<nil>} 
DEBU[2016-10-14 12:48:44] {ID:default Host:172.26.40.253 Port:8086 DB:test_db User: Password: Retention:default} 
DEBU[2016-10-14 12:48:44] {ID:Linux_user_CPU_percent FieldName:user Description:percentage of user CPU time BaseOID:.1.3.6.1.4.1.2021.11.9.0 DataSrcType:INTEGER GetRate:false Scale:0 Shift:0} 
DEBU[2016-10-14 12:48:44] {ID:Linux_system_CPU_percent FieldName:system Description:percentage of system CPU time BaseOID:.1.3.6.1.4.1.2021.11.10.0 DataSrcType:INTEGER GetRate:false Scale:0 Shift:0} 
DEBU[2016-10-14 12:48:44] {ID:Linux_idle_CPU_percent FieldName:idle Description:percentage of Idle CPU time BaseOID:.1.3.6.1.4.1.2021.11.11.0 DataSrcType:INTEGER GetRate:false Scale:0 Shift:0} 
DEBU[2016-10-14 12:48:44] {ID:ifHCInOctets FieldName:In.bytes Description:Bytes In - 64-bit Counters BaseOID:.1.3.6.1.2.1.31.1.1.1.6 DataSrcType:COUNTER64 GetRate:false Scale:0 Shift:0} 
DEBU[2016-10-14 12:48:44] {ID:ifHCOutOctets FieldName:Out.bytes Description:Bytes Out - 64-bit Counters BaseOID:.1.3.6.1.2.1.31.1.1.1.10 DataSrcType:COUNTER64 GetRate:false Scale:0 Shift:0} 
DEBU[2016-10-14 12:48:44] {ID:ifHCInUcastPkts FieldName:In.packets Description:Packets In - 64-bit Counters BaseOID:.1.3.6.1.2.1.31.1.1.1.7 DataSrcType:COUNTER64 GetRate:false Scale:0 Shift:0} 
DEBU[2016-10-14 12:48:44] {ID:ifHCOutUcastPkts FieldName:Out.packets Description:Packets Out - 64-bit Counters BaseOID:.1.3.6.1.2.1.31.1.1.1.11 DataSrcType:COUNTER64 GetRate:false Scale:0 Shift:0} 
DEBU[2016-10-14 12:48:44] {ID:ifInOctets FieldName:In.bytes Description:Bytes In - 32-bit Counters BaseOID:.1.3.6.1.2.1.2.2.1.10 DataSrcType:COUNTER32 GetRate:false Scale:0 Shift:0} 
DEBU[2016-10-14 12:48:44] {ID:ifOutOctets FieldName:Out.bytes Description:Bytes Out - 32-bit Counters BaseOID:.1.3.6.1.2.1.2.2.1.16 DataSrcType:COUNTER32 GetRate:false Scale:0 Shift:0} 
DEBU[2016-10-14 12:48:44] {ID:linux_cpu Name:linux.cpu GetMode:value IndexOID: IndexTag: Fields:[Linux_user_CPU_percent Linux_system_CPU_percent Linux_idle_CPU_percent] fieldMetric:[]} 
DEBU[2016-10-14 12:48:44] {ID:linux_ports Name:linux.ports GetMode:indexed IndexOID:.1.3.6.1.2.1.31.1.1.1.1 IndexTag:portName Fields:[ifHCInOctets ifHCOutOctets ifHCInUcastPkts ifHCOutUcastPkts] fieldMetric:[]} 
DEBU[2016-10-14 12:48:44] {ID:linux_ports_by_index Name:linux.ports GetMode:indexed IndexOID:.1.3.6.1.2.1.2.2.1.1 IndexTag:ifindex Fields:[ifHCInOctets ifHCOutOctets ifHCInUcastPkts ifHCOutUcastPkts] fieldMetric:[]} 
DEBU[2016-10-14 12:48:44] {ID:network_32bits Name:32bits-ports GetMode:indexed IndexOID:.1.3.6.1.2.1.31.1.1.1.1 IndexTag:portName Fields:[ifInOctets ifOutOctets] fieldMetric:[]} 
DEBU[2016-10-14 12:48:44] {ID:filter_ports_file_a IDMeasurementCfg:linux_ports FType:file FileName:lp_file_filter_a.txt EnableAlias:true OIDCond: CondType: CondValue:} 
DEBU[2016-10-14 12:48:44] {ID:filter_ports_file_b IDMeasurementCfg:linux_ports FType:file FileName:lp_file_filter_b.txt EnableAlias:true OIDCond: CondType: CondValue:} 
DEBU[2016-10-14 12:48:44] {ID:filter_port_if_status_up IDMeasurementCfg:linux_ports FType:OIDCondition FileName: EnableAlias:false OIDCond:.1.3.6.1.2.1.2.2.1.8 CondType:neq CondValue:1} 
DEBU[2016-10-14 12:48:44] {ID:filter_port_if_name_match_eth IDMeasurementCfg:linux_ports FType:OIDCondition FileName: EnableAlias:false OIDCond:.1.3.6.1.2.1.31.1.1.1.1 CondType:match CondValue:eth.*} 
DEBU[2016-10-14 12:48:44] {ID:Linux Measurements:[linux_cpu linux_ports]} 
DEBU[2016-10-14 12:48:44] {ID:Issue_index Measurements:[linux_cpu linux_ports_by_index]} 
DEBU[2016-10-14 12:48:44] {ID:switch Host:172.26.40.5 Port:161 Retries:2 Timeout:60 Repeat:5 SnmpVersion:2c Community:public V3SecLevel: V3AuthUser: V3AuthPass: V3AuthProt: V3PrivPass: V3PrivProt: Freq:60 OutDB: LogLevel:debug LogFile: SnmpDebug:true DeviceTagName:router DeviceTagValue:id ExtraTags:[tagA=4 tagB=5 tagC=6] MetricGroups:[] MeasFilters:[]} 
DEBU[2016-10-14 12:48:44] {General:{LogDir:./log LogLevel:debug} Database:{Type:sqlite3 Host: Name:snmpcollector User: Pass: SQLLogFile:sql.log Debug:1 x:0xc82014e960} Selfmon:{Enabled:true Freq:60 Prefix:gvm ExtraTags:[instance=snmpcollector01] Influx:<nil> runtimeStatsRunning:false TagMap:map[] bps:<nil>} Metrics:map[ifOutOctets:0xc820185dc0 Linux_user_CPU_percent:0xc820185a40 Linux_idle_CPU_percent:0xc820185b20 ifHCInUcastPkts:0xc820185c70 ifHCOutUcastPkts:0xc820185ce0 ifInOctets:0xc820185d50 Linux_system_CPU_percent:0xc820185ab0 ifHCInOctets:0xc820185b90 ifHCOutOctets:0xc820185c00] Measurements:map[network_32bits:0xc8201a5580 linux_cpu:0xc8201a5400 linux_ports:0xc8201a5480 linux_ports_by_index:0xc8201a5500] MFilters:map[filter_ports_file_a:0xc8201a5c00 filter_ports_file_b:0xc8201a5d00 filter_port_if_status_up:0xc8201a5e00 filter_port_if_name_match_eth:0xc8201a5f00] GetGroups:map[Linux:0xc8201b9ec0 Issue_index:0xc8201b9ef0] SnmpDevice:map[switch:0xc8201cc600] Influxdb:map[default:0xc8201855e0] HTTP:{Port:8090 AdminUser:adm1 AdminPassword:adm1pass}} 
DEBU[2016-10-14 12:48:44] --------------------Initializing Config metrics------------------- 
DEBU[2016-10-14 12:48:44] Initializing SNMPMetricconfig...             
DEBU[2016-10-14 12:48:44] Initializing MEASSUREMENTSconfig...          
INFO[2016-10-14 12:48:44] processing measurement key: linux_cpu        
DEBU[2016-10-14 12:48:44] %+v&{linux_cpu linux.cpu value   [Linux_user_CPU_percent Linux_system_CPU_percent Linux_idle_CPU_percent] []} 
DEBU[2016-10-14 12:48:44] looking for measure linux.cpu fields: Linux_user_CPU_percent 
DEBU[2016-10-14 12:48:44] Found ok!                                    
DEBU[2016-10-14 12:48:44] looking for measure linux.cpu fields: Linux_system_CPU_percent 
DEBU[2016-10-14 12:48:44] Found ok!                                    
DEBU[2016-10-14 12:48:44] looking for measure linux.cpu fields: Linux_idle_CPU_percent 
DEBU[2016-10-14 12:48:44] Found ok!                                    
DEBU[2016-10-14 12:48:44] FIELDMETRICS: [0xc820185a40 0xc820185ab0 0xc820185b20] 
INFO[2016-10-14 12:48:44] processing measurement key: linux_ports      
DEBU[2016-10-14 12:48:44] %+v&{linux_ports linux.ports indexed .1.3.6.1.2.1.31.1.1.1.1 portName [ifHCInOctets ifHCOutOctets ifHCInUcastPkts ifHCOutUcastPkts] []} 
DEBU[2016-10-14 12:48:44] looking for measure linux.ports fields: ifHCInOctets 
DEBU[2016-10-14 12:48:44] Found ok!                                    
DEBU[2016-10-14 12:48:44] looking for measure linux.ports fields: ifHCOutOctets 
DEBU[2016-10-14 12:48:44] Found ok!                                    
DEBU[2016-10-14 12:48:44] looking for measure linux.ports fields: ifHCInUcastPkts 
DEBU[2016-10-14 12:48:44] Found ok!                                    
DEBU[2016-10-14 12:48:44] looking for measure linux.ports fields: ifHCOutUcastPkts 
DEBU[2016-10-14 12:48:44] Found ok!                                    
DEBU[2016-10-14 12:48:44] FIELDMETRICS: [0xc820185b90 0xc820185c00 0xc820185c70 0xc820185ce0] 
INFO[2016-10-14 12:48:44] processing measurement key: linux_ports_by_index 
DEBU[2016-10-14 12:48:44] %+v&{linux_ports_by_index linux.ports indexed .1.3.6.1.2.1.2.2.1.1 ifindex [ifHCInOctets ifHCOutOctets ifHCInUcastPkts ifHCOutUcastPkts] []} 
DEBU[2016-10-14 12:48:44] looking for measure linux.ports fields: ifHCInOctets 
DEBU[2016-10-14 12:48:44] Found ok!                                    
DEBU[2016-10-14 12:48:44] looking for measure linux.ports fields: ifHCOutOctets 
DEBU[2016-10-14 12:48:44] Found ok!                                    
DEBU[2016-10-14 12:48:44] looking for measure linux.ports fields: ifHCInUcastPkts 
DEBU[2016-10-14 12:48:44] Found ok!                                    
DEBU[2016-10-14 12:48:44] looking for measure linux.ports fields: ifHCOutUcastPkts 
DEBU[2016-10-14 12:48:44] Found ok!                                    
DEBU[2016-10-14 12:48:44] FIELDMETRICS: [0xc820185b90 0xc820185c00 0xc820185c70 0xc820185ce0] 
INFO[2016-10-14 12:48:44] processing measurement key: network_32bits   
DEBU[2016-10-14 12:48:44] %+v&{network_32bits 32bits-ports indexed .1.3.6.1.2.1.31.1.1.1.1 portName [ifInOctets ifOutOctets] []} 
DEBU[2016-10-14 12:48:44] looking for measure 32bits-ports fields: ifInOctets 
DEBU[2016-10-14 12:48:44] Found ok!                                    
DEBU[2016-10-14 12:48:44] looking for measure 32bits-ports fields: ifOutOctets 
DEBU[2016-10-14 12:48:44] Found ok!                                    
DEBU[2016-10-14 12:48:44] FIELDMETRICS: [0xc820185d50 0xc820185dc0]    
DEBU[2016-10-14 12:48:44] -----------------------END Config metrics---------------------- 
DEBU[2016-10-14 12:48:44] {General:{LogDir:./log LogLevel:debug} Database:{Type:sqlite3 Host: Name:snmpcollector User: Pass: SQLLogFile:sql.log Debug:1 x:0xc82014e960} Selfmon:{Enabled:true Freq:60 Prefix:gvm ExtraTags:[instance=snmpcollector01] Influx:<nil> runtimeStatsRunning:false TagMap:map[] bps:<nil>} Metrics:map[ifInOctets:0xc820185d50 ifOutOctets:0xc820185dc0 Linux_user_CPU_percent:0xc820185a40 Linux_idle_CPU_percent:0xc820185b20 ifHCInUcastPkts:0xc820185c70 ifHCOutUcastPkts:0xc820185ce0 Linux_system_CPU_percent:0xc820185ab0 ifHCInOctets:0xc820185b90 ifHCOutOctets:0xc820185c00] Measurements:map[linux_cpu:0xc8201a5400 linux_ports:0xc8201a5480 linux_ports_by_index:0xc8201a5500 network_32bits:0xc8201a5580] MFilters:map[filter_ports_file_a:0xc8201a5c00 filter_ports_file_b:0xc8201a5d00 filter_port_if_status_up:0xc8201a5e00 filter_port_if_name_match_eth:0xc8201a5f00] GetGroups:map[Linux:0xc8201b9ec0 Issue_index:0xc8201b9ef0] SnmpDevice:map[switch:0xc8201cc600] Influxdb:map[default:0xc8201855e0] HTTP:{Port:8090 AdminUser:adm1 AdminPassword:adm1pass}} 
INFO[2016-10-14 12:48:44] Initializing device switch

INFO[2016-10-14 12:48:44] Initializing influxdb with id = default      
INFO[2016-10-14 12:48:44] Server is running on localhost:8090...       
INFO[2016-10-14 12:48:44] beggining Influx Emmiter thread: 5577006791947779410 
DEBU[2016-10-14 12:48:44] sending data from Emmiter 5577006791947779410 
DEBU[2016-10-14 12:49:44] sending data from Emmiter 5577006791947779410 
DEBU[2016-10-14 12:50:44] sending data from Emmiter 5577006791947779410 
DEBU[2016-10-14 12:51:44] sending data from Emmiter 5577006791947779410 
DEBU[2016-10-14 12:52:44] sending data from Emmiter 5577006791947779410

Switch log:

�[34mINFO�[0m[0000] First SNMP connection to host  172.26.40.5 stablished 
�[37mDEBU�[0m[0000] DEBUG pdu:{Name:.1.3.6.1.2.1.1.1.0 Type:4 Value:[67 105 115 99 111 32 73 79 83 32 83 111 102 116 119 97 114 101 44 32 67 50 57 54 48 32 83 111 102 116 119 97 114 101 32 40 67 50 57 54 48 45 76 65 78 66 65 83 69 45 77 41 44 32 86 101 114 115 105 111 110 32 49 50 46 50 40 50 53 41 83 69 69 49 44 32 82 69 76 69 65 83 69 32 83 79 70 84 87 65 82 69 32 40 102 99 49 41 13 10 67 111 112 121 114 105 103 104 116 32 40 99 41 32 49 57 56 54 45 50 48 48 54 32 98 121 32 67 105 115 99 111 32 83 121 115 116 101 109 115 44 32 73 110 99 46 13 10 67 111 109 112 105 108 101 100 32 83 117 110 32 50 49 45 77 97 121 45 48 54 32 50 49 58 51 51 32 98 121 32 121 101 110 97 110 104]} 
�[37mDEBU�[0m[0000] DEBUG pdu:{Name:.1.3.6.1.2.1.1.3.0 Type:67 Value:4196630943} 
�[37mDEBU�[0m[0000] DEBUG pdu:{Name:.1.3.6.1.2.1.1.4.0 Type:4 Value:[]} 
�[37mDEBU�[0m[0000] DEBUG pdu:{Name:.1.3.6.1.2.1.1.5.0 Type:4 Value:[83 119 105 116 99 104]} 
�[37mDEBU�[0m[0000] DEBUG pdu:{Name:.1.3.6.1.2.1.1.6.0 Type:4 Value:[0]} 
�[34mINFO�[0m[0000] Got basic system info main.SysInfo{sysDescr:"\x00", sysUptime:41966309000000000, sysContact:"", sysName:"Switch", sysLocation:""}  
�[37mDEBU�[0m[0000] -----------------Init device 172.26.40.5------------------ 
�[34mINFO�[0m[0000] Beginning gather process for device switch (172.26.40.5) 
�[34mINFO�[0m[0000] snmpdevice [switch] snmp poolling took [255ns]  
�[34mINFO�[0m[0000] snmpdevice [switch] influx send took [1.153µs] 
�[34mINFO�[0m[0060] snmpdevice [switch] snmp poolling took [737ns]  
�[34mINFO�[0m[0060] snmpdevice [switch] influx send took [16.326µs]
@vkosilko vkosilko mentioned this issue Oct 14, 2016
Closed
@vkosilko
Copy link
Contributor Author

Problem was in filtering measurements.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@vkosilko