Hi,
I have just set up a librenms installation and added a few systems with mysql.
Two systems are showing the graphs correctly, but two other systems don’t show the graph correctly and keep the -nan status.
For the two systems that don’t show the graph. I see the data is correclty fetched see output below.
How can I get to the cause of this?
./validate.php
| Component | Version |
|---|---|
| LibreNMS | 1.51 |
| DB Schema | 2019_02_10_220000_add_dates_to_fdb (132) |
| PHP | 7.2.16 |
| MySQL | 5.5.60-MariaDB |
| RRDTool | 1.4.8 |
| SNMP | NET-SNMP 5.7.2 |
| ==================================== |
[OK] Composer Version: 1.8.5
[OK] Dependencies up-to-date.
[OK] Database connection successful
[OK] Database schema correct
/opt/librenms/poller.php -h 11 -m applications -d
LibreNMS Poller
SQL[select migration from migrations order by id desc limit 1 0.62ms]
SQL[select count(*) as aggregate from migrations limit 1 0.47ms]
SQL[SELECT version() 0.23ms]
===================================
Version info:
Commit SHA: 5c6a9ab623aa913f892038d547ff32f725ed1fa8
Commit Date: 1556573781
DB Schema: 2019_02_10_220000_add_dates_to_fdb (132)
PHP: 7.2.16
MySQL: 5.5.60-MariaDB
RRDTool: 1.4.8
SNMP: NET-SNMP 5.7.2
==================================DEBUG!
Updating os_def.cache…
Done
Override poller modules: applications
Starting polling run:
SQL[SELECT * FROM devices WHERE disabled = 0 AND device_id = 11 ORDER BY device_id ASC 1.08ms]
SQL[SELECT * FROM devices_attribs WHERE device_id = ? [11] 0.68ms]
Hostname:
Device ID: 11
OS: linux
Resolved IP:
(unix)
[FPING] /usr/sbin/fping -e -q -c 3 -p 500 -t 500
array (
‘xmt’ => ‘3’,
‘rcv’ => ‘3’,
‘loss’ => ‘0’,
‘min’ => ‘0.17’,
‘max’ => ‘0.46’,
‘avg’ => ‘0.29’,
‘exitcode’ => 0,
)
SQL[INSERT IGNORE INTO device_perf (xmt,rcv,loss,min,max,avg,device_id,timestamp,debug) VALUES (:xmt,:rcv,:loss,:min,:max,:avg,:device_id,NOW(),:debug) {“xmt”:“3”,“rcv”:“3”,“loss”:“0”,“min”:“0.17”,“max”:“0.46”,“avg”:“0.29”,“device_id”:11,“debug”:“”} 1.08ms]
SNMP Check response code: 0
Modules status: Global+
OS
Device
Load poller module core
SNMP[‘/usr/bin/snmpget’ ‘-v2c’ ‘-c’ ‘COMMUNITY’ ‘-OQnUt’ ‘-m’ ‘SNMPv2-MIB’ ‘-M’ ‘/opt/librenms/mibs:/opt/librenms/mibs/supermicro:/opt/librenms/mibs/dell’ ‘udp:HOSTNAME:161’ ‘sysUpTime.0’ ‘sysLocation.0’ ‘sysContact.0’ ‘sysName.0’ ‘sysObjectID.0’ ‘sysDescr.0’]
...0 = 915994
...0 = Vertixo, DCA - big room, Dataplace, Arnhem, The Netherlands
...0 = Your Name [email protected]
...0 =
...0 = ..4.1.8
...0 = Linux 3.10.0-957.el7.x86_64 #1 SMP Thu Nov 8 23:39:32 UTC 2018 x86_64
SNMP[‘/usr/bin/snmpget’ ‘-v2c’ ‘-c’ ‘COMMUNITY’ ‘-OQnUst’ ‘-m’ ‘HOST-RESOURCES-MIB:SNMP-FRAMEWORK-MIB’ ‘-M’ ‘/opt/librenms/mibs:/opt/librenms/mibs/supermicro:/opt/librenms/mibs/dell’ ‘udp:HOSTNAME:161’ ‘snmpEngineTime.0’ ‘hrSystemUptime.0’]
snmpEngineTime.0 = 9160
hrSystemUptime.0 = 164643220
Uptime seconds: 1646432
RRD[update /uptime.rrd N:1646432 --daemon unix:/var/run/rrdcached/rrdcached.sock]
Uptime: 19 days 1hour 20 minutes 32 seconds
SQL[select * from locations where (location = ?) limit 1 [“Vertixo, DCA - big room, Dataplace, Arnhem, The Netherlands”] 0.77ms]
Runtime for poller module ‘core’: 0.0558 seconds with 103160 bytes
SNMP: [2/0.05s] MySQL: [0/0.00s] RRD: [1/0.00s]
Unload poller module core
RRD[update /poller-perf-core.rrd N:0.05584979057312 --daemon unix:/var/run/rrdcached/rrdcached.sock]
Modules status: Global+
OS
Device
Load poller module applications
SQL[SELECT * FROM applications WHERE device_id = ? [11] 0.48ms]
SNMP[‘/usr/bin/snmpget’ ‘-v2c’ ‘-c’ ‘COMMUNITY’ ‘-Ovq’ ‘-M’ ‘/opt/librenms/mibs:/opt/librenms/mibs/supermicro:/opt/librenms/mibs/dell’ ‘udp:HOSTNAME:161’ ‘.1.3.6.1.4.1.8072.1.3.2.3.1.2.5.109.121.115.113.108’]
a0:24
a1:2
a2:2
a3:2
a4:1533
a5:318373933839
a6:0
a7:6
a8:0
a9:0
aa:6553592
ab:8178
ac:6426299
ad:2181
ae:17684767
af:58492255
ag:617301779
ah:85781732
ai:20953468
aj:636636009
ak:10589527
al:0
am:0
an:0
ao:0
ap:0
aq:0
ar:0
as:0
at:0
au:389945
av:8348139
aw:544344
ax:482827754
ay:342204821
az:8360744
b0:3182792108
b1:786195213
b2:3197115692
b3:3983310878
b4:0
b5:1089318203
b6:0
b7:44
b8:844
b9:432139
ba:4000
bb:32000
bc:4000
bd:1
be:9
bf:2
bg:0
bh:1
bi:1
bj:2
bk:1
bl:3000
bm:100
bn:808036
bo:6
bp:0
bq:0
br:6
bs:0
bt:0
bu:0
bv:0
bw:0
bx:0
by:0
bz:0
c0:0
c1:0
c2:2425830
c3:750231059
c4:15035703
c5:807772
c6:323707471
c7:0
c8:0
c9:0
ca:0
cb:0
cc:0
cd:0
ce:0
cf:0
cg:0
ch:759
ci:0
cj:0
ck:0
cl:0
cm:759
cn:0
co:1455477
cp:2336137903
cq:972469805877
cr:268435456
cs:268435456
ct:115340813627968
cu:115340814281414
cv:581892248
cw:32768
cx:1322561
cy:1088974233
cz:265062588898
d0:0
d1:0
d2:0
d3:0
d4:0
d5:0
d6:1
d7:0
d8:0
d9:0
da:0
db:0
dc:0
dd:0
de:0
df:0
dg:0
dh:6
di:4356215647
dj:3197115692
dk:0
dl:4355896932
dm:22
dn:3983310945
do:0
dp:0
dq:3982924013
dr:204476
ds:0
dt:0
du:0
dv:786195230
dw:3182995043
dx:0
dy:0
dz:212497541
e0:0
e1:109890764800
e2:0
e3:2648805
e4:1
e5:593084
e6:593086
e7:-1
e8:-1
e9:-1
ea:-1
eb:-1
ec:-1
ed:-1
ee:-1
ef:-1
eg:0
eh:12239872
ei:67108864
ej:0
ek:0
ol:-1
om:-1
on:-1
oo:-1
op:-1
oq:-1
or:-1
os:-1
ot:-1
ou:-1
ov:-1
ow:-1
ox:-1
oy:-1
oz:-1
pg:-1
ph:-1
pi:-1
pj:-1
pk:-1
mysqlRRD[update app-mysql-7.rrd N:268435456:1.1534081362797E+14:1.1534081428141E+14:0:0:0:0:20953468:636636009:10589527:85781732:3197115692:3182792108:3983310878:786195213:17684767:58492255:617301779:1089318203:0:6553592:6426299:8178:2181:4000:44:844:432139:342204821:482827754:8360744:0:0:3000:2:1:9:1:808036:318373933839:24:2:2:2:0:0:0:0:0:0:759:1455477:389945:8348139:544344:0:0:0:0:0:0:0:0:0:0:0:759:0:972469805877:2336137903:323707471:15035703:0:0:0:0:807772:750231059:0 --daemon unix:/var/run/rrdcached/rrdcached.sock]
RRD[update /app-mysql-7-status.rrd N:0:0:0:0:1:0:0:0:0:0:0:0:0:0:0:6 --daemon unix:/var/run/rrdcached/rrdcached.sock]
SQL[UPDATE applications set app_state=?,app_status=?,timestamp=NOW() WHERE app_id = ? [“OK”,“”,7] 1.22ms]
SQL[SELECT * FROM application_metrics WHERE app_id=? [7] 0.56ms]
: .SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [115340813627968,115340573708319,7,“IBLFh”] 0.55ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [115340814281414,115340574401987,7,“IBLWn”] 0.63ms]
U…SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [20953468,20952119,7,“IBIRd”] 0.56ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [636636009,636585382,7,“IBIWr”] 0.59ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [10589527,10588358,7,“IBILg”] 0.69ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [85781732,85774971,7,“IBIFSc”] 0.46ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [3197115692,3197036414,7,“IDBRDd”] 0.49ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [3182792108,3182727754,7,“IDBRId”] 0.57ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [3983310878,3983193213,7,“IDBRRd”] 0.5ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [786195213,786156826,7,“IDBRUd”] 0.58ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [17684767,17684048,7,“IBRd”] 0.56ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [58492255,58483886,7,“IBCd”] 0.47ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [617301779,617253250,7,“IBWr”] 0.57ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [1089318203,1089268536,7,“TLIe”] 0.51ms]
U…SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [6426299,6425962,7,“IBPDBp”] 0.5ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [8178,8182,7,“IBPFe”] 0.6ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [2181,1106,7,“IBPMps”] 0.49ms]
U…SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [844,845,7,“OTs”] 0.5ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [432139,432118,7,“OdTs”] 0.61ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [342204821,342191983,7,“IBSRs”] 0.57ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [482827754,482817369,7,“IBSWs”] 0.46ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [8360744,8360105,7,“IBOWs”] 0.6ms]
U…SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [808036,807984,7,“Cs”] 0.58ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [318373933839,318373835101,7,“IBTNx”] 0.51ms]
U…SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [759,756,7,“CTMPTs”] 0.52ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [1455477,1455407,7,“CTMPFs”] 0.51ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [389945,389933,7,“IBIIs”] 0.48ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [8348139,8348127,7,“IBIMRd”] 0.51ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [544344,544335,7,“IBIMs”] 0.51ms]
U…SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [759,756,7,“SSn”] 0.48ms]
U.SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [972469805877,972436556722,7,“BRd”] 0.65ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [2336137903,2335942090,7,“BSt”] 0.62ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [323707471,323696460,7,“CDe”] 0.6ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [15035703,15035050,7,“CIt”] 0.59ms]
U…SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [807772,807721,7,“CSt”] 0.55ms]
USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [750231059,750193070,7,“CUe”] 0.54ms]
U…
Runtime for poller module ‘applications’: 0.2486 seconds with 77056 bytes
SNMP: [1/0.22s] MySQL: [39/0.03s] RRD: [3/0.00s]
Unload poller module applications
RRD[update /poller-perf-applications.rrd N:0.24858498573303 --daemon unix:/var/run/rrdcached/rrdcached.sock]
Start Device Groups
SQL[SELECT * FROM device_groups ORDER BY name 0.4ms]
SQL[SELECT device_group_id FROM device_group_device WHERE device_id=? [11] 0.33ms]
Groups Added:
Groups Removed:
End Device Groups
RRD[update /ping-perf.rrd N:0.29 --daemon unix:/var/run/rrdcached/rrdcached.sock]
RRD[update /poller-perf.rrd N:1.359 --daemon unix:/var/run/rrdcached/rrdcached.sock]
SQL[UPDATE devices set uptime=?,last_ping=NOW(),last_ping_timetaken=? WHERE device_id = ? [1646432,“0.29”,11] 0.57ms]
Updating
Polled in 1.359 seconds
Start Alerts
SQL[select * from devices where devices.device_id = ? limit 1 [11] 0.48ms]
SQL[select device_groups.*, device_group_device.device_id as pivot_device_id, device_group_device.device_group_id as pivot_device_group_id from device_groups inner join device_group_device on device_groups.id = device_group_device.device_group_id where device_group_device.device_id = ? [11] 0.46ms]
SQL[select exists(select * from alert_schedule inner join alert_schedulables on alert_schedule.schedule_id = alert_schedulables.schedule_id where ((recurring = ? and start <= NOW() and end >= NOW()) or (recurring = ? and (start_recurring_dt <= date_format(NOW(), ‘–%d’) and (end_recurring_dt >= date_format(NOW(), ‘–%d’) or end_recurring_dt is null or end_recurring_dt = ? or end_recurring_dt = ?)) and start_recurring_hr <= date_format(NOW(), ‘%H:%i:%s’) and end_recurring_hr >= date_format(NOW(), ‘%H:%i:%s’) and (recurring_day like CONCAT(‘%’, date_format(NOW(), ‘’), ‘%’) or recurring_day is null or recurring_day = ?))) and ((alert_schedulable_type = ? and alert_schedulable_id = ?) or (alert_schedulable_type = ? and 0 = 1))) as exists [0,1,“0000-00-00”,“”,“”,“device”,11,“device_group”] 0.59ms]
SQL[SELECT DISTINCT a.* FROM alert_rules a
LEFT JOIN alert_device_map d ON a.id=d.rule_id
LEFT JOIN alert_group_map g ON a.id=g.rule_id
LEFT JOIN device_group_device dg ON g.group_id=dg.device_group_id
WHERE a.disabled = 0 AND ((d.device_id IS NULL AND g.group_id IS NULL) OR d.device_id=? OR dg.device_id=?) [11,11] 1.36ms]
End Alerts
SQL[INSERT IGNORE INTO perf_times (type,doing,start,duration,devices,poller) VALUES (:type,:doing,:start,:duration,:devices,:poller) {“type”:“poll”,“doing”:“11”,“start”:1558432312.144908,“duration”:“1.560”,“devices”:1,“poller”:“devops-librenms-001.admin.colo.beslist.local”} 0.69ms]
/opt/librenms/poller.php 11 2019-05-21 11:51:53 - 1 devices polled in 1.560 secs
SNMP [4/0.31s]: Get[4/0.31s] Getnext[0/0.00s] Walk[0/0.00s]
MySQL [46/0.04s]: Cell[1/0.00s] Row[-1/-0.00s] Rows[5/0.01s] Column[1/0.00s] Update[38/0.03s] Insert[2/0.00s] Delete[0/0.00s]
RRD [7/0.00s]: Update[7/0.00s] Create [0/0.00s] Other[0/0.00s]