Graph not loading anymore

Tags: #<Tag:0x00007f3b8f307538>

Hello everyone,

I’ve been searching for hours without success, so I’m asking for your help.
While it was working fine for months, without known configuration changes, all graphs aren’t loading anymore in the UI for every devices and with any browser.

I’ve been checking the configuration and directory rights, nothing seems wrong, rrd directory are filled with the updates every five minutes as expected :

[email protected]:~/rrd/10.32.6.5$ ls -l
total 29944
-rw-r–r-- 1 librenms librenms 171272 Nov 17 17:05 availability-2592000.rrd
-rw-r–r-- 1 librenms librenms 171272 Nov 17 17:05 availability-31536000.rrd
-rw-r–r-- 1 librenms librenms 171272 Nov 17 17:05 availability-604800.rrd
-rw-r–r-- 1 librenms librenms 171272 Nov 17 17:05 availability-86400.rrd
-rw-r–r-- 1 librenms librenms 849128 Nov 17 17:05 cisco-voice-ip.rrd
-rw-r–r-- 1 librenms librenms 340736 Nov 17 17:05 mempool-cmp-1.rrd
-rw-r–r-- 1 librenms librenms 340736 Nov 17 17:05 mempool-cmp-2.rrd
-rw-r–r-- 1 librenms librenms 4407872 Nov 17 17:05 netstats-icmp.rrd
-rw-r–r-- 1 librenms librenms 2713232 Nov 17 17:05 netstats-ip.rrd
-rw-r–r-- 1 librenms librenms 4916264 Nov 17 17:05 netstats-snmp.rrd
-rw-r–r-- 1 librenms librenms 1696448 Nov 17 17:05 netstats-tcp.rrd
-rw-r–r-- 1 librenms librenms 679664 Nov 17 17:05 netstats-udp.rrd
-rw-r–r-- 1 librenms librenms 171272 Nov 17 17:05 ping-perf.rrd

I’ve been running .validate.php without errors aswell :

[email protected]:~$ ./validate.php

Component Version
LibreNMS 1.69-32-g498e0be31
DB Schema 2020_11_02_164331_add_powerstate_enum_to_vminfo (190)
PHP 7.4.3
Python 3.8.5
MySQL 10.3.25-MariaDB-0ubuntu0.20.04.1
RRDTool 1.7.2
SNMP NET-SNMP 5.8
OpenSSL

====================================

[OK] Composer Version: 2.0.7
[OK] Dependencies up-to-date.

[OK] Database connection successful
[OK] Database schema correct

RRD command grom GUI returns no error

RRDTool Command

rrdtool graph /tmp/8LAiZ5DLSNrWQuLj --alt-autoscale-max --rigid -E --start 1605624850 --end 1605628450 --width 1728 --height 489 -c BACK#EEEEEE00 -c SHADEA#EEEEEE00 -c SHADEB#EEEEEE00 -c CANVAS#FFFFFF00 -c GRID#a5a5a5 -c MGRID#FF9999 -c FRAME#5e5e5e -c ARROW#5e5e5e -R normal -c FONT#000000 --font LEGEND:8:DejaVuSansMono --font AXIS:7:DejaVuSansMono --font-render-mode normal -u 100 -l 0 -E -b 1024 COMMENT:’ Min Cur Max\n’ DEF:mempoolfree1=/opt/librenms/rrd/10.32.6.1/mempool-cmp-1.rrd:free:AVERAGE DEF:mempoolused1=/opt/librenms/rrd/10.32.6.1/mempool-cmp-1.rrd:used:AVERAGE CDEF:mempooltotal1=mempoolused1,mempoolused1,mempoolfree1,+,/,100,* AREA:mempooltotal1#CC000010 DEF:mempoolfree2=/opt/librenms/rrd/10.32.6.1/mempool-cmp-2.rrd:free:AVERAGE DEF:mempoolused2=/opt/librenms/rrd/10.32.6.1/mempool-cmp-2.rrd:used:AVERAGE CDEF:mempooltotal2=mempoolused2,mempoolused2,mempoolfree2,+,/,100,* AREA:mempooltotal2#008C0010 DEF:mempoolfree3=/opt/librenms/rrd/10.32.6.1/mempool-cmp-16.rrd:free:AVERAGE DEF:mempoolused3=/opt/librenms/rrd/10.32.6.1/mempool-cmp-16.rrd:used:AVERAGE CDEF:mempooltotal3=mempoolused3,mempoolused3,mempoolfree3,+,/,100,* AREA:mempooltotal3#4096EE10 LINE1:mempooltotal1#CC0000:'Processor ’ GPRINT:mempooltotal1:MIN:%3.0lf%% GPRINT:mempooltotal1:LAST:%3.0lf%% GPRINT:mempooltotal1:MAX:%3.0lf%%\l LINE1:mempooltotal2#008C00:'I/O ’ GPRINT:mempooltotal2:MIN:%3.0lf%% GPRINT:mempooltotal2:LAST:%3.0lf%% GPRINT:mempooltotal2:MAX:%3.0lf%%\l LINE1:mempooltotal3#4096EE:'Driver text ’ GPRINT:mempooltotal3:MIN:%3.0lf%% GPRINT:mempooltotal3:LAST:%3.0lf%% GPRINT:mempooltotal3:MAX:%3.0lf%%\l HRULE:0#999999

RRDTool Output

1809x586
OK u:0.32 s:0.02 r:0.32

Could you help me out understanding what is goin on ?

./discovery.php -h 10.32.6.5 -d
https://p.libren.ms/view/e3f445a4

./poller.php -h 10.32.6.5 -r -f -d
https://p.libren.ms/view/e0eb95b8

I’m looking forward your help :slightly_smiling_face:

LibreNMS reinstalled without changing the DB, imported configuration + rrd directory -> problem solved…