Another red graph / Error drawing graph post

Hey all,

So, first of all, it seems like the first time every day that I run “validate.php”, I get this:
[root@librenms librenms]# ./validate.php

Component Version
LibreNMS 1.59
DB Schema 2020_01_09_1300_migrate_devices_attribs_table (154)
PHP 7.2.24
MySQL 5.5.64-MariaDB
RRDTool 1.4.8
SNMP NET-SNMP 5.7.2

====================================

[OK] Composer Version: 1.9.2
[OK] Dependencies up-to-date.
[OK] Database connection successful
[WARN] Your database schema has extra migrations (2019_12_17_151314_add_invert_map_to_alert_rules, 2020_01_09_1300_migrate_devices_attribs_table). If you just switched to the stable release from the daily release, your database is in between releases and this will be resolved with the next release.
[OK] Database schema correct
[FAIL] Some folders have incorrect file permissions, this may cause issues.
[FIX]:
sudo chown -R librenms:librenms /opt/librenms
sudo setfacl -d -m g::rwx /opt/librenms/rrd /opt/librenms/logs /opt/librenms/bootstrap/cache/ /opt/librenms/storage/
sudo chmod -R ug=rwX /opt/librenms/rrd /opt/librenms/logs /opt/librenms/bootstrap/cache/ /opt/librenms/storage/
Files:
/opt/librenms/bootstrap/cache/services.php

So, I run the commands to fix the file permissions. But that doesn’t seem to help my problem.

I currently have two Juniper MX-480 and a Juniper EX-4600 stack added to the Devices list, as a test. Here’s what I have observed:

  1. When I browse to the Ports tab on any of the devices, the list is empty under the Basic, Details, and the default Graphs. However, the mini versions of the graphs populate, though there is absolutely no data in any of them.

  2. If I select the Graphs - Bits - Mini link, all of the interface graphs start populating. They are all red, and none show any traffic.

  3. If I click on one of the interface graphs, there are no graphs displayed. The three stacked mini graphs in the “header” are all red, and if I hover over them, the displayed graphs show “Error drawing graph”.

  4. Real time graphing works! However, the bandwidth usage displayed at timelines under 5s is way off, but 5s and up seem to be pretty accurate.

Any ideas on where to start with this?

TIA,

Alex

OK, now something is really messed up. Can’t log in, gives an error. Here’s the output of validate.php:

====================================

Component Version
LibreNMS 1.60
DB Schema 2019_12_28_180000_add_overwrite_ip_to_devices (156)
PHP 7.2.24
MySQL 5.5.64-MariaDB
RRDTool 1.4.8
SNMP NET-SNMP 5.7.2
====================================

[OK] Composer Version: 1.9.3
[OK] Dependencies up-to-date.
[OK] Database connection successful
[FAIL] Database: missing column (alert_rules/invert_map)
[FAIL] Database: missing column (devices/disable_notify)
[FAIL] We have detected that your database schema may be wrong, please report the following to us on Discord (LibreNMS) or the community site (Report database schema issues here - LibreNMS Community):
[FIX]:
Run the following SQL statements to fix.
SQL Statements:
ALTER TABLE alert_rules ADD invert_map tinyint(1) NOT NULL DEFAULT ‘0’ AFTER proc;
ALTER TABLE devices ADD disable_notify tinyint(1) NOT NULL DEFAULT ‘0’ AFTER max_depth;
[FAIL] Some folders have incorrect file permissions, this may cause issues.
[FIX]:
sudo chown -R librenms:librenms /opt/librenms
sudo setfacl -d -m g::rwx /opt/librenms/rrd /opt/librenms/logs /opt/librenms/bootstrap/cache/ /opt/librenms/storage/
sudo chmod -R ug=rwX /opt/librenms/rrd /opt/librenms/logs /opt/librenms/bootstrap/cache/ /opt/librenms/storage/
Files:
/opt/librenms/bootstrap/cache/services.php

I have applied the SQL statements, and rerun the permissions fixes (AGAIN!!!). New validate.php output:

====================================

Component Version
LibreNMS 1.60
DB Schema 2019_12_28_180000_add_overwrite_ip_to_devices (156)
PHP 7.2.24
MySQL 5.5.64-MariaDB
RRDTool 1.4.8
SNMP NET-SNMP 5.7.2
====================================

[OK] Composer Version: 1.9.3
[OK] Dependencies up-to-date.
[OK] Database connection successful
[OK] Database schema correct

Still all red graphs. But at least now I can log in and use the interface.

Well, I should clarify that statement: the graphs for the INTERFACES are red and empty. However, the graphs for the processor, memory, environmental, power, even the transceivers, are all good and working.

Anyone?

And again today…

====================================

Component Version
LibreNMS 1.60
DB Schema 2019_12_28_180000_add_overwrite_ip_to_devices (156)
PHP 7.2.24
MySQL 5.5.64-MariaDB
RRDTool 1.4.8
SNMP NET-SNMP 5.7.2
====================================

[OK] Composer Version: 1.9.3
[OK] Dependencies up-to-date.
[OK] Database connection successful
[OK] Database schema correct
[FAIL] Some folders have incorrect file permissions, this may cause issues.
[FIX]:
sudo chown -R librenms:librenms /opt/librenms
sudo setfacl -d -m g::rwx /opt/librenms/rrd /opt/librenms/logs /opt/librenms/bootstrap/cache/ /opt/librenms/storage/
sudo chmod -R ug=rwX /opt/librenms/rrd /opt/librenms/logs /opt/librenms/bootstrap/cache/ /opt/librenms/storage/
Files:
/opt/librenms/bootstrap/cache/services.php

1 Like

More data:

RRDTool Command

rrdtool graph /tmp/bNHVUpSO3wgCAasz --alt-autoscale-max --rigid -E --start 1581259200 --end 1581345600 --width 1152 --height 300 -c BACK#EEEEEE00 -c SHADEA#EEEEEE00 -c SHADEB#EEEEEE00 -c CANVAS#FFFFFF00 -c GRID#a5a5a5 -c MGRID#FF9999 -c FRAME#5e5e5e -c ARROW#5e5e5e -R normal -c FONT#000000 --font LEGEND:8:DejaVuSansMono --font AXIS:7:DejaVuSansMono --font-render-mode normal COMMENT:’ Now Avg Max’ COMMENT:’ Total’ COMMENT:‘\n’ CDEF:inB= CDEF:outB= CDEF:octets=inB,outB,+ CDEF:doutB=outB,-1,* CDEF:inbits=inB,8,* CDEF:outbits=outB,8,* CDEF:bits=inbits,outbits,+ CDEF:doutbits=doutB,8,* VDEF:percentile_in=inbits,95,PERCENT VDEF:percentile_out=outbits,95,PERCENT CDEF:dpercentile_outn=doutbits,-1,* VDEF:dpercentile_outnp=dpercentile_outn,95,PERCENT CDEF:dpercentile_outnpn=doutbits,doutbits,-,dpercentile_outnp,-1,*,+ VDEF:dpercentile_out=dpercentile_outnpn,FIRST VDEF:totin=inB,TOTAL VDEF:avein=inbits,AVERAGE VDEF:totout=outB,TOTAL VDEF:aveout=outbits,AVERAGE VDEF:tot=octets,TOTAL COMMENT:’ \n’ HRULE:999999999999999#FFFFFF:‘Total In ’ GPRINT:inbits:LAST:%6.2lf%s GPRINT:inbits:AVERAGE:%6.2lf%s GPRINT:inbits:MAX:%6.2lf%s GPRINT:totin:%6.2lf%sB COMMENT:’\n’ HRULE:999999999999990#FFFFFF:’ Out’ GPRINT:outbits:LAST:%6.2lf%s GPRINT:outbits:AVERAGE:%6.2lf%s GPRINT:outbits:MAX:%6.2lf%s GPRINT:totout:%6.2lf%sB COMMENT:‘\n’ HRULE:999999999999990#FFFFFF:’ Agg’ GPRINT:bits:LAST:%6.2lf%s GPRINT:bits:AVERAGE:%6.2lf%s GPRINT:bits:MAX:%6.2lf%s GPRINT:tot:%6.2lf%sB COMMENT:‘\n’ HRULE:0#999999

RRDTool Output

ERROR: String ends after the = sign on ‘CDEF:inB=’

Anyone?

Nothing, after 21 days… No ideas from anyone?

Might have to abandon this. I hate to, because I really like the interface and see the advantages. But if the graphing refuses to work, and no one can offer any advice or help, I guess I don’t really have any choice.