Graphs stopped updating

All graphs of all types stopped getting updated after adjusting which polling modules were active. The only graph anywhere that is getting updated at all is the poller performance graph and even it is only sporadically getting updated with big gaps in it. No other graphs have any updated information.

Output of poller.php for an affected device can be found here (device name obscured for privacy): Untitled - LibreNMS

Output of validate.php here:

===========================================

Component Version
LibreNMS 23.1.0-5-g8d49e72f2 (2023-01-25T11:19:46-08:00)
DB Schema 2022_08_15_084507_add_rrd_type_to_wireless_sensors_table (248)
PHP 8.1.14
Python 3.8.10
Database MariaDB 10.3.37-MariaDB-0ubuntu0.20.04.1
RRDTool 1.7.2
SNMP 5.8
===========================================

[OK] Composer Version: 2.5.1
[OK] Dependencies up-to-date.
[OK] Database connection successful
[OK] Database Schema is current
[OK] SQL Server meets minimum requirements
[OK] lower_case_table_names is enabled
[OK] MySQL engine is optimal
[OK]
[OK] Database schema correct
[OK] MySQl and PHP time match
[OK] Active pollers found
[OK] Dispatcher Service is enabled
[OK] Locks are functional
[OK] Python wrapper cron entry is not present
[OK] Redis is unavailable
[OK] rrdtool version ok
[OK] Connected to rrdcached

RRD files are being created/added.

I am getting a ‘no such file or directory’ message when running rrdtool on the command line. However, before that I was getting a resolution output when running the tool. (like 1085x835) and the graphs were not working then either. Something must have changed during my troubleshooting steps. Here is the output:

rrdtool graph /tmp/WTJ1uec1AvZRtYlZ --start 1674595800 --end 1674682200 --width 2063 --height 644 --font LEGEND:8:DejaVuSansMono --font AXIS:7:DejaVuSansMono --font-render-mode normal -c FONT#000000 -c BACK#EEEEEE00 -c SHADEA#EEEEEE00 -c SHADEB#EEEEEE00 -c CANVAS#FFFFFF00 -c GRID#a5a5a5 -c MGRID#FF9999 -c FRAME#5e5e5e -c ARROW#5e5e5e -l 0 -u 100 --slope-mode DEF:availability=bdu1-ups-2f-02.mycorpcorp.com/availability-86400.rrd:availability:AVERAGE AREA:availability#8B8BEB44: COMMENT:‘Availability(%) Now Ave Max\n’ LINE1.25:availability#000000:'1 day ’ GPRINT:availability:LAST:%6.3lf%s GPRINT:availability:AVERAGE:%6.3lf%s GPRINT:availability:MAX:%6.3lf%s\n COMMENT:\n --daemon unix:/var/run/rrdcached.sock
ERROR: realpath(bdu1-ups-2f-02.mycorpcorp.com/availability-86400.rrd): No such file or directory

Polling seems fine. It seems to only be graph population.

Tried deleting and re-adding a device, re-discovering. Running daily.sh, rebooting, restarting rrdcached, librenms, mysql. I’ve checked many other threads of similar issues and attempted everything in them, without success. One person said they fixed their issue because it was a ‘mariadb problem’ but didn’t expand about the cause which sucks.

kind of at a loss at this point.