It appears over the weekend one of my pollers has stopped working randomly, when I try to run ./validate.php or ./daily.sh on it, I receive both errors below:
I check in /opt/librenms/logs/librenms.log and see that starting 08/01 there are a ton of these errors filling up the log:
Any ideas on this?
In case its needed here is a validation from the master poller and another poller in the cluster:
| Component | Version |
|---|---|
| LibreNMS | 25.8.0-dev.25+b481497ba (2025-08-05T03:05:55-05:00) |
| DB Schema | 2025_07_10_201918_update_vlans_table (353) |
| PHP | 8.3.14 |
| Python | 3.10.12 |
| Database | MariaDB 10.6.22-MariaDB-0ubuntu0.22.04.1 |
| RRDTool | 1.7.2 |
| SNMP | 5.9.1 |
| =========================================== |
[OK] Composer Version: 2.8.10
[OK] Dependencies up-to-date.
[OK] Database Connected
[OK] Database Schema is current
[OK] SQL Server meets minimum requirements
[OK] lower_case_table_names is enabled
[OK] MySQL engine is optimal
[OK] Database and column collations are correct
[OK] Database schema correct
[OK] MySQL and PHP time match
[OK] Distributed Polling setting is enabled globally
[OK] Connected to rrdcached
[OK] Active pollers found
[FAIL] Some dispatcher nodes have not checked in recently
Inactive Nodes:
inactive poller
[OK] Locks are functional
[OK] Python wrapper cron entry is not present
[OK] Redis is functional
[OK] rrdtool version ok
[OK] Connected to rrdcached
===========================================
| Component | Version |
|---|---|
| LibreNMS | 25.8.0-dev.22+867c6cce3 (2025-08-04T13:04:47-05:00) |
| DB Schema | 2025_07_10_201918_update_vlans_table (353) |
| PHP | 8.3.16 |
| Python | 3.10.12 |
| Database | MariaDB 10.6.22-MariaDB-0ubuntu0.22.04.1 |
| RRDTool | 1.7.2 |
| SNMP | 5.9.1 |
| =========================================== |
[OK] Composer Version: 2.8.10
[OK] Dependencies up-to-date.
[OK] Database Connected
[OK] Database Schema is current
[OK] SQL Server meets minimum requirements
[OK] lower_case_table_names is enabled
[OK] MySQL engine is optimal
[OK] Database and column collations are correct
[OK] Database schema correct
[OK] MySQL and PHP time match
[OK] Distributed Polling setting is enabled globally
[OK] Connected to rrdcached
[OK] Active pollers found
[FAIL] Some dispatcher nodes have not checked in recently
Inactive Nodes:
inactive poller
[OK] Locks are functional
[OK] Python wrapper cron entry is not present
[OK] Redis is functional
[OK] rrdtool version ok
[OK] Connected to rrdcached