Daily Update Broke Poller

Hi everyone,

Since last daily update on midnight (local time) the poller stopped working.

Anyone else seeing this behavior?

Regards,

Time of incident: 2021-08-09 20:15 PST
OS: Raspbian GNU/Linux 10 (buster)
Issue: Poller is not successfully polling any devices

Cronic detected failure or error output for the command:
    /opt/librenms/poller-wrapper.py 4

    RESULT CODE: 1

    ERROR OUTPUT:
    ERROR: Could not execute command [['/usr/bin/env', 'php', '/opt/librenms/config_to_json.php']]: Expecting value: line 1 column 1 (char 0)
    Traceback (most recent call last):
      File "/opt/librenms/poller-wrapper.py", line 37, in <module>
        log_dir = config["log_dir"]
    TypeError: 'NoneType' object is not subscriptable

VALIDATE OUTPUT:

librenms@server-3-1:~$ ./validate.php
====================================
Component | Version
--------- | -------
LibreNMS  | 21.7.0-61-g93209a0fc
DB Schema | 2021_08_04_102914_add_syslog_indexes (213)
PHP       | 7.4.22
Python    | 3.7.3
MySQL     | 10.3.29-MariaDB-0+deb10u1
RRDTool   | 1.7.1
SNMP      | NET-SNMP 5.7.3
====================================

[OK]    Composer Version: 2.1.5
[OK]    Dependencies up-to-date.
[OK]    Database connection successful
[OK]    Database schema correct
[WARN]  IPv6 is disabled on your server, you will not be able to add IPv6 devices.
[WARN]  Your local git contains modified files, this could prevent automatic updates.
        [FIX]:
        You can fix this with ./scripts/github-remove
        Modified Files:
         includes/definitions/ciscosb.yaml
         includes/definitions/dahua-nvr.yaml
         rrd/.gitignore

Same error here:

Cronic detected failure or error output for the command:
/opt/librenms/poller-wrapper.py 6

RESULT CODE: 1

ERROR OUTPUT:
ERROR: Could not execute command [['/usr/bin/env', 'php', '/opt/librenms/config_to_json.php']]: Expecting value: line 1 column 1 (char 0)
Traceback (most recent call last):
  File "/opt/librenms/poller-wrapper.py", line 37, in <module>
    log_dir = config["log_dir"]
TypeError: 'NoneType' object is not subscriptable

STANDARD OUTPUT:

Validate output:

librenms@librenms:~$ ./validate.php
====================================
Component | Version
--------- | -------
LibreNMS  | 21.7.0-61-g93209a0fc
DB Schema | 2021_08_04_102914_add_syslog_indexes (213)
PHP       | 7.3.29-1~deb10u1
Python    | 3.7.3
MySQL     | 10.3.29-MariaDB-0+deb10u1
RRDTool   | 1.7.1
SNMP      | NET-SNMP 5.7.3
====================================

[OK]    Composer Version: 2.1.5
[OK]    Dependencies up-to-date.
[OK]    Database connection successful
[OK]    Database schema correct

My poller is crazy… sometimes all ok… and some time goes all wrong:

My Poller stopped working right after the update this morning. Is is possible to rollback the update?

I was seeing the same problem this morning - but manually ran the daily update script again and it looks like there’s a new patch already if the version numbering is anything to go by. No longer getting any errors about being unable to import the .env.

Component Version
LibreNMS 21.7.0-62-g31246c6ba
DB Schema 2021_08_04_102914_add_syslog_indexes (213)
PHP 7.3.20
Python 3.6.8
MySQL 10.3.28-MariaDB
RRDTool 1.7.0
SNMP NET-SNMP 5.8

I tried running update again and it seems to have fixed my problems. My charts are populating once again…

====================================

Component Version
LibreNMS 21.7.0-63-ga7f9c97ae
DB Schema 2021_08_04_102914_add_syslog_indexes (213)
PHP 7.4.9
Python 3.8.10
MySQL 10.3.29-MariaDB-0ubuntu0.20.10.1
RRDTool 1.7.2
SNMP NET-SNMP 5.8

====================================

[^[[32mOK^[[0m] Composer Version: 2.1.5
[^[[32mOK^[[0m] Dependencies up-to-date.
[^[[0;32mOK^[[0m] Database connection successful
[^[[0;32mOK^[[0m] Database schema correct

Indeed, I ran the update script again and the poller is now working as usual on the newest version.

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.