Dispatcher not updaing RRD files

Help
#1

So I converted my kubernetes install from using the librenms cron to using dispatcher. I installed redis and everything ‘seems’ good however none of my rrd files are getting updated. I am also getting an error on the console of the dispatcher. I don’t know if this has anything do do with the rrd issue.

2020-07-06T11:02:42.765447505-04:00 Poller_0-15(ERROR):Poller poller exception! 'utf-8' codec can't decode bytes in position 3015-3016: invalid continuation byte
2020-07-06T11:02:42.775751521-04:00 Traceback (most recent call last):
2020-07-06T11:02:42.775783953-04:00   File "/opt/librenms/LibreNMS/queuemanager.py", line 63, in _service_worker
2020-07-06T11:02:42.775793994-04:00     self.do_work(device_id, queue_id)
2020-07-06T11:02:42.775808117-04:00   File "/opt/librenms/LibreNMS/queuemanager.py", line 392, in do_work
2020-07-06T11:02:42.775813886-04:00     LibreNMS.call_script('poller.php', ('-h', device_id))
2020-07-06T11:02:42.775820225-04:00   File "/opt/librenms/LibreNMS/__init__.py", line 39, in call_script
2020-07-06T11:02:42.77582537-04:00     return subprocess.check_output(cmd, stderr=subprocess.STDOUT, preexec_fn=os.setsid).decode()
2020-07-06T11:02:42.775845797-04:00 UnicodeDecodeError: 'utf-8' codec can't decode bytes in position 3015-3016: invalid continuation byte
#2

Your OS isn’t set to use UTF or something?

#3

Good question. I’m running this in a container in k3s. The node is running Ubuntu 18.04.

# --------------------------------------------------------------------------------
# LibreNMS Dispatcher
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: librenms-dispatcher
  namespace: librenms
spec:
  serviceName: librenms-dispatcher
  replicas: 1
  selector:
    matchLabels:
      app: librenms-dispatcher
  template:
    metadata:
      labels:
        app: librenms-dispatcher
    spec:
      initContainers:
        - name: nfs-fixer
          image: alpine
          securityContext:
            runAsUser: 0
          volumeMounts:
          - name: librenms-data
            mountPath: /nfs
          command:
          - sh
          - -c
          - (chmod 0775 /nfs; chown -R 1000:1000 /nfs)
      containers:
      - name: librenms-dispatcher
        image: librenms/librenms:1.65
        imagePullPolicy: IfNotPresent
        env:
        - name: TZ
          value: America/Montreal
        - name: PUID
          value: "1000"
        - name: PGID
          value: "1000"
        - name: DB_HOST
          valueFrom:
            configMapKeyRef:
              name: librenms-config
              key: MYSQL_SERVER
        - name: DB_NAME
          valueFrom:
            configMapKeyRef:
              name: librenms-config
              key: MYSQL_DATABASE
        - name: DB_USER
          valueFrom:
            configMapKeyRef:
              name: librenms-config
              key: MYSQL_USERNAME
        - name: DB_PASSWORD
          valueFrom:
            configMapKeyRef:
              name: librenms-config
              key: MYSQL_PASSWORD
        - name: DB_TIMEOUT
          value: "60"
        - name: DISPATCHER_NODE_ID
          valueFrom:
            fieldRef:
              fieldPath: metadata.name
        - name: REDIS_HOST
          value: "redis"
        - name: REDIS_PORT
          value: "6379"
        - name: REDIS_DB
          value: "0"
        - name: SIDECAR_DISPATCHER
          value: "1"
        volumeMounts:
        - name: librenms-data
          mountPath: /data
      nodeSelector:
        kubernetes.io/arch: amd64
        node-role.kubernetes.io/vm: ""
      volumes:
      - name: librenms-data
        nfs:
          server: 192.168.0.6
          path: /volume1/k3s/librenms/librenms-data
#4

Hi

Are some your graphs red. I installed 1.65 docker today on Ubuntu 18.04 using docker-compose.

Most of my graphs are red some aren’t graphing at all.

Thanks

#5

possibly, your UI instance is not able to access the RRD directory. check the RRD Command & output of the Red graphs you are seeing.

#6

Hi

Below is an example of what is happening

image
image1849×465 28.8 KB

#7

docker-compose exec --user librenms librenms php validate.php

Component Version
LibreNMS 1.65
DB Schema 2020_06_23_00522_alter_availability_perc_column (170)
PHP 7.3.19
Python 3.8.3
MySQL 10.4.13-MariaDB-1:10.4.13+maria~focal
RRDTool 1.7.2
SNMP NET-SNMP 5.8

====================================

[OK] Installed from the official Docker image; no Composer required
[OK] Database connection successful
[OK] Database schema correct
[WARN] IPv6 is disabled on your server, you will not be able to add IPv6 devices.
[WARN] Updates are managed through the official Docker image

#8