MySQL application graph showing NaN

Help
1

Hello,

my mysql applications graphs only show NaN

image
image1644×421 102 KB

Other applications on same server (apache, postfix) work fine.

Here ist the output of validate.php:

bash-4.2$ ./validate.php

Component Version
LibreNMS 21.8.0-265-g4d7a5dd
DB Schema 2021_25_01_0129_isis_adjacencies_nullable (216)
PHP 7.3.30
Python 3.6.8
MySQL 10.5.12-MariaDB
RRDTool 1.4.8
SNMP NET-SNMP 5.7.2
====================================

[OK] Composer Version: 1.8.6
[OK] Dependencies up-to-date.
[OK] Database connection successful
[OK] Database schema correct
[WARN] IPv6 is disabled on your server, you will not be able to add IPv6 devices.

And the output of the poller.php:

bash-4.2$ ./poller.php -h 8
LibreNMS Poller
Starting polling run:

Hostname: iliasweb01
Device ID: 8
OS: linux
Resolved IP: 192.168.1.131
(unix)

Load poller module core

Uptime: 324 days 39 minutes 40 seconds

Runtime for poller module ‘core’: 0.0278 seconds with 51224 bytes
SNMP: [2/0.03s] MySQL: [0/0.00s] Graphite: [1/0.00s] RRD: [1/0.00s]

Unload poller module core

Load poller module availability

Availability:
1 day : 100%
7 days : 100%
30 days : 100%
365 days : 100%

Runtime for poller module ‘availability’: 0.0054 seconds with 39352 bytes
SNMP: [0/0.00s] MySQL: [5/0.00s] Graphite: [5/0.00s] RRD: [5/0.00s]

Unload poller module availability

Module [ unix-agent ] disabled globally.

Load poller module os

Generic :frowning:
Location: G3-RZ3-S2
Hardware: Generic x86 64-bit
OS Version: 3.10.0-1127.19.1.el7.x86_64
OS Features:
Serial:

Runtime for poller module ‘os’: 0.0017 seconds with 97976 bytes
SNMP: [0/0.00s] MySQL: [0/0.00s] Graphite: [1/0.00s] RRD: [1/0.00s]

Unload poller module os

Load poller module ipmi

Runtime for poller module ‘ipmi’: 0.0007 seconds with 2992 bytes
SNMP: [0/0.00s] MySQL: [1/0.00s] Graphite: [1/0.00s] RRD: [1/0.00s]

Unload poller module ipmi

Load poller module sensors

Checking (snmp) temperature Package id 0…
Checking (snmp) temperature Core 0…
Checking (snmp) temperature Core 1…
Checking (snmp) temperature Core 2…
Checking (snmp) temperature Core 3…
Checking (snmp) temperature Core 4…
Checking (snmp) temperature Core 5…
Checking (snmp) temperature Core 6…
Checking (snmp) temperature Core 7…
31 C
29 C
28 C
28 C
27 C
29 C
28 C
30 C
29 C

Runtime for poller module ‘sensors’: 0.0714 seconds with 14496 bytes
SNMP: [1/0.03s] MySQL: [11/0.04s] Graphite: [10/0.00s] RRD: [10/0.00s]

Unload poller module sensors

Load poller module processors

Intel Xeon Silver 4110 @ 2.10GHz: 15%
Intel Xeon Silver 4110 @ 2.10GHz: 19%
Intel Xeon Silver 4110 @ 2.10GHz: 21%
Intel Xeon Silver 4110 @ 2.10GHz: 17%
Intel Xeon Silver 4110 @ 2.10GHz: 11%
Intel Xeon Silver 4110 @ 2.10GHz: 14%
Intel Xeon Silver 4110 @ 2.10GHz: 16%
Intel Xeon Silver 4110 @ 2.10GHz: 13%
Intel Xeon Silver 4110 @ 2.10GHz: 10%
Intel Xeon Silver 4110 @ 2.10GHz: 4%
Intel Xeon Silver 4110 @ 2.10GHz: 5%
Intel Xeon Silver 4110 @ 2.10GHz: 11%
Intel Xeon Silver 4110 @ 2.10GHz: 12%
Intel Xeon Silver 4110 @ 2.10GHz: 4%
Intel Xeon Silver 4110 @ 2.10GHz: 14%
Intel Xeon Silver 4110 @ 2.10GHz: 11%

Runtime for poller module ‘processors’: 0.1230 seconds with 62384 bytes
SNMP: [2/0.05s] MySQL: [14/0.07s] Graphite: [17/0.00s] RRD: [17/0.00s]

Unload poller module processors

Load poller module mempools

hrstorage [system]: Physical memory: 14% 13.17 GiiB / 92.95 GiiB
hrstorage [virtual]: Virtual memory: 41% 77.04 GiiB / 186.7 GiiB
hrstorage [swap]: Swap space: 0% 70 MiiB / 93.75 GiiB
hrstorage [buffers]: Memory buffers: 0% 4.06 MiiB / 92.95 GiiB
hrstorage [cached]: Cached memory: 69% 63.8 GiiB / 92.95 GiiB
hrstorage [shared]: Shared memory: 4% 3.98 GiiB / 92.95 GiiB

Runtime for poller module ‘mempools’: 0.0496 seconds with 104928 bytes
SNMP: [1/0.03s] MySQL: [0/0.00s] Graphite: [13/0.00s] RRD: [7/0.00s]

Unload poller module mempools

Load poller module storage

Storage /: hrstorage

43%
Storage /dev/shm: hrstorage

0%
Storage /run: hrstorage

9%
Storage /sys/fs/cgroup: hrstorage

0%
Storage /boot: hrstorage

3%
Storage /boot/efi: hrstorage

1%
Storage /run/user/0: hrstorage

0%

Runtime for poller module ‘storage’: 0.0273 seconds with 18064 bytes
SNMP: [1/0.02s] MySQL: [8/0.00s] Graphite: [15/0.00s] RRD: [8/0.00s]

Unload poller module storage

Load poller module netstats

ICMP IP IP-FORWARD SNMP TCP TCPHC UDP

Runtime for poller module ‘netstats’: 0.1398 seconds with 3544 bytes
SNMP: [7/0.13s] MySQL: [0/0.00s] Graphite: [86/0.00s] RRD: [6/0.00s]

Unload poller module netstats

Load poller module hr-mib

Processes Users

Runtime for poller module ‘hr-mib’: 0.0494 seconds with 3248 bytes
SNMP: [1/0.05s] MySQL: [0/0.00s] Graphite: [3/0.00s] RRD: [3/0.00s]

Unload poller module hr-mib

Load poller module ucd-mib

Runtime for poller module ‘ucd-mib’: 0.0343 seconds with 5000 bytes
SNMP: [2/0.03s] MySQL: [0/0.00s] Graphite: [24/0.00s] RRD: [19/0.00s]

Unload poller module ucd-mib

Load poller module ipSystemStats

ipv4 ipv6

Runtime for poller module ‘ipSystemStats’: 0.0246 seconds with 17224 bytes
SNMP: [1/0.02s] MySQL: [0/0.00s] Graphite: [33/0.00s] RRD: [3/0.00s]

Unload poller module ipSystemStats

Load poller module ports

Caching Oids: Full ports polling ifDescr ifAdminStatus ifOperStatus ifLastChange ifType ifPhysAddress ifMtu ifInErrors ifOutErrors ifInDiscards ifOutDiscards dot3StatsDuplexStatus
Port lo: lo (1 / #371) VLAN = lobps(35.28 Mbps/35.28 Mbps)bytes(155.59 MiB/155.59 MiB)pkts(1.65 Kpps/1.65 Kpps)
Port eno1: eno1 (2 / #372) dot3Duplex VLAN = eno1bps(14.94 Kbps/6.21 Kbps)bytes(67.45 KiB/28.06 KiB)pkts(22.78 pps/2.89 pps)
Port eno2: eno2 (3 / #373) dot3Duplex VLAN = eno2
Port eno3: eno3 (4 / #374) dot3Duplex VLAN = eno3bps(47.49 Kbps/3.65 Mbps)bytes(214.5 KiB/16.12 MiB)pkts(49.3 pps/320.49 pps)
Port enp23s0f0: enp23s0f0 (5 / #375) dot3Duplex VLAN = enp23s0f0bps(1.43 Mbps/50.36 Mbps)bytes(6.3 MiB/222.13 MiB)pkts(1.45 Kpps/4.89 Kpps)
Port eno4: eno4 (6 / #673) dot3Duplex VLAN = eno4bps(0 bps/0 bps)bytes(0 B/0 B)pkts(0 pps/0 pps)
Port enp23s0f1: enp23s0f1 (7 / #674) dot3Duplex VLAN = enp23s0f1bps(2.15 Mbps/93.78 Kbps)bytes(9.5 MiB/423.55 KiB)pkts(205.03 pps/54.3 pps)

Runtime for poller module ‘ports’: 0.2782 seconds with 39000 bytes
SNMP: [14/0.22s] MySQL: [14/0.04s] Graphite: [139/0.00s] RRD: [7/0.00s]

Unload poller module ports

Load poller module customoid

Runtime for poller module ‘customoid’: 0.0010 seconds with 2448 bytes
SNMP: [0/0.00s] MySQL: [1/0.00s] Graphite: [1/0.00s] RRD: [1/0.00s]

Unload poller module customoid

Module [ bgp-peers ] disabled on os.

Module [ junose-atm-vp ] disabled globally.

Module [ printer-supplies ] disabled globally.

Load poller module ucd-diskio

sda sda1 sda2 sda3 dm-0 dm-1

Runtime for poller module ‘ucd-diskio’: 0.0201 seconds with 7872 bytes
SNMP: [1/0.02s] MySQL: [1/0.00s] Graphite: [25/0.00s] RRD: [7/0.00s]

Unload poller module ucd-diskio

Module [ wifi ] disabled globally.

Load poller module wireless

Runtime for poller module ‘wireless’: 0.0030 seconds with 168680 bytes
SNMP: [0/0.00s] MySQL: [1/0.00s] Graphite: [1/0.00s] RRD: [1/0.00s]

Unload poller module wireless

Module [ ospf ] disabled on os.

Module [ isis ] disabled globally.

Module [ cisco-ipsec-flow-monitor ] disabled globally.

Module [ cisco-remote-access-monitor ] disabled globally.

Module [ cisco-cef ] disabled globally.

Module [ slas ] disabled globally.

Module [ cisco-mac-accounting ] disabled globally.

Module [ cipsec-tunnels ] disabled globally.

Module [ cisco-ace-loadbalancer ] disabled globally.

Module [ cisco-ace-serverfarms ] disabled globally.

Module [ cisco-asa-firewall ] disabled globally.

Module [ cisco-voice ] disabled globally.

Module [ cisco-cbqos ] disabled globally.

Module [ cisco-otv ] disabled globally.

Module [ cisco-qfp ] disabled globally.

Module [ cisco-vpdn ] disabled globally.

Module [ nac ] disabled globally.

Module [ netscaler-vsvr ] disabled globally.

Module [ aruba-controller ] disabled globally.

Load poller module entity-physical

Runtime for poller module ‘entity-physical’: 0.0006 seconds with 2152 bytes
SNMP: [0/0.00s] MySQL: [1/0.00s] Graphite: [1/0.00s] RRD: [1/0.00s]

Unload poller module entity-physical

Module [ entity-state ] disabled globally.

Load poller module applications

apache: UUUU…UUU…U…
mysql: .UUUU.UUUUUUUUUU.UU…UUU…UUUU…UUUUU…UU.UUU…U.U.U.UUUU…U.UU…UU…U.
: …

Runtime for poller module ‘applications’: 0.7914 seconds with 91256 bytes
SNMP: [4/0.56s] MySQL: [61/0.22s] Graphite: [152/0.00s] RRD: [5/0.00s]

Unload poller module applications

Module [ mib ] disabled globally.

Module [ stp ] disabled on os.

Load poller module ntp

Runtime for poller module ‘ntp’: 0.0002 seconds with 400 bytes
SNMP: [0/0.00s] MySQL: [0/0.00s] Graphite: [1/0.00s] RRD: [1/0.00s]

Unload poller module ntp

Module [ loadbalancers ] disabled globally.

Module [ mef ] disabled globally.

Load poller module mpls

Runtime for poller module ‘mpls’: 0.0004 seconds with 23880 bytes
SNMP: [0/0.00s] MySQL: [0/0.00s] Graphite: [1/0.00s] RRD: [1/0.00s]

Unload poller module mpls

Enabling graphs:

Polled in 2.714 seconds

Start Device Groups

End Device Groups, runtime: 0.0056s

Start Alerts

End Alerts

SNMP [38/1.21s]: Get[12/0.46s] Getnext[4/0.06s] Walk[22/0.69s]
MySQL [123/0.39s]: Cell[1/0.00s] Row[-1/-0.00s] Rows[16/0.01s] Column[1/0.00s] Update[105/0.38s] Insert[1/0.00s] Delete[0/0.00s]
Graphite [533/0.01s]: Write[533/0.01s]
RRD [108/0.01s]: Update[108/0.01s]

I already deleted the RRD files and did a new discover.

2

I found the following lines in /var/log/carbon/listener.log:

02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBLFh U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBLWn U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBIRd U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBIWr U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBILg U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBIFSc U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IDBRDd U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IDBRId U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IDBRRd U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IDBRUd U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBRd U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBCd U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBWr U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBPse U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBPDBp U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBPFe U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBPMps U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBSRs U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBSWs U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBOWs U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBTNx U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBIIs U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBIMRd U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBIMs U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBILog U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBISc U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBIFLg U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBFBl U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBIIAo U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBIAd U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.IBIAe U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.SlLa U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.status.State_closing_tables U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.status.State_copying_to_tmp_table U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.status.State_end U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.status.State_freeing_items U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.status.State_locked U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.status.State_login U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.status.State_preparing U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.status.State_reading_from_net U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.status.State_sorting_result U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.status.State_statistics U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.status.State_updating U 1630590320) received from client 127.0.0.1:54628, ignoring
02/09/2021 15:45:20 :: invalid line (your.metric.prefix.HOSTNAME.app.app.mysql.46.status.State_writing_to_net U 1630590320) received from client 127.0.0.1:54628, ignoring

3

I disabled the carbon cache, deleted the device and added it again.
But I still got NaN:

[root@HOSTNAME]# rrdtool fetch app-mysql-51.rrd AVERAGE
IDBLBSe IBLFh IBLWn SRows SRange SMPs SScan IBIRd IBIWr IBILg IBIFSc IDBRDd IDBRId IDBRRd IDBRUd IBRd IBCd IBWr TLIe TLWd IBPse IBPDBp IBPFe IBPMps TOC OFs OTs OdTs IBSRs IBSWs IBOWs QCs QCeFy MaCs MUCs ACs AdCs TCd Cs IBTNx KRRs KRs KWR KWs QCQICe QCHs QCIs QCNCd QCLMPs CTMPDTs CTMPTs CTMPFs IBIIs IBIMRd IBIMs IBILog IBISc IBIFLg IBFBl IBIIAo IBIAd IBIAe SFJn SFRJn SRe SRCk SSn SQs BRd BSt CDe CIt CISt CLd CRe CRSt CSt CUe CUMi SlLa

1630823400: -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan
1630823700: -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan
1630824000: -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan
1630824300: -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan
1630824600: -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan
1630824900: -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan
1630825200: -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan
1630825500: -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan
1630825800: -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan -nan

4

Hi Linus,

Are you using extended SNMP, as described here?
https://docs.librenms.org/Extensions/Applications/#mysql

5

Yes I am using extended SNMP

6

What is the output of /etc/snmp/mysql ?

7

a0:919212268337
a1:1432450
a2:15812135
a3:12676294
a4:-1
a5:-1
a6:-1
a7:-1
a8:-1
a9:-1
aa:-1
ab:-1
ac:-1
ad:-1
ae:-1
af:-1
ag:-1
ah:-1
ai:-1
aj:-1
ak:-1
al:-1
am:-1
an:-1
ao:-1
ap:-1
aq:-1
ar:-1
as:-1
at:-1
au:-1
av:-1
aw:-1
ax:-1
ay:-1
az:-1
b0:-1
b1:-1
b2:-1
b3:-1
b4:657963
b5:45889923383
b6:4090
b7:81
b8:1024
b9:502275
ba:1024
bb:3005
bc:1024
bd:198
be:16
bf:328
bg:0
bh:15
bi:6
bj:59825
bk:2
bl:600
bm:16
bn:99297843
bo:-1
bp:-1
bq:0
br:-1
bs:0
bt:0
bu:0
bv:0
bw:0
bx:0
by:0
bz:0
c0:0
c1:0
c2:44441935290
c3:224059619
c4:102436987
c5:43616961283
c6:138006526
c7:51533576
c8:0
c9:0
ca:5594
cb:0
cc:0
cd:6910364
ce:251372
cf:392258928
cg:1
ch:2323253750
ci:45525
cj:733655641
ck:18235497380
cl:214002292
cm:212877782
cn:8374543
co:116136
cp:156394092561979
cq:4226459684509
cr:8388608
cs:-1
ct:-1
cu:-1
cv:-1
cw:32768
cx:15902
cy:503086345
cz:2838225591
d0:-1
d1:-1
d2:-1
d3:-1
d4:-1
d5:-1
d6:1
d7:-1
d8:-1
d9:-1
da:-1
db:-1
dc:-1
dd:-1
de:-1
df:-1
dg:4
dh:1
di:43105520525
dj:136265813
dk:0
dl:783584018
dm:314114121
dn:304945698165
do:1076955969929
dp:20132683528
dq:14860735829
dr:2881743996559
ds:7146
dt:0
du:0
dv:225966194
dw:177217173
dx:-1
dy:-1
dz:-1
e0:-1
e1:-1
e2:-1
e3:-1
e4:-1
e5:-1
e6:-1
e7:-1
e8:-1
e9:-1
ea:-1
eb:-1
ec:-1
ed:-1
ee:-1
ef:-1
eg:0
eh:81165312
ei:134217728
ej:1332638
ek:843564

8

OK, that sounds right. I guess you also have this entry in your snmpd.conf file:
extend mysql /etc/snmp/mysql

9

Yes I have that entry.
I dont think it is a problem on the source device because data is collected.

But I have no clue why the RRD only shows NaN. I deleted the device and the RRD files several times now.
This device belongs to a setup with 2 servers an the other one is configured similiar and the mysql application graphs are shown perfectly.

/edit: The temporary file agent-local-mysql is also filled with data from the script.

10

check this post out:

Specially the output of this command ./poller.php -d -h hostname -m applications

11

I saw that thread, I think it is an other problem because the script gets data, so the user has to be able to login.

Here is the output of the mysql part of “./poller.php -d -H 69 -m applications” where you can see data is pulled and RRD files are updated.

SNMP[‘/usr/bin/snmpget’ ‘-v2c’ ‘-c’ ‘COMMUNITY’ ‘-Ovq’ ‘-M’ ‘/opt/librenms/mibs’ ‘udp:HOSTNAME:161’ ‘.1.3.6.1.4.1.8072.1.3.2.3.1.2.5.109.121.115.113.108’]
a0:919319374315
a1:1432810
a2:15813129
a3:12677277
a4:-1
a5:-1
a6:-1
a7:-1
a8:-1
a9:-1
aa:-1
ab:-1
ac:-1
ad:-1
ae:-1
af:-1
ag:-1
ah:-1
ai:-1
aj:-1
ak:-1
al:-1
am:-1
an:-1
ao:-1
ap:-1
aq:-1
ar:-1
as:-1
at:-1
au:-1
av:-1
aw:-1
ax:-1
ay:-1
az:-1
b0:-1
b1:-1
b2:-1
b3:-1
b4:657972
b5:45895386778
b6:4090
b7:129
b8:1024
b9:502317
ba:1024
bb:3005
bc:1024
bd:198
be:16
bf:328
bg:0
bh:14
bi:7
bj:59825
bk:2
bl:600
bm:16
bn:99314601
bo:-1
bp:-1
bq:0
br:-1
bs:0
bt:0
bu:0
bv:0
bw:0
bx:0
by:0
bz:0
c0:0
c1:0
c2:44447331720
c3:224092907
c4:102451866
c5:43622241222
c6:138023763
c7:51538175
c8:0
c9:0
ca:5594
cb:0
cc:0
cd:6911280
ce:251372
cf:392323704
cg:1
ch:2323674439
ci:45553
cj:733768837
ck:18237782866
cl:214040769
cm:212908819
cn:8375626
co:116193
cp:156420467568715
cq:4226967367231
cr:8388608
cs:-1
ct:-1
cu:-1
cv:-1
cw:32768
cx:15902
cy:503155016
cz:2884719000
d0:-1
d1:-1
d2:-1
d3:-1
d4:-1
d5:-1
d6:1
d7:-1
d8:-1
d9:-1
da:-1
db:-1
dc:-1
dd:-1
de:-1
df:-1
dg:5
dh:1
di:43110702103
dj:136274463
dk:0
dl:783696608
dm:314167783
dn:304983276888
do:1077086961746
dp:20136270857
dq:14862964147
dr:2882513933332
ds:7146
dt:0
du:0
dv:226001454
dw:177236651
dx:-1
dy:-1
dz:-1
e0:-1
e1:-1
e2:-1
e3:-1
e4:-1
e5:-1
e6:-1
e7:-1
e8:-1
e9:-1
ea:-1
eb:-1
ec:-1
ed:-1
ee:-1
ef:-1
eg:0
eh:81533952
ei:134217728
ej:1332736
ek:843672

mysqlRRD[update /opt/librenms/rrd/HOSTNAME/app-mysql-63.rrd N:8388608:U:U:18237782866:733768837:45553:214040769:U:U:U:U:U:U:U:U:U:U:U:45895386778:657972:U:U:U:U:1024:129:1024:502317:U:U:U:0:0:600:328:198:16:7:99314601:U:919319374315:1432810:15813129:12677277:0:0:0:0:0:8375626:212908819:116193:U:U:U:U:U:U:U:U:U:U:6911280:251372:392323704:1:2323674439:4090:4226967367231:1.5642046756872E+14:138023763:102451866:5594:0:51538175:0:43622241222:224092907:0:U]
RRD[update /opt/librenms/rrd/HOSTNAME/app-mysql-63-status.rrd N:U:U:U:U:1:U:U:U:U:U:U:U:U:U:5:1]
SQL[UPDATE applications set app_state=?,app_status=?,timestamp=NOW() WHERE app_id = ? [“OK”,“”,63] 1.56ms]

SQL[SELECT * FROM application_metrics WHERE app_id=? [63] 0.42ms]

: …SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [18237782866,18237720142,63,“SRows”] 1.27ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [733768837,733765448,63,“SRange”] 1.36ms]

U.SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [214040769,214039613,63,“SScan”] 0.83ms]

U…SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [45895386778,45895257551,63,“TLIe”] 1.36ms]

U…SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [7,9,63,“TCd”] 1.36ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [99314601,99314076,63,“Cs”] 0.86ms]

U.SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [919319374315,919311102048,63,“KRRs”] 1.32ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [1432810,1432809,63,“KRs”] 1.36ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [15813129,15813119,63,“KWR”] 0.81ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [12677277,12677267,63,“KWs”] 1.35ms]

U…SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [8375626,8375619,63,“CTMPDTs”] 1.38ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [212908819,212907840,63,“CTMPTs”] 0.81ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [116193,116192,63,“CTMPFs”] 1.35ms]

U…SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [6911280,6911247,63,“SFJn”] 1.35ms]

U.SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [392323704,392322856,63,“SRe”] 1.54ms]

U.SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [2323674439,2323661245,63,“SSn”] 1.44ms]

U.SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [4226967367231,4226955356673,63,“BRd”] 0.83ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [156420467568715,156419692823590,63,“BSt”] 1.38ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [138023763,138023418,63,“CDe”] 1.37ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [102451866,102451461,63,“CIt”] 0.83ms]

U…SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [51538175,51538048,63,“CRe”] 1.53ms]

U.SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [43622241222,43622116999,63,“CSt”] 1.37ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [224092907,224091924,63,“CUe”] 0.82ms]

U…SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [5,8,63,“State_none”] 1.37ms]

U.

12

This RRD update seems very weird:
RRD[update /opt/librenms/rrd/HOSTNAME/app-mysql-63-status.rrd N:U:U:U:U:1:U:U:U:U:U:U:U:U:U:5:1]

This is mine:
RRD[update 10.10.10.51/app-mysql-1-status.rrd N:0:0:0:0:0:0:0:0:0:0:0:0:0:0:20:1 --daemon 10.10.10.51:42217]

Why are you getting these U’s there? :thinking:

13

The update looks the same on the other server I mentioned where the graphs are shown fine:

RRD[update /opt/librenms/rrd/HOSTNAME-2/app-mysql-41-status.rrd N:U:U:U:U:1:U:U:U:U:U:U:U:U:U:U:2]

I dont know why there are “U” instead of “0”

14

Hi,
I’m showing the same issue. My mysql graphing was working but stopped around begining of june.

When I debug the poller I get.

mysqlRRD[last ncnmcp04f/app-mysql-40.rrd --daemon librenms-rrd:42217]
RRD[update ncnmcp04f/app-mysql-40.rrd N:16777216:788664540436:788664540436:33657:283:50:659:51388:73365:41996:4176:3523:4213:48864081:43062:51278:242:30555:18:0:32764:30055:1024:27:2000:25:182:188:0:49541:19872:1048576:1031320:151:32:0:0:15:992:3359764432:0:0:0:0:0:0:0:0:0:757:3631:105:409:409:408:0:0:0:0:0:0:0:16:0:2199:0:22280:0:42889110:267336633:1548:687:0:0:0:0:73789:49821:0:U --daemon librenms-rrd:42217]
RRD[last ncnmcp04f/app-mysql-40-status.rrd --daemon librenms-rrd:42217]
RRD[update ncnmcp04f/app-mysql-40-status.rrd N:0:0:0:0:1:0:0:0:0:0:0:0:0:0:14:5 --daemon librenms-rrd:42217]
SQL[SELECT * FROM devices LEFT JOIN applications ON devices.device_id=applications.device_id WHERE applications.app_id=? [40] 1.6ms]

SQL[insert into eventlog (device_id, reference, type, datetime, severity, message, username) values (?, ?, ?, ?, ?, ?, ?) [104,null,“application”,“2021-09-07 10:31:38”,1,“Application MySQL changed to OK”,“”] 1.44ms]

SQL[UPDATE applications set app_state=?,app_status=?,timestamp=NOW(),app_state_prev=? WHERE app_id = ? [“OK”,“”,“UNKNOWN”,40] 1.12ms]

SQL[SELECT * FROM application_metrics WHERE app_id=? [40] 1.28ms]

: SQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [16777216,0,40,“IDBLBSe”] 1.04ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [788664540436,0,40,“IBLFh”] 0.94ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [788664540436,0,40,“IBLWn”] 1.03ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [33657,0,40,“SRows”] 1.07ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [283,0,40,“SRange”] 1.11ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [50,0,40,“SMPs”] 1.16ms]

USQL[UPDATE application_metrics set value=?,value_prev=? WHERE app_id=? && metric=? [659,0,40,“SScan”] 1.12ms]

The values in the DB are fine. Just the RRD is nan.

The last line of RRD update looks suspect to me.
mysqlRRD[last ncnmcp04f/app-mysql-40.rrd --daemon librenms-rrd:42217]
RRD[update ncnmcp04f/app-mysql-40.rrd N:16777216:788664540436:788664540436:33657:283:50:659:51388:73365:41996:4176:3523:4213:48864081:43062:51278:242:30555:18:0:32764:30055:1024:27:2000:25:182:188:0:49541:19872:1048576:1031320:151:32:0:0:15:992:3359764432:0:0:0:0:0:0:0:0:0:757:3631:105:409:409:408:0:0:0:0:0:0:0:16:0:2199:0:22280:0:42889110:267336633:1548:687:0:0:0:0:73789:49821:0:U --daemon librenms-rrd:42217]
RRD[last ncnmcp04f/app-mysql-40-status.rrd --daemon librenms-rrd:42217]

RRD[update ncnmcp04f/app-mysql-40-status.rrd N:0:0:0:0:1:0:0:0:0:0:0:0:0:0:14:5 --daemon librenms-rrd:42217]

Is it overwriting the update with Zeros?

15

Ok so I deleted the old app-mysql-40.rrd file and it seems to be happy now.
Looking over the code it looks like includes/polling/applications/mysql.inc.php was updated to include additional metrics that the old RRD may not have had in it.

16

Thank you for your post but deleting the RRD file does not work for me.
I did that several times, I even deleted the whole device including all RRD files multiple times.

/edit: the mysql.inc.php is the current version.

17

I found giant values in the DB, for example datapoint “BSt” has the value “156725489527730”.
rrdinfo app-mysql-63.rrd shows a max value of “ds[BSt].max = 1.2500000000e+11”. Isnt this too small to hold the actual value ?

I did try to set the max values to unlimited with the command “rrdtool tune app-mysql-63.rrd -a BSt:U” but it still shows NaN in the RRD file.

18

I “solved” the problem with the dirty patch from https://github.com/librenms/librenms/issues/13169 . Not really solved, but its a workaround. I posted my findings too.

19

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.