Centos 8.1 - Error Drawing Graphs

Reinhard_Lal · 1 April 2020 05:01

Hi,

New install 2 days ago, everything working except

“Error Drawing Graphs” , no graphs are showing up
rrd directory is empty
All permissions are good
SELINUX disabled also for testing

Graphing in realtime works.

A. Below details of ./validate.php :

OS: CentOS Linux release 8.1.1911 (Core)

Component	Version
LibreNMS	1.62-3-g7b8ca66c6
DB Schema	2020_03_24_0844_add_primary_key_to_device_graphs (160)
PHP	7.2.11
MySQL	10.3.17-MariaDB
RRDTool	1.7.0
SNMP	NET-SNMP 5.8
====================================

B. OutPut of Discovery.php:

./discovery.php -h 172.x.x.x -d | ./pbin.sh

Paste endpoint: https://p.libren.ms/api/create

SQL[ select migration from migrations order by id desc limit 1 [] 0.35ms]

SQL[ select count(*) as aggregate from migrations limit 1 [] 0.27ms]

SQL[ SELECT version() [] 0.17ms]

Updating os_def.cache…

Done

SQL[ SELECT * FROM devices WHERE disabled = 0 AND snmp_disable = 0 AND hostname LIKE ‘172.x.x.x’ ORDER BY device_id DESC [] 0.75ms]

./discovery.php 172.x.x.x 2020-04-01 16:02:28 - 0 devices discovered in 0.211 secs

title:
name: root
private: 1
expire: 0

C. Running Poller :

\LibreNMS Poller

SQL[ select migration from migrations order by id desc limit 1 [] 0.37ms]
SQL[ select count(*) as aggregate from migrations limit 1 [] 0.33ms]
SQL[ SELECT version() [] 0.18ms]

===================================

Version info:

Commit SHA: 7b8ca66c67e490e8c2090efa7784b51eb0b4e87b
Commit Date: 1585714575
DB Schema: 2020_03_24_0844_add_primary_key_to_device_graphs (160)
PHP: 7.2.11
MySQL: 10.3.17-MariaDB
RRDTool: 1.7.0
SNMP: NET-SNMP 5.8
==================================DEBUG!

Updating os_def.cache…

Done

Starting polling run:

SQL[ SELECT * FROM devices WHERE disabled = 0 AND hostname = ‘172.x.x.x’ ORDER BY device_id ASC [] 1.07ms]

./poller.php 172.x.x.x 2020-04-01 16:07:48 - 0 devices polled in 0.230 secs

MySQL [1/0.00s]: Cell[1/0.00s] Row[-1/-0.00s] Rows[1/0.00s] Column[0/0.00s] Update[0/0.00s] Insert[0/0.00s] Delete[0/0.00s]

RRD [0/0.00s]:

D. No Errors showing up in /opt/librenms/logs/librenms.log file
E. Devices being polled is using snmp , and are Cisco switches and a router for testing.

Do have a look and assist what else i need to check.

thanks,
Rein

TheGreatDoc · 1 April 2020 06:26

Hi,

Run the poller command adding the -d argv, so debug output will be showed

Reinhard_Lal · 1 April 2020 06:54

Here : Poller ran with debug.

LibreNMS Poller

SQL[ select migration from migrations order by id desc limit 1 [] 0.39ms]

SQL[ select count(*) as aggregate from migrations limit 1 [] 0.36ms]

SQL[ SELECT version() [] 0.24ms]

===================================

Version info:

Commit SHA: 7b8ca66c67e490e8c2090efa7784b51eb0b4e87b

Commit Date: 1585714575

DB Schema: 2020_03_24_0844_add_primary_key_to_device_graphs (160)

PHP: 7.2.11

MySQL: 10.3.17-MariaDB

RRDTool: 1.7.0

SNMP: NET-SNMP 5.8

==================================DEBUG!

Updating os_def.cache…

Done

Starting polling run:

SQL[ SELECT * FROM devices WHERE disabled = 0 AND hostname = ‘172.x.x.x’ ORDER BY device_id ASC [] 1.08ms]

./poller.php 172.x.x.x 2020-04-01 18:12:11 - 0 devices polled in 0.211 secs

MySQL [1/0.00s]: Cell[1/0.00s] Row[-1/-0.00s] Rows[1/0.00s] Column[0/0.00s] Update[0/0.00s] Insert[0/0.00s] Delete[0/0.00s]

RRD [0/0.00s]:

TheGreatDoc · 1 April 2020 07:21

Well, thats an issue

Use the ID instead the hostname.

Reinhard_Lal · 2 April 2020 00:40

Hi,

Sorry , found the Device ID and this is the result. It now created rrd files in the rrd directory but what is the fix for this , in the WebUI, its added using hostname and IP address. None work unless i use Devise ID.

./poller.php -h 3

LibreNMS Poller

Starting polling run:

Hostname: xxxxxxxxxxxxx

Device ID: 3

OS: ios

Assigned IP: 172.x.x.x

(cisco)

Load poller module core

Uptime: 1 year 55 days 13 hours 22 minutes 48 seconds

Runtime for poller module ‘core’: 0.0211 seconds with 86376 bytes

SNMP: [2/0.02s] MySQL: [0/0.00s] RRD: [1/0.00s]

Unload poller module core

Module [ unix-agent ] disabled globally.

Load poller module os

Hardware: CISCO3925-CHASSIS

Version: 15.2(4)M3, RELEASE SOFTWARE (fc2)

Features: UNIVERSALK9

Serial: FTX1728AK5Q

Runtime for poller module ‘os’: 0.0279 seconds with 58040 bytes

SNMP: [2/0.03s] MySQL: [0/0.00s] RRD: [1/0.00s]

Unload poller module os

Module [ ipmi ] disabled on os.

Load poller module sensors

Checking (snmp) state 12V Voltage In MV…

Checking (snmp) state 5V Voltage In MV…

Checking (snmp) state 3.3V Voltage In MV…

Checking (snmp) state 2.5V Voltage In MV…

Checking (snmp) state 1.8V Voltage In MV…

Checking (snmp) state 1.2V Voltage In MV…

Checking (snmp) state ASIC Voltage In MV…

Checking (snmp) state CPU Core Voltage In MV…

Checking (snmp) state CPU…

Checking (snmp) state Intake Left…

Checking (snmp) state Intake Right…

Checking (snmp) state Exhaust Right…

Checking (snmp) state Exhaust Left…

Checking (snmp) state Power Supply 1…

Checking (snmp) state Fan Tray…

Checking (snmp) state Fan 1…

Checking (snmp) state Fan 2…

Checking (snmp) state Fan 3…

Checking (snmp) state Fan 4…

Checking (snmp) state Fan 5…

Checking (snmp) state C3900 AC Power Supply 1…

Checking (snmp) state Unknown…

Checking (snmp) state Cisco Services Performance Engine 100 for Cisco 3900 ISR on Slot 0…

Checking (snmp) state VSS Device State…

Checking (snmp) state VSS Peer State…

1

5

2

14

2

Checking (snmp) temperature CPU…

Checking (snmp) temperature Intake Left…

Checking (snmp) temperature Intake Right…

Checking (snmp) temperature Exhaust Right…

Checking (snmp) temperature Exhaust Left…

Checking (snmp) temperature Power Supply 1…

48

21

22

23

Runtime for poller module ‘sensors’: 0.0980 seconds with 2672 bytes

SNMP: [4/0.09s] MySQL: [4/0.00s] RRD: [32/0.00s]

Unload poller module sensors

Load poller module processors

24%

Runtime for poller module ‘processors’: 0.0279 seconds with 131136 bytes

SNMP: [1/0.02s] MySQL: [2/0.00s] RRD: [2/0.00s]

Unload poller module processors

Load poller module mempools

Mempool CISCO3925-CHASSIS - Processor: 10.06%

Mempool CISCO3925-CHASSIS - I/O: 7.57%

Runtime for poller module ‘mempools’: 0.0415 seconds with 7608 bytes

SNMP: [4/0.04s] MySQL: [3/0.00s] RRD: [3/0.00s]

Unload poller module mempools

Load poller module storage

Runtime for poller module ‘storage’: 0.0007 seconds with 1624 bytes

SNMP: [0/0.00s] MySQL: [1/0.00s] RRD: [1/0.00s]

Unload poller module storage

Load poller module netstats

ICMP IP IP-FORWARD SNMP TCP TCPHC UDP

Runtime for poller module ‘netstats’: 0.1635 seconds with 1712 bytes

SNMP: [7/0.16s] MySQL: [0/0.00s] RRD: [7/0.00s]

Unload poller module netstats

Load poller module hr-mib

Runtime for poller module ‘hr-mib’: 0.0118 seconds with 1560 bytes

SNMP: [1/0.01s] MySQL: [0/0.00s] RRD: [1/0.00s]

Unload poller module hr-mib

Load poller module ucd-mib

Runtime for poller module ‘ucd-mib’: 0.0287 seconds with 8152 bytes

SNMP: [3/0.03s] MySQL: [0/0.00s] RRD: [1/0.00s]

Unload poller module ucd-mib

Load poller module ipSystemStats

ipv4 ipv6

Runtime for poller module ‘ipSystemStats’: 0.0185 seconds with 17312 bytes

SNMP: [1/0.02s] MySQL: [0/0.00s] RRD: [3/0.00s]

Unload poller module ipSystemStats

Load poller module ports

Caching Oids: Full ports polling ifDescr ifAdminStatus ifOperStatus ifLastChange ifType ifPhysAddress ifMtu ifInErrors ifOutErrors ifInDiscards ifOutDiscards dot3StatsDuplexStatus

Port Ba0/3: Backplane-GigabitEthernet0/3 (1 / #1) VLAN = Backplane-GigabitEthernet0/3bps(0 bps/0 bps)bytes(0 B/0 B)pkts(0 pps/0 pps)

Port Gi0/0: GigabitEthernet0/0 (2 / #2) dot3Duplex VLAN = [Trunk: BM_SB_IXPSW1]bps(4.91 Mbps/5.68 Mbps)bytes(89 MB/102.87 MB)pkts(993.68 pps/2.16 kpps)

Port Gi0/1: GigabitEthernet0/1 (3 / #3) dot3Duplex VLAN = [Trunk: BM_SB_IGWSW1]bps(2.69 Mbps/4.72 Mbps)bytes(48.76 MB/85.45 MB)pkts(2.19 kpps/842.28 pps)

Port Gi0/2: GigabitEthernet0/2 (4 / #4) dot3Duplex VLAN = GigabitEthernet0/2

Port Em0/0: Embedded-Service-Engine0/0 (5 / #5) dot3Duplex VLAN = Embedded-Service-Engine0/0

Port Nu0: Null0 (6 / #6) VLAN = Null0bps(0 bps/0 bps)bytes(0 B/0 B)pkts(0 pps/0 pps)

Port Lo10: Loopback10 (7 / #7) VLAN = Loopback10bps(0 bps/0 bps)bytes(0 B/0 B)pkts(0 pps/0 pps)

Port Lo50: Loopback50 (8 / #8) VLAN = Loopback50bps(0 bps/0 bps)bytes(0 B/0 B)pkts(0 pps/0 pps)

Port Tu1: Tunnel1 (9 / #9) VLAN = [PNG-SI GRE Tunnel-temp]bps(0 bps/0 bps)bytes(0 B/0 B)pkts(0 pps/0 pps)

Port Tu21: Tunnel21 (10 / #10) VLAN = Tunnel21

Port Gi0/0.10: GigabitEthernet0/0.10 (11 / #11) VLAN = [PACTEL Internet]bps(239.35 kbps/72.78 kbps)bytes(4.34 MB/1.32 MB)pkts(283.61 pps/80.57 pps)

Port NV0: NVI0 (12 / #12) VLAN = NVI0bps(0 bps/0 bps)bytes(0 B/0 B)pkts(0 pps/0 pps)

Port Gi0/0.20: GigabitEthernet0/0.20 (13 / #13) VLAN = [MINTA Internet]bps(597 bps/584 bps)bytes(11.07 kB/10.83 kB)pkts(0 pps/0 pps)

Port Gi0/0.30: GigabitEthernet0/0.30 (14 / #14) VLAN = [O3B Internet]bps(4.11 Mbps/602 bps)bytes(74.44 MB/11.17 kB)pkts(656.95 pps/32.89 mpps)

Port Gi0/1.100: GigabitEthernet0/1.100 (15 / #15) VLAN = [Edge Routing]bps(2.52 Mbps/4.59 Mbps)bytes(45.75 MB/83.1 MB)pkts(1.94 kpps/594.38 pps)

Port Gi0/1.101: GigabitEthernet0/1.101 (16 / #16) VLAN = [PACTEL Core SWitch-temp]bps(163.71 kbps/142.64 kbps)bytes(2.97 MB/2.58 MB)pkts(250.16 pps/246.93 pps)

Port Gi0/1.181: GigabitEthernet0/1.181 (17 / #17) VLAN = NETWORK OM - via BM_SB_IGWSW1 Gi0/1bps(2.65 kbps/4.2 kbps)bytes(49.13 kB/77.94 kB)pkts(2.24 pps/2.24 pps)

Port Gi0/0.40: GigabitEthernet0/0.40 (18 / #18) VLAN = [SISCC INTERNET]bps(563.58 kbps/5.6 Mbps)bytes(10.21 MB/101.46 MB)pkts(53.16 pps/2.08 kpps)

Runtime for poller module ‘ports’: 0.4641 seconds with 31280 bytes

SNMP: [26/0.37s] MySQL: [34/0.06s] RRD: [24/0.00s]

Unload poller module ports

Load poller module customoid

Runtime for poller module ‘customoid’: 0.0007 seconds with 2040 bytes

SNMP: [0/0.00s] MySQL: [1/0.00s] RRD: [1/0.00s]

Unload poller module customoid

Load poller module bgp-peers

Checking BGP peer 10.177.56.1 Fetching CISCO-BGP4-MIB data…

Checking BGP peer 103.21.251.3 Fetching CISCO-BGP4-MIB data…

Checking BGP peer 103.142.98.137 Fetching CISCO-BGP4-MIB data…

Runtime for poller module ‘bgp-peers’: 0.1240 seconds with 146992 bytes

SNMP: [10/0.11s] MySQL: [7/0.01s] RRD: [7/0.00s]

Unload poller module bgp-peers

Module [ junose-atm-vp ] disabled globally.

Module [ toner ] disabled globally.

Load poller module ucd-diskio

Runtime for poller module ‘ucd-diskio’: 0.0007 seconds with 1824 bytes

SNMP: [0/0.00s] MySQL: [1/0.00s] RRD: [1/0.00s]

Unload poller module ucd-diskio

Module [ wifi ] disabled globally.

Load poller module wireless

Runtime for poller module ‘wireless’: 0.0015 seconds with 100160 bytes

SNMP: [0/0.00s] MySQL: [1/0.00s] RRD: [1/0.00s]

Unload poller module wireless

Load poller module ospf

Processes: 0

Runtime for poller module ‘ospf’: 0.0138 seconds with 37736 bytes

SNMP: [1/0.01s] MySQL: [0/0.00s] RRD: [1/0.00s]

Unload poller module ospf

Load poller module cisco-ipsec-flow-monitor

Runtime for poller module ‘cisco-ipsec-flow-monitor’: 0.0170 seconds with 3648 bytes

SNMP: [1/0.02s] MySQL: [0/0.00s] RRD: [1/0.00s]

Unload poller module cisco-ipsec-flow-monitor

Load poller module cisco-remote-access-monitor

Runtime for poller module ‘cisco-remote-access-monitor’: 0.0095 seconds with 1672 bytes

SNMP: [1/0.01s] MySQL: [0/0.00s] RRD: [1/0.00s]

Unload poller module cisco-remote-access-monitor

Load poller module cisco-cef

Caching OIDs: entPhysicalDescr entPhysicalName entPhysicalModelName

Runtime for poller module ‘cisco-cef’: 0.0478 seconds with 42320 bytes

SNMP: [3/0.03s] MySQL: [1/0.00s] RRD: [1/0.00s]

Unload poller module cisco-cef

Load poller module cisco-sla

Runtime for poller module ‘cisco-sla’: 0.0008 seconds with 4384 bytes

SNMP: [0/0.00s] MySQL: [1/0.00s] RRD: [1/0.00s]

Unload poller module cisco-sla

Load poller module cisco-mac-accounting

Runtime for poller module ‘cisco-mac-accounting’: 0.0008 seconds with 4936 bytes

SNMP: [0/0.00s] MySQL: [1/0.00s] RRD: [1/0.00s]

Unload poller module cisco-mac-accounting

Load poller module cipsec-tunnels

Runtime for poller module ‘cipsec-tunnels’: 0.0161 seconds with 3312 bytes

SNMP: [1/0.02s] MySQL: [1/0.00s] RRD: [1/0.00s]

Unload poller module cipsec-tunnels

Load poller module cisco-ace-loadbalancer

Runtime for poller module ‘cisco-ace-loadbalancer’: 0.0231 seconds with 3176 bytes

SNMP: [1/0.02s] MySQL: [1/0.00s] RRD: [1/0.00s]

Unload poller module cisco-ace-loadbalancer

Load poller module cisco-ace-serverfarms

Runtime for poller module ‘cisco-ace-serverfarms’: 0.0191 seconds with 3128 bytes

SNMP: [1/0.02s] MySQL: [1/0.00s] RRD: [1/0.00s]

Unload poller module cisco-ace-serverfarms

Module [ cisco-asa-firewall ] disabled globally.

Load poller module cisco-voice

Cisco IOS Voice IP

Runtime for poller module ‘cisco-voice’: 0.1235 seconds with 3168 bytes

SNMP: [5/0.12s] MySQL: [0/0.00s] RRD: [2/0.00s]

Unload poller module cisco-voice

Load poller module cisco-cbqos

Runtime for poller module ‘cisco-cbqos’: 0.0013 seconds with 43264 bytes

SNMP: [0/0.00s] MySQL: [1/0.00s] RRD: [1/0.00s]

Unload poller module cisco-cbqos

Load poller module cisco-otv

Runtime for poller module ‘cisco-otv’: 0.0007 seconds with 6880 bytes

SNMP: [0/0.00s] MySQL: [1/0.00s] RRD: [1/0.00s]

Unload poller module cisco-otv

Module [ cisco-qfp ] disabled globally.

Load poller module cisco-vpdn

Runtime for poller module ‘cisco-vpdn’: 0.0121 seconds with 1632 bytes

SNMP: [1/0.01s] MySQL: [0/0.00s] RRD: [1/0.00s]

Unload poller module cisco-vpdn

Module [ nac ] disabled globally.

Module [ netscaler-vsvr ] disabled globally.

Module [ aruba-controller ] disabled globally.

Load poller module entity-physical

Cisco Cat6xxx/76xx Crossbar :

Runtime for poller module ‘entity-physical’: 0.0260 seconds with 3920 bytes

SNMP: [2/0.02s] MySQL: [1/0.00s] RRD: [1/0.00s]

Unload poller module entity-physical

Module [ entity-state ] disabled globally.

Load poller module applications

ntp include missing!

Runtime for poller module ‘applications’: 0.0005 seconds with 2776 bytes

SNMP: [0/0.00s] MySQL: [1/0.00s] RRD: [1/0.00s]

Unload poller module applications

Module [ mib ] disabled globally.

Load poller module stp

Runtime for poller module ‘stp’: 0.0110 seconds with 5624 bytes

SNMP: [1/0.01s] MySQL: [1/0.00s] RRD: [1/0.00s]

Unload poller module stp

Load poller module ntp

Runtime for poller module ‘ntp’: 0.0271 seconds with 2688 bytes

SNMP: [1/0.02s] MySQL: [2/0.00s] RRD: [2/0.00s]

Unload poller module ntp

Module [ loadbalancers ] disabled globally.

Module [ mef ] disabled globally.

Load poller module mpls

Runtime for poller module ‘mpls’: 0.0006 seconds with 30288 bytes

SNMP: [0/0.00s] MySQL: [0/0.00s] RRD: [1/0.00s]

Unload poller module mpls

Start Device Groups

End Device Groups, runtime: 0.0037s

Enabling graphs: uptime netstat_icmp netstat_icmp_info netstat_ip netstat_ip_frag netstat_ip_forward netstat_snmp netstat_snmp_pkt netstat_tcp netstat_udp ipsystemstats_ipv4 ipsystemstats_ipv4_frag ipsystemstats_ipv6 ipsystemstats_ipv6_frag cisco-voice-ip

Polled in 2.455 seconds

Start Alerts

End Alerts

SNMP [81/1.24s]: Get[29/0.39s] Getnext[4/0.04s] Walk[48/0.82s]

MySQL [74/0.10s]: Cell[1/0.00s] Row[0/-0.00s] Rows[29/0.02s] Column[0/0.00s] Update[42/0.08s] Insert[2/0.00s] Delete[0/0.00s]

RRD [109/0.01s]: Update[109/0.01s]

TheGreatDoc · 3 April 2020 11:10

poller uses ID, dont worry about that.

./validate.php your install, post full output!

murrant · 3 April 2020 13:30

Are you sure the poller is running? It should have created the rrd files if it was.

Reinhard_Lal · 4 April 2020 02:13

Here is the output of validate.php:

./validate.php

Component	Version
LibreNMS	1.62-24-gf0d68a1ad
DB Schema	2020_03_25_165300_add_column_to_ports (161)
PHP	7.2.11
MySQL	10.3.17-MariaDB
RRDTool	1.7.0
SNMP	NET-SNMP 5.8

====================================

[OK] Composer Version: 1.10.1
[OK] Dependencies up-to-date.
[OK] Database connection successful
[OK] Database schema correct

Reinhard_Lal · 4 April 2020 02:33

Hi Murrant,

I think i know what the issue is. I have two versions of Python on Centos 8.

dnf search python | grep -i mysql

python2-Py MySQL .noarch : Pure-Python MySQL client library
python3-Py MySQL .noarch : Pure-Python MySQL client library
python3-aio mysql .noarch : MySQL driver for asyncio

However, running poller :
./poller-wrapper.py

ERROR: missing the mysql python module:

On ubuntu: apt-get install python-mysqldb

On FreeBSD: cd /usr/ports/*/py-MySQLdb && make install clean

So it still complains that it cannot find the python module for mysql. Any work arounds for this ?

murrant · 4 April 2020 02:47

Run pip install -r requirements.txt as the librenms user if you can’t figure out how to get installed via the system package management.

Reinhard_Lal · 4 April 2020 04:55

Hi,

I had already done that, also, i did for both python3 and python2 , just to be sure.

bash-4.4$ pip2 install -r requirements.txt

Requirement already satisfied: PyMySQL in /usr/lib/python2.7/site-packages (from -r requirements.txt (line 1))

Requirement already satisfied: python-dotenv in /usr/lib/python2.7/site-packages (from -r requirements.txt (line 2))

Requirement already satisfied: redis>=3.0 in /usr/lib/python2.7/site-packages (from -r requirements.txt (line 3))

Requirement already satisfied: typing; python_version < “3.5” in /usr/lib/python2.7/site-packages (from python-dotenv->-r requirements.txt (line 2))

bash-4.4$ pip3 install -r requirements.txt

Requirement already satisfied: PyMySQL in /usr/local/lib/python3.6/site-packages (from -r requirements.txt (line 1))

Requirement already satisfied: python-dotenv in /usr/local/lib/python3.6/site-packages (from -r requirements.txt (line 2))

Requirement already satisfied: redis>=3.0 in /usr/local/lib/python3.6/site-packages (from -r requirements.txt (line 3))

bash-4.4$ pip install -r requirements.txt

bash: pip: command not found

and i still get the same error

./poller-wrapper.py

ERROR: missing the mysql python module:

On ubuntu: apt-get install python-mysqldb

On FreeBSD: cd /usr/ports/*/py-MySQLdb && make install clean

With this error showing up in Web UI:

Devices unpolled

It appears as though you have some devices that haven’t completed polling within the last 15 minutes, you may want to check that out

murrant · 4 April 2020 04:59

I dunno, hopefully a python expert can step in and say why they aren’t loaded.

Reinhard_Lal · 4 April 2020 05:02

No worries Murrant, i will try to find a fix else will revert to a new install or maybe downgrade to Centos 7 or another OS variant.

murrant · 4 April 2020 05:09

Check the locations python2 searches for libraries. That might help.

Phobeus · 7 April 2020 17:14

Any luck Reinhard_Lal? I am running into this exact issue on Cent8.1.

Reinhard_Lal · 15 April 2020 01:02

Hi Phobeus,

Had done a fresh install , same issue. So have not touched it from then, got busy with other work. Hopefully when i get time will look at it again.

Phobeus · 15 April 2020 01:27

Hey Reinhard, I ended up installing a fresh instance on a Cent OS 7.7 and manually upgraded all of the tools; rrd, php, and mysql and had no issues.

I followed this guide for the Cent OS 8 setup and don’t know how the writer got the result that he did.

system · 12 October 2021 13:15