Polling is happening, but no new RRD traffic data appearing anymore

Tags: #<Tag:0x00007f5224829df8>

On a fairly new install of 1.65.1 using docker compose method on Ubuntu 18.04, Things were working fine for about 8 hours. I was polling about 20 HP switches and traffic data was appearing beautifully.

Then the next day, everything still appears to be working fine except no new data appears in the graphs. I can see the 8 hours worth of data appearing in historical graphs, but nothing new appears.

Polling appears to happen successfully, and I can see new SNMP event data from the switches and I can even successfully display real-time data when looking at a particular port. So I know it is able to communicate successfully with the switches.

Validate Config shows all is good.Can anyone suggest some avenues for troubleshooting this? It is weird that everything looks fine and no notable errors are appearing in syslog (are there other log locations to look at?).

You can run a single ./poller.php -d -h device_id from the poller container and check output.

Also check librenms.log

The log looks OK. There were some earlyDB issues when I was first installing, but everything for 7 days since show no errors.

That suggestion to run a poller instance was helpful.

I can see the whole sequence of actions downloading SNMP data and posting it to the dB. It all seems to be working fine, and ends with:

./poller.php 3 2020-07-29 21:11:02 - 1 devices polled in 8.780 secs
SNMP [40/6.84s]: Get[15/0.36s] Getnext[4/0.09s] Walk[21/6.39s]
MySQL [77/0.19s]: Cell[22/0.03s] Row[-21/-0.03s] Rows[16/0.03s] Column[1/0.00s] Update[57/0.15s] Insert[2/0.01s] Delete[0/0.00s]
RRD [100/0.05s]: Other[50/0.04s] Update[50/0.02s]

So data is clearly going in. Any thoughts about why it might not be graphing?

Here is a screenshot from that same device that I polled. You can see in the monthly graph the short window of time when data was graphing:

The other day someone had the same issue https://discordapp.com/channels/327529583601647617/327529583601647617/738109451403526225

Read from there as I think it was solved

Can you give a different reference to that thread?

When I click on it, it leads me to the discordapp.com website where it wants me to create a new Discord account, but even if I do It doesn’t link to any existing content.

Thanks

If you already registered to discord, join the LibreNMS server and click again on that link

OK, I see that thread.

If I read it correctly, it sounds like I need to ensure that nginx and php-fm threads all run as librenms user. That already seems to be the case:

> bash-5.0# ps -Af
> UID        PID  PPID  C STIME TTY          TIME CMD
> root         1     0  0 Jul28 ?        00:00:00 s6-svscan -t0 /var/run/s6/services
> root        32     1  0 Jul28 ?        00:00:00 s6-supervise s6-fdholderd
> root       353     1  0 Jul28 ?        00:00:00 s6-supervise snmpd
> root       355     1  0 Jul28 ?        00:00:00 s6-supervise nginx
> root       356     1  0 Jul28 ?        00:00:00 s6-supervise php-fpm
> librenms   357   356  0 Jul28 ?        00:00:09 php-fpm: master process (/etc/php7/php-fpm.conf)
> librenms   359   355  0 Jul28 ?        00:00:00 nginx: master process nginx -g daemon off;
> root       360   353  0 Jul28 ?        00:00:45 /usr/sbin/snmpd -f -c /etc/snmp/snmpd.conf
> librenms   365   359  0 Jul28 ?        00:00:00 nginx: worker process
> librenms   366   359  0 Jul28 ?        00:00:00 nginx: worker process
> librenms   368   359  0 Jul28 ?        00:00:02 nginx: worker process
> root      1768     0  0 Jul29 pts/0    00:00:00 /bin/bash
> librenms  1884   357  0 Jul29 ?        00:00:20 php-fpm: pool www
> librenms  1911   357  0 Jul29 ?        00:00:18 php-fpm: pool www
> librenms  4892   357  0 08:31 ?        00:00:03 php-fpm: pool www
> librenms  4953   357  0 08:31 ?        00:00:01 php-fpm: pool www
> librenms  4999   357  0 15:28 ?        00:00:00 php-fpm: pool www
> librenms  5038   357  0 15:28 ?        00:00:00 php-fpm: pool www
> root      5068  1768  0 15:41 pts/0    00:00:00 ps -Af

Is there something else I need to check?

Thanks

I decided to bail on this docker installation and reinstall from scratch on a new Ubuntu VM. That seems to be working so far.

Thanks for the effort!