i am running a 3 server setup: webUI, rrdcached, mariadb on one server and two polling servers. Right now i we only have 10 devices in our monitoring for testing out the install. rrdcached appears to be working as the rrd files are being written to the webUI server from the polling servers, but in the webUI when i bring up a device and click on graphs the site hangs on that page waiting.
and it will sit there until i kill the rrdtool process on my CentOS 7 server. Once i kill the rrdtool process then it brings up the red graph and when looking at the rrdtool command i get this.
[OK] Composer Version: 1.6.5
[OK] Dependencies up-to-date.
[OK] Database connection successful
[OK] Database schema correct
[WARN] IPv6 is disabled on your server, you will not be able to add IPv6 devices.
[WARN] Your local git contains modified files, this could prevent automatic updates.
[FIX]:
You can fix this with ./scripts/github-remove
Modified Files:
discovery-wrapper.py
discovery.php
poller-service.py
poller-wrapper.py
poller.php
[FAIL] Some folders have incorrect file permissions, this may cause issues.
[FIX]:
sudo chown -R librenms:librenms /opt/librenms
sudo setfacl -d -m g::rwx /opt/librenms/rrd /opt/librenms/logs /opt/librenms/bootstrap/cache/ /opt/librenms/storage/
sudo chmod -R ug=rwX /opt/librenms/rrd /opt/librenms/logs /opt/librenms/bootstrap/cache/ /opt/librenms/storage/
Files:
/opt/librenms/bootstrap/cache/packages.php
the modified files are because i removed execute permissions on those files so the box didn’t try polling and discovery earlier.
nope. the fixes didn’t solve the issue, and /opt/librenms/rrd does have the correct permissions.
the more i think about it, the more i am thinking that it is something i did. For the last 8 months this was a single server setup. we decided to move to a distributed polling setup a few weeks ago and i had to update rrdtool from 1.4 to 1.7.1 and the package dependancies were giving me a bunch of issues on the upgrade, and when i finally got rrdtool 1.7.1 installed is when the issues started creeping up.
i am going to blow the main server out and rebuild it with one of our newer CentOS 7.6 images to bring it inline with the 2 polling servers i built because neither of them gave me the issues with package dependancies on the rrdtool install.
