mySQL Error

Encountered a problem after adding too much devices.

After a while, nms is popping out errors that he there are some devices not being polled for 15 minutes.
After the graphs are not display correctly. It is like broken image.

This is displayed on when accessed via browser:

Here is the output of ./validate.php
https://p.libren.ms/view/27699e19

Kindly help. Thank you

looks like it stopped, check to see if its running systemctl status mariadb

The process is not running/failed.

mariadb.service - MariaDB database server
Loaded: loaded (/usr/lib/systemd/system/mariadb.service; enabled; vendor preset: disabled)
Active: failed (Result: exit-code) since Tue 2017-09-19 22:16:51 +08; 12min ago
Process: 1140 ExecStartPost=/usr/libexec/mariadb-wait-ready $MAINPID (code=exited, status=1/FAILURE)
Process: 1138 ExecStart=/usr/bin/mysqld_safe --basedir=/usr (code=exited, status=0/SUCCESS)
Process: 974 ExecStartPre=/usr/libexec/mariadb-prepare-db-dir %n (code=exited, status=0/SUCCESS)
Main PID: 1138 (code=exited, status=0/SUCCESS)

Sep 19 22:16:47 nms systemd[1]: Starting MariaDB database server…
Sep 19 22:16:47 nms mariadb-prepare-db-dir[974]: Database MariaDB is probably initialized in /var/lib/mysql already, nothing is done.
Sep 19 22:16:47 nms mariadb-prepare-db-dir[974]: If this is not the case, make sure the /var/lib/mysql is empty before running mariadb-prepare-db-dir.
Sep 19 22:16:47 nms mysqld_safe[1138]: 170919 22:16:47 mysqld_safe Logging to ‘/var/log/mariadb/mariadb.log’.
Sep 19 22:16:47 nms mysqld_safe[1138]: 170919 22:16:47 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
Sep 19 22:16:51 nms systemd[1]: mariadb.service: control process exited, code=exited status=1
Sep 19 22:16:51 nms systemd[1]: Failed to start MariaDB database server.
Sep 19 22:16:51 nms systemd[1]: Unit mariadb.service entered failed state.
Sep 19 22:16:51 nms systemd[1]: mariadb.service failed.

This isn’t really a LibreNMS issue, for whatever reason MySQL isn’t starting. I’d start by checking the mysql logs to see what’s going on.

I’ve identified the real problem and its on the storage itself.
Already consumed 100% on space.

Increasing the Storage and restarting the services fixes the issue.

Thanks a lot

Well, it’s very fortunate that you have monitoring now. In the future you’ll be alerted and see when storage is starting to fill up :wink:

1 Like