Php fpm SIGSEGV with alert-rules and alert-transports

Help
1

Since the last update I have to many php fpm SIGSEGV crashes when visiting the alert-rules or alert-transport page. I cannot figure out what causing it. Anybody some tips?

./validate.php

Component Version
LibreNMS 25.1.0-21-gf2f6cdb4c (2025-01-21T10:27:14+01:00)
DB Schema 2024_10_20_154356_create_qos_table (310)
PHP 8.2.26
Python 3.9.2
Database MariaDB 10.5.19-MariaDB-0+deb11u2
RRDTool 1.7.2
SNMP 5.9
===========================================

[OK] Composer Version: 2.8.4
[OK] Dependencies up-to-date.
[OK] Database connection successful
[OK] Database connection successful
[OK] Database Schema is current
[OK] SQL Server meets minimum requirements
[OK] lower_case_table_names is enabled
[OK] MySQL engine is optimal
[OK] Database and column collations are correct
[OK] Database schema correct
[OK] MySQL and PHP time match
[OK] Distributed Polling setting is enabled globally
[OK] Connected to rrdcached
[OK] Active pollers found
[OK] Dispatcher Service is enabled
[OK] Locks are functional
[OK] Python wrapper cron entry is not present
[OK] Redis is functional
[WARN] IPv6 is disabled on your server, you will not be able to add IPv6 devices.
[OK] rrdtool version ok
[OK] Connected to rrdcached

[21-Jan-2025 13:41:30] WARNING: [pool librenms] child 4184815 exited on signal 11 (SIGSEGV) after 11179.511319 seconds from start
[21-Jan-2025 13:41:30] NOTICE: [pool librenms] child 1094071 started
[21-Jan-2025 13:44:00] WARNING: [pool librenms] child 281340 exited on signal 11 (SIGSEGV) after 1862.858521 seconds from start
[21-Jan-2025 13:44:00] NOTICE: [pool librenms] child 1163313 started
[21-Jan-2025 13:46:33] WARNING: [pool librenms] child 1085186 exited on signal 11 (SIGSEGV) after 325.187078 seconds from start
[21-Jan-2025 13:46:33] NOTICE: [pool librenms] child 1227362 started
[21-Jan-2025 13:46:35] WARNING: [pool librenms] child 1094071 exited on signal 11 (SIGSEGV) after 305.709389 seconds from start
[21-Jan-2025 13:46:35] NOTICE: [pool librenms] child 1228569 started

Thanks in advance.

Gert-Jan

2

You should check your web server logs (and possibly update LibreNMS)

3

Hi.

It is not always the case. Yesterday I had this in the webserver log:

2025/01/21 14:06:27 [error] 577590#577590: *606810 recv() failed (104: Connection reset by peer) while reading response header from upstream, client: 192.168.xxx.xx, server: ftth-mgmt-xxxxxx.xxxx.nl, request: "GET /alert-rules HTTP/2.0", upstream: "fastcgi://unix:/run/php-fpm-librenms.sock:", host: "ftth-mgmt-xxxxxx.xxxx.nl", referrer: "https://ftth-mgmt-xxxxxx.xxxx.nl/alerts"

This is giving me not a lot information where it goes wrong.

Thanks.

4

Did you update LibreNMS?

5

Yes.

===========================================

Component Version
LibreNMS 25.1.0-36-gfdc303617 (2025-01-23T10:04:55+01:00)
DB Schema 2025_01_22_194342_drop_storage_deleted (312)
PHP 8.2.26
Python 3.9.2
Database MariaDB 10.5.19-MariaDB-0+deb11u2
RRDTool 1.7.2
SNMP 5.9
===========================================

I only have it with alert-rules and alert-transports often. Not always.

[23-Jan-2025 15:21:16] NOTICE: fpm is running, pid 2928725
[23-Jan-2025 15:21:16] NOTICE: ready to handle connections
[23-Jan-2025 15:21:16] NOTICE: systemd monitor interval set to 10000ms
[23-Jan-2025 15:22:35] WARNING: [pool librenms] child 2928748 exited on signal 11 (SIGSEGV) after 79.003114 seconds from start
[23-Jan-2025 15:22:35] NOTICE: [pool librenms] child 2953917 started
[23-Jan-2025 15:22:49] WARNING: [pool librenms] child 2928761 exited on signal 11 (SIGSEGV) after 93.729831 seconds from start
[23-Jan-2025 15:22:49] NOTICE: [pool librenms] child 2958108 started
[23-Jan-2025 15:22:52] WARNING: [pool librenms] child 2928751 exited on signal 11 (SIGSEGV) after 96.199544 seconds from start
[23-Jan-2025 15:22:52] NOTICE: [pool librenms] child 2959053 started

php-fpm 8.2:

pm.max_children = 80
pm.start_servers = 24
pm.min_spare_servers = 20
pm.max_spare_servers = 44

kernel: php-fpm8.2[3890632]: segfault at 7f5d943201d8 ip 00007f5d97bdea2d sp 00007ffeda332560 error 6 in opcache.so[7f5d97bd7000+b7000]

image

6

Is disabled opcache in php-fpm and it works seemless. I can upgrade to php8.3-fp, is that advisable?