Last week I’ve gotten 2 or 3 alerts that then cleared themselves next poll period immediately, but they’re all wrong they claim I have negative space left, but the drive in question has over 150GB free. I ran chkdsk on the drive - no issues.
How would I troubleshoot this further?
Share your alert rule so we can see what you are doing.
It’s really simple, the not like is a relic from when I didn’t know you can put the mount point ignores in global settings
storage.storage_perc >= 95 AND storage.storage_descr NOT LIKE '/shares%'
edit:
this is the template it uses to send the alert
{{ $alert->title }}
URL: http://192.168.1.101:8161/device/device={{ $alert->hostname }}
@foreach ($alert->faults as $key => $value)
Drive: {{ $value['storage_descr'] }}
Disk %: {{ $value['storage_perc'] }}%
Disk Size: {{ number_format($value['storage_size']/1073741824,2) }} GB
Disk Free: {{ number_format($value['storage_free']/1073741824,2) }} GB
@endforeach
@if ($alert->state == 0)
Time elapsed: {{ $alert->elapsed }}
@endif
Timestamp: {{ $alert->timestamp }}
Can you post the output of ./discovery.php -h HOSTNAME -d -m storage
LibreNMS Discovery
SQL[select `migration` from `migrations` order by `id` desc limit 1 [] 0.73ms]
SQL[select count(*) as aggregate from `migrations` [] 0.73ms]
SQL[select version() [] 0.64ms]
===========================================
Component | Version
--------- | -------
LibreNMS | 25.2.0 (2025-02-23T13:02:21+00:00)
DB Schema | 2025_01_30_000121_add_ifindex_index_to_ports_table (315)
PHP | 8.3.17
Python | 3.12.9
Database | MariaDB 10.5.28-MariaDB-ubu2004
RRDTool | 1.9.0
SNMP | 5.9.4
===========================================
DEBUG!
LibreNMS config cache cleared and config reloaded.
SQL[select `config_name`, `config_value` from `config` [] 0.85ms]
SQL[select * from `graph_types` [] 0.66ms]
Override discovery modules: storage
SQL[SELECT * FROM `devices` WHERE disabled = 0 AND `hostname` LIKE 'turbojeba.lan' ORDER BY device_id DESC [] 0.82ms]
turbojeba.lan 30 windows SQL[select * from `devices` where `device_id` = ? limit 1 [30] 0.86ms]
SQL[select * from `devices_attribs` where `devices_attribs`.`device_id` = ? and `devices_attribs`.`device_id` is not null [30] 0.94ms]
[FPING] '/usr/sbin/fping' '-e' '-q' '-c' '3' '-p' '500' '-t' '500' '-O' '0' 'turbojeba.lan'
response: turbojeba.lan : xmt/rcv/%loss = 3/3/0%, min/avg/max = 0.31/0.472/0.661
SNMP['/usr/bin/snmpget' '-M' '/opt/librenms/mibs:/opt/librenms/mibs/microsoft:/opt/librenms/mibs/dell' '-m' 'SNMPv2-TC:SNMPv2-MIB:IF-MIB:IP-MIB:TCP-MIB:UDP-MIB:NET-SNMP-VACM-MIB' '-v2c' '-c' 'COMMUNITY' '-OQXUte' '-Pu' 'udp:HOSTNAME:161' 'SNMPv2-MIB::sysObjectID.0']
SNMPv2-MIB::sysObjectID.0 = SNMPv2-SMI::enterprises.3*.1.1
Modules status: Global+
OS
Device
#### Load disco module core ####
Attempting to initialize OS: windows
OS initialized: LibreNMS\OS\Windows
SNMP['/usr/bin/snmpget' '-M' '/opt/librenms/mibs:/opt/librenms/mibs/microsoft:/opt/librenms/mibs/dell' '-m' 'SNMPv2-TC:SNMPv2-MIB:IF-MIB:IP-MIB:TCP-MIB:UDP-MIB:NET-SNMP-VACM-MIB' '-v2c' '-c' 'COMMUNITY' '-OQXUte' '-Pu' '-On' 'udp:HOSTNAME:161' 'SNMPv2-MIB::sysObjectID.0' 'SNMPv2-MIB::sysDescr.0' 'SNMPv2-MIB::sysName.0']
.*.*.0 = .*.4.1.3*.1.1
.*.*.0 = Hardware: Intel64 Family 6 Model 183 Stepping 1 AT/AT COMPATIBLE - Software: Windows Version 6.3 (Build 22631 Multiprocessor Free)
.*.*.0 = turbojeba
| Hardware: Intel64 Family 6 Model 183 Stepping 1 AT/AT COMPATIBLE - Software: Windows Version 6.3 (Build 22631 Multiprocessor Free) | .1.3.6.1.4.1.311.1.1.3.1.1 |
OS: Microsoft Windows (windows)
Attempting to initialize OS: windows
OS initialized: LibreNMS\OS\Windows
>> Runtime for discovery module 'core': 0.0370 seconds with 79920 bytes
>> SNMP: [1/0.02s] MySQL: [0/0.00s] RRD: [0/0.00s]
#### Unload disco module core ####
Modules status: Global+
OS
Device
#### Load disco module storage ####
Cache miss for snmpwalk HOST-RESOURCES-MIB::hrStorageTable, grabbing fresh data.
SNMP['/usr/bin/snmpbulkwalk' '-M' '/opt/librenms/mibs:/opt/librenms/mibs/microsoft:/opt/librenms/mibs/dell' '-m' 'SNMPv2-TC:SNMPv2-MIB:IF-MIB:IP-MIB:TCP-MIB:UDP-MIB:NET-SNMP-VACM-MIB:HOST-RESOURCES-TYPES' '-v2c' '-c' 'COMMUNITY' '-OQXUte' '-Pu' '-Os' 'udp:HOSTNAME:161' 'HOST-RESOURCES-MIB::hrStorageTable']
hrStorageIndex[1] = 1
hrStorageIndex[2] = 2
hrStorageIndex[3] = 3
hrStorageIndex[4] = 4
hrStorageIndex[5] = 5
hrStorageIndex[6] = 6
hrStorageIndex[7] = 7
hrStorageType[1] = hrStorageFixedDisk
hrStorageType[2] = hrStorageFixedDisk
hrStorageType[3] = hrStorageFixedDisk
hrStorageType[4] = hrStorageFixedDisk
hrStorageType[5] = hrStorageFixedDisk
hrStorageType[6] = hrStorageVirtualMemory
hrStorageType[7] = hrStorageRam
hrStorageDescr[1] = C:\ Label:system Serial Number 80123760
hrStorageDescr[2] = M:\ Label:games Serial Number 5fcfd720
hrStorageDescr[3] = O:\ Label:system2 Serial Number d13240d0
hrStorageDescr[4] = T:\ Label:games2 Serial Number 7c912acb
hrStorageDescr[5] = W:\ Label:data Serial Number 42a421af
hrStorageDescr[6] = Virtual Memory
hrStorageDescr[7] = Physical Memory
hrStorageAllocationUnits[1] = 4096
hrStorageAllocationUnits[2] = 4096
hrStorageAllocationUnits[3] = 4096
hrStorageAllocationUnits[4] = 4096
hrStorageAllocationUnits[5] = 4096
hrStorageAllocationUnits[6] = 65536
hrStorageAllocationUnits[7] = 65536
hrStorageSize[1] = 71611647
hrStorageSize[2] = 244190207
hrStorageSize[3] = 172240127
hrStorageSize[4] = 244186111
hrStorageSize[5] = 244186111
hrStorageSize[6] = 1308018
hrStorageSize[7] = 1045874
hrStorageUsed[1] = 37971752
hrStorageUsed[2] = 182386858
hrStorageUsed[3] = 131534408
hrStorageUsed[4] = 126905606
hrStorageUsed[5] = 195875174
hrStorageUsed[6] = 151657
hrStorageUsed[7] = 145795
hrStorageAllocationFailures[1] = 0
hrStorageAllocationFailures[2] = 0
hrStorageAllocationFailures[3] = 0
hrStorageAllocationFailures[4] = 0
hrStorageAllocationFailures[5] = 0
hrStorageAllocationFailures[6] = 0
hrStorageAllocationFailures[7] = 0
SQL[select * from `storage` where `storage`.`device_id` = ? and `storage`.`device_id` is not null [30] 0.85ms]
SQL[update `storage` set `storage_used` = ?, `storage_free` = ? where `storage_id` = ? [155532296192,137789009920,4471] 13.01ms]
Updated data:
array (
'storage_used' => 155532296192.0,
'storage_free' => 137789009920.0,
)
....
C:\ Label:system Serial Number 80123760 (FixedDisk): 53% 144.85 GiB / 273.18 GiB
M:\ Label:games Serial Number 5fcfd720 (FixedDisk): 75% 695.75 GiB / 931.51 GiB
O:\ Label:system2 Serial Number d13240d0 (FixedDisk): 76% 501.76 GiB / 657.04 GiB
T:\ Label:games2 Serial Number 7c912acb (FixedDisk): 52% 484.11 GiB / 931.5 GiB
W:\ Label:data Serial Number 42a421af (FixedDisk): 80% 747.2 GiB / 931.5 GiB
>> Runtime for discovery module 'storage': 0.0570 seconds with 103288 bytes
>> SNMP: [1/0.04s] MySQL: [2/0.14s] RRD: [0/0.00s]
#### Unload disco module storage ####
SQL[update `devices` set `last_discovered_timetaken` = ?, `last_discovered` = NOW() where `device_id` = ? [1.148,30] 1.81ms]
Discovered in 1.148 seconds
./discovery.php turbojeba.lan 2025-02-27 11:07:39 - 1 devices discovered in 1.366 secs
SNMP [3/0.09s]: Snmpget[2/0.05s] Snmpwalk[1/0.04s]
SQL [12/0.28s]: Select[10/0.13s] Update[2/0.15s]
RRD [0/0.00s]:
SnmpQuery Cache Performance
HOST-RESOURCES-MIB::hrStorageTable cache hits: 0 Waste of memory!
It just happened again, during a windows update running. Could that be related? That partition O: is an 2ndary partition on system drive so possibly the update does something with partitions?