AIX Discovery not working in 22.10.0-102-g3e6ad9006

dlesel · 10 November 2022 13:17

[[email protected] ~]$ /opt/librenms/discovery.php -h XX.XX.XX.XX -m os -d
LibreNMS Discovery
SQL[select migration from migrations order by id desc limit 1 [] 0.57ms]

SQL[select count(*) as aggregate from migrations [] 0.34ms]

SQL[select version() [] 0.22ms]

===========================================

Component	Version
LibreNMS	22.10.0-102-g3e6ad9006 (2022-11-09T12:07:08-05:00)
DB Schema	2022_08_15_084507_add_rrd_type_to_wireless_sensors_table (248)
PHP	8.1.11
Python	3.6.8
Database	MariaDB 10.6.10-MariaDB
RRDTool	1.7.0
SNMP	5.8

===========================================
DEBUG!
Updating os_def.cache
Override discovery modules: os
SQL[SELECT * FROM devices WHERE disabled = 0 AND hostname LIKE ‘XX.XX.XX.XX’ ORDER BY device_id DESC [] 1.3ms]

SQL[select * from devices where device_id = ? limit 1 [102] 0.34ms]

SQL[select * from devices_attribs where devices_attribs.device_id = ? and devices_attribs.device_id is not null [102] 0.24ms]

10.60.9.14 102 aix [FPING] ‘/usr/sbin/fping’ ‘-e’ ‘-q’ ‘-c’ ‘3’ ‘-p’ ‘500’ ‘-t’ ‘500’ ‘-O’ ‘0’ ‘10.60.9.14’

response: xmt/rcv/%loss = 3/3/0%, min/avg/max = 0.37/0.43/0.52
SNMP[’/usr/bin/snmpget’ ‘-M’ ‘/opt/librenms/mibs:/opt/librenms/mibs/ibm’ ‘-v2c’ ‘-c’ ‘COMMUNITY’ ‘-OQXUte’ ‘udp:HOSTNAME:161’ ‘SNMPv2-MIB::sysObjectID.0’]
SNMPv2-MIB::sysObjectID.0 = SNMPv2-SMI::enterprises.*.1.1.3

Modules status: Global+
OS
Device

Load disco module core

Attempting to initialize OS: aix
Attempting to initialize Group OS: unix
OS initialized: LibreNMS\OS\Shared\Unix
SNMP[’/usr/bin/snmpget’ ‘-M’ ‘/opt/librenms/mibs:/opt/librenms/mibs/ibm’ ‘-v2c’ ‘-c’ ‘COMMUNITY’ ‘-OQXUte’ ‘-On’ ‘udp:HOSTNAME:161’ ‘SNMPv2-MIB::sysObjectID.0’ ‘SNMPv2-MIB::sysDescr.0’ ‘SNMPv2-MIB::sysName.0’]
...0 = ....3
...0 = IBM PowerPC CHRP Computer
Machine Type: 0x0800004c Processor id: 00F903A64C00
Base Operating System Runtime AIX version: 07.02.0004.0000
TCP/IP Client Core Support version: 07.02.0004.0000
..*.0 = balto

| IBM PowerPC CHRP Computer
Machine Type: 0x0800004c Processor id: 00F903A64C00
Base Operating System Runtime AIX version: 07.02.0004.0000
TCP/IP Client Core Support version: 07.02.0004.0000 | .1.3.6.1.4.1.2.3.1.2.1.1.3 |

OS: AIX (aix)

Attempting to initialize OS: aix
Attempting to initialize Group OS: unix
OS initialized: LibreNMS\OS\Shared\Unix

Runtime for discovery module ‘core’: 0.0370 seconds with -277440 bytes
SNMP: [1/0.02s] MySQL: [0/0.00s] RRD: [0/0.00s]

Unload disco module core

Modules status: Global+
OS
Device

Load disco module os

Yaml location data:
SNMP[’/usr/bin/snmpget’ ‘-v2c’ ‘-c’ ‘COMMUNITY’ ‘-Oqv’ ‘-M’ ‘/opt/librenms/mibs:/opt/librenms/mibs/ibm’ ‘udp:HOSTNAME:161’ ‘SNMPv2-MIB::sysLocation.0’]

SNMP[’/usr/bin/snmpget’ ‘-v2c’ ‘-c’ ‘COMMUNITY’ ‘-Ovq’ ‘-m’ ‘SNMPv2-MIB’ ‘-M’ ‘/opt/librenms/mibs:/opt/librenms/mibs/ibm’ ‘udp:HOSTNAME:161’ ‘sysContact.0’]

SNMP[’/usr/bin/snmpget’ ‘-v2c’ ‘-c’ ‘COMMUNITY’ ‘-OUQ’ ‘-M’ ‘/opt/librenms/mibs:/opt/librenms/mibs/ibm’ ‘udp:HOSTNAME:161’ ‘IBM-AIX-MIB::aixSeSerialNumber.0’ ‘IBM-AIX-MIB::aixSeMachineType.0’]
IBM-AIX-MIB::aixSeSerialNumber.0 = “IBM,02210XXXX”
IBM-AIX-MIB::aixSeMachineType.0 = “IBM,8205-E6D”

Yaml OS data: {“IBM-AIX-MIB::aixSeSerialNumber.0”:“IBM,02210XXXX”,“IBM-AIX-MIB::aixSeMachineType.0”:“IBM,8205-E6D”}
Reporting disabled by user setting
SNMP[’/usr/bin/snmpget’ ‘-v2c’ ‘-c’ ‘COMMUNITY’ ‘-OUQ’ ‘-M’ ‘/opt/librenms/mibs:/opt/librenms/mibs/ibm:/opt/librenms/mibs/dell’ ‘udp:HOSTNAME:161’ ‘MIB-Dell-10892::chassisModelName.1’ ‘MIB-Dell-10892::chassisServiceTagName.1’]
MIB-Dell-10892::chassisModelName.1 = NULL
MIB-Dell-10892::chassisServiceTagName.1 = NULL

SNMP[’/usr/bin/snmpget’ ‘-M’ ‘/opt/librenms/mibs:/opt/librenms/mibs/ibm’ ‘-v2c’ ‘-c’ ‘COMMUNITY’ ‘-OQXUte’ ‘udp:HOSTNAME:161’ ‘NET-SNMP-EXTEND-MIB::nsExtendOutput1Line.“distro”’ ‘.1.3.6.1.4.1.2021.7890.1.3.1.1.6.100.105.115.116.114.111’ ‘.1.3.6.1.4.1.2021.7890.1.101.1’]
NET-SNMP-EXTEND-MIB::nsExtendOutput1Line[distro] = NULL
UCD-SNMP-MIB::ucdavis.78*.. = NULL
UCD-SNMP-MIB::ucdavis.78* = NULL

SNMP[’/usr/bin/snmpget’ ‘-M’ ‘/opt/librenms/mibs:/opt/librenms/mibs/ibm’ ‘-v2c’ ‘-c’ ‘COMMUNITY’ ‘-OQXUte’ ‘udp:HOSTNAME:161’ ‘NET-SNMP-EXTEND-MIB::nsExtendOutput1Line.“hardware”’ ‘.1.3.6.1.4.1.2021.7890.2.4.1.2.8.104.97.114.100.119.97.114.101.1’ ‘.1.3.6.1.4.1.2021.7890.2.101.2’]
NET-SNMP-EXTEND-MIB::nsExtendOutput1Line[hardware] = NULL
UCD-SNMP-MIB::ucdavis.78*...114.101.1 = NULL
UCD-SNMP-MIB::ucdavis.78* = NULL

SNMP[’/usr/bin/snmpget’ ‘-M’ ‘/opt/librenms/mibs:/opt/librenms/mibs/ibm’ ‘-v2c’ ‘-c’ ‘COMMUNITY’ ‘-OQXUte’ ‘udp:HOSTNAME:161’ ‘NET-SNMP-EXTEND-MIB::nsExtendOutput1Line.“manufacturer”’ ‘.1.3.6.1.4.1.2021.7890.3.4.1.2.12.109.97.110.117.102.97.99.116.117.114.101.114.1’ ‘.1.3.6.1.4.1.2021.7890.3.4.1.2.6.118.101.110.100.111.114.1’ ‘.1.3.6.1.4.1.2021.7890.3.101.1’]
NET-SNMP-EXTEND-MIB::nsExtendOutput1Line[manufacturer] = NULL
UCD-SNMP-MIB::ucdavis.78*....101.114.1 = NULL
UCD-SNMP-MIB::ucdavis.78...1 = NULL
UCD-SNMP-MIB::ucdavis.78* = NULL

SNMP[’/usr/bin/snmpget’ ‘-M’ ‘/opt/librenms/mibs:/opt/librenms/mibs/ibm’ ‘-v2c’ ‘-c’ ‘COMMUNITY’ ‘-OQXUte’ ‘udp:HOSTNAME:161’ ‘NET-SNMP-EXTEND-MIB::nsExtendOutput1Line.“version”’]
NET-SNMP-EXTEND-MIB::nsExtendOutput1Line[version] = NULL

SNMP[’/usr/bin/snmpget’ ‘-M’ ‘/opt/librenms/mibs:/opt/librenms/mibs/ibm’ ‘-v2c’ ‘-c’ ‘COMMUNITY’ ‘-OQXUte’ ‘udp:HOSTNAME:161’ ‘NET-SNMP-EXTEND-MIB::nsExtendOutput1Line.“serial”’ ‘.1.3.6.1.4.1.2021.7890.4.4.1.2.6.115.101.114.105.97.108.1’ ‘.1.3.6.1.4.1.2021.7890.4.101.1’]
NET-SNMP-EXTEND-MIB::nsExtendOutput1Line[serial] = NULL
UCD-SNMP-MIB::ucdavis.78*...1 = NULL
UCD-SNMP-MIB::ucdavis.78* = NULL

Location:
Hardware: NULL NULL [NULL]
OS Version: 7.2.4.0
OS Features: NULL
Serial: NULL

Runtime for discovery module ‘os’: 0.2290 seconds with 78896 bytes
SNMP: [10/0.22s] MySQL: [0/0.00s] RRD: [0/0.00s]

Unload disco module os

SQL[UPDATE devices set last_discovered=NOW(),last_discovered_timetaken=? WHERE device_id = ? [1.318,102] 1.06ms]

Discovered in 1.318 seconds

/opt/librenms/discovery.php 10.60.9.14 2022-11-10 08:15:35 - 1 devices discovered in 1.562 secs

SNMP [12/0.28s]: Snmpget[12/0.28s]
SQL [8/0.05s]: Select[7/0.04s] Update[1/0.01s]
RRD [0/0.00s]:
[[email protected] ~]$

murrant · 11 November 2022 14:47

Why is your snmp daemon returning NULL for non-existent oids??? that seem horrible.

dlesel · 11 November 2022 16:55

I think it is right behaviour. Please compare following snmpgets. First one is without mibs/dell and second is with mibs/dell.
In second case it finds MIB-Dell-10892… and gets NULL from them.
Why we need Dell mibs with IBM mibs?

[[email protected] ~]# /usr/bin/snmpget -v2c -c XXXXXXXXXX -OUQ -Pw -M /opt/librenms/mibs:/opt/librenms/mibs/ibm udp:XX.XX.XX.XX:161 MIB-Dell-10892::chassisModelName.1 MIB-Dell-10892::chassisServiceTagName.1
Warning: Module LLDP-EXT-DOT3-MIB was in /opt/librenms/mibs/LLDP-EXT-DOT1-MIB now is /opt/librenms/mibs/LLDP-EXT-DOT3-MIB
Warning: Module SML-MIB was in /opt/librenms/mibs/SML-MIB now is /opt/librenms/mibs/ibm/SML-MIB
MODULE-IDENTITY MACRO (lines 55…79 parsed and ignored).
OBJECT-IDENTITY MACRO (lines 81…103 parsed and ignored).
OBJECT-TYPE MACRO (lines 212…298 parsed and ignored).
NOTIFICATION-TYPE MACRO (lines 302…334 parsed and ignored).
TEXTUAL-CONVENTION MACRO (lines 8…48 parsed and ignored).
MIB search path: /opt/librenms/mibs:/opt/librenms/mibs/ibm
Cannot find module (MIB-Dell-10892): At line 0 in (none)
MIB-Dell-10892::chassisModelName.1: Unknown Object Identifier
MIB-Dell-10892::chassisServiceTagName.1: Unknown Object Identifier
[[email protected] ~]#
[[email protected] ~]#
[[email protected] ~]# /usr/bin/snmpget -v2c -c XXXXXXXXXX -OUQ -Pw -M /opt/librenms/mibs:/opt/librenms/mibs/ibm:/opt/librenms/mibs/dell udp:XX.XX.XX.XX:161 MIB-Dell-10892::chassisModelName.1 MIB-Dell-10892::chassisServiceTagName.1
Warning: Module LLDP-EXT-DOT3-MIB was in /opt/librenms/mibs/LLDP-EXT-DOT1-MIB now is /opt/librenms/mibs/LLDP-EXT-DOT3-MIB
Warning: Module SML-MIB was in /opt/librenms/mibs/SML-MIB now is /opt/librenms/mibs/ibm/SML-MIB
MODULE-IDENTITY MACRO (lines 55…79 parsed and ignored).
OBJECT-IDENTITY MACRO (lines 81…103 parsed and ignored).
OBJECT-TYPE MACRO (lines 212…298 parsed and ignored).
NOTIFICATION-TYPE MACRO (lines 302…334 parsed and ignored).
TEXTUAL-CONVENTION MACRO (lines 8…48 parsed and ignored).
OBJECT-TYPE MACRO (lines 25…39 parsed and ignored).
MIB-Dell-10892::chassisModelName.1 = NULL
MIB-Dell-10892::chassisServiceTagName.1 = NULL

murrant · 11 November 2022 20:35

All unix os check the dell mibs. This is discovery so, it is run very infrequently. This is how every other device responds:

$ '/usr/bin/snmpget' '-v2c' '-c' 'community' '-OUQ' '-M' '/home/murrant/projects/librenms/mibs:/home/murrant/projects/librenms/mibs/dell' '-t' '0.1' 'udp:device:161' 'MIB-Dell-10892::chassisModelName.1' 'MIB-Dell-10892::chassisServiceTagName.1'
MIB-Dell-10892::chassisModelName.1 = No Such Object available on this agent at this OID
MIB-Dell-10892::chassisServiceTagName.1 = No Such Object available on this agent at this OID

murrant · 11 November 2022 20:36

It pains me to add an exception just for AIX so that “NULL” is discarded. It could cause issues with other devices where that is valid output.

Might have to exclude it from the unix group too.

dlesel · 11 November 2022 20:50

AIX is different than other UNIX OSs. If it is big job may be better go with php code than yaml? i already tested php code and it worked.

dlesel · 11 November 2022 21:14

i have renamed mib/dell directory and run discovery. i got message “Unknown Object Identifier” and discovery did not work. I am thinking if something missing on my RedHat/CenOS installation? Some YAML or python3 libraries? What is different between yours and mine LibreNMS installation.

murrant · 12 November 2022 21:11

github.com/librenms/librenms

AIX: remove extends and hardware detection support

librenms:master ← murrant:aix-disable-extends

opened 09:09PM - 12 Nov 22 UTC

murrant

+38 -0

Because the aix snmpd returns NULL instead of a non-existent oid error, remove s…upport for extends and additional hardware detection https://community.librenms.org/t/aix-discovery-not-working-in-22-10-0-102-g3e6ad9006/20135/4 #### Please note > Please read this information carefully. You can run `./lnms dev:check` to check your code before submitting. - [x] Have you followed our [code guidelines?](https://docs.librenms.org/Developing/Code-Guidelines/) - [x] If my Pull Request does some changes/fixes/enhancements in the WebUI, I have inserted a screenshot of it. - [x] If my Pull Request makes discovery/polling/yaml changes, I have added/updated [test data](https://docs.librenms.org/Developing/os/Test-Units/). #### Testers If you would like to test this pull request then please run: `./scripts/github-apply <pr_id>`, i.e `./scripts/github-apply 5926` After you are done testing, you can remove the changes with `./scripts/github-remove`. If there are schema changes, you can ask on discord how to revert.

Which actually restores the behavior of the previous code by not allowing snmp extends or additional hardware detection.

dlesel · 14 November 2022 14:07

Thank you Tony!!! It works now!

dlesel · 14 November 2022 14:33

One small thing if it not too hard to correct.
sysDescr is different in AIX 5.3 compared to AIX 6.1, 7.1 and 7.2 .
LibreNMS cannot recognize AIX version for AIX 5.3:

/opt/librenms/discovery.php -h nahXXXXX.XXX.org -m os
LibreNMS Discovery
nahlab02.nah.org 89 aix

Load disco module core

OS: AIX (aix)

Runtime for discovery module ‘core’: 0.0340 seconds with 2449888 bytes
SNMP: [1/0.02s] MySQL: [0/0.00s] RRD: [0/0.00s]

Unload disco module core

Load disco module os

Location:
Hardware: 9111-520
OS Version:
OS Features:
Serial: 0210XXXXX

Runtime for discovery module ‘os’: 0.0950 seconds with 80536 bytes
SNMP: [4/0.09s] MySQL: [0/0.00s] RRD: [0/0.00s]

Unload disco module os

Discovered in 1.187 seconds

SNMP [6/0.14s]: Snmpget[6/0.14s]
SQL [5/0.03s]: Select[4/0.01s] Update[1/0.01s]
RRD [0/0.00s]:

This is sysDescr from AIX 5.3:
IBM PowerPC CHRP Computer Machine Type: n …9111-520*SN-n …10FXXXX Serial Number: not available! Base Operating System Runtime AIX version: 05.03.0009.0000 TCP/IP Client Support version: 05.03.0009.0001

This is sysDescr from from AIX 6.1 and above:
IBM PowerPC CHRP Computer Machine Type: 0x0800004c Processor id: 00F8F24A4C00 Base Operating System Runtime AIX version: 07.02.0002.0015 TCP/IP Client Core Support version: 07.02.0002.0016

system · 12 February 2023 14:34

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.