AVAYA/Extreme VSP-7024 XLS broken

zoeloe · 24 April 2018 13:28

After the Avaya/Extreme BOSS/VOSS rewrite (after Saturday Apr 21st) , the display of VSP-7024 XLS devices is broken.
The overview aggregated graph is empty and no ports are listed below overview graph.
The “Graphs” page seems correct. (SNMP, TCP,… etc. stats)
The “Ports” page (and associated) graphs are completely empy.

Sensor readings seem to be working also.

Only VSP-7027XLS devices are affected. All 7024 affected have different software versions detected correctly by librenms.

validate.ph output:

Component	Version
LibreNMS	1.38-73-gd69e965
DB Schema	247
PHP	7.0.28-0ubuntu0.16.04.1
MySQL	5.7.22-0ubuntu0.16.04.1
RRDTool	1.5.5
SNMP	NET-SNMP 5.7.3

====================================

[OK] Composer Version: 1.6.4
[OK] Dependencies up-to-date.
[OK] Database connection successful
[OK] Database schema correct

Thanks for any insight.

murrant · 24 April 2018 13:42

It was a rename, not a rewrite.

Can you please give us more info. We don’t have access to these devices.

This info would be helpful and screenshots with annotation.
https://docs.librenms.org/Support/FAQ/#what-information-do-you-need-to-add-a-new-os

zoeloe · 24 April 2018 14:09

A rename agreed. I should have written that, agreed.
It’s not a “new” OS as these devices worked (Graphs, Port graphs) perfectly before the update of Saturday Apr 21st.
Here’s the requested info:

./discovery.php -h r1101sw5 -d | ./pbin.sh
Paste endpoint: …
ifStackStatus: Unknown Object Identifier (Sub-id not found: (top) -> ifStackStatus)
MIB search path: /opt/librenms/mibs:/opt/librenms/mibs/nortel
Cannot find module (RC-VRF-MIB): At line 13 in /opt/librenms/mibs/nortel/RC-VLAN-MIB
Did not find ‘LPortSet’ in module RAPID-CITY (/opt/librenms/mibs/nortel/RC-VLAN-MIB)
MIB search path: /opt/librenms/mibs:/opt/librenms/mibs/nortel
Cannot find module (RC-VRF-MIB): At line 13 in /opt/librenms/mibs/nortel/RC-VLAN-MIB
Did not find ‘LPortSet’ in module RAPID-CITY (/opt/librenms/mibs/nortel/RC-VLAN-MIB)
MIB search path: /opt/librenms/mibs:/opt/librenms/mibs/nortel
Cannot find module (RC-VRF-MIB): At line 13 in /opt/librenms/mibs/nortel/RC-VLAN-MIB
Did not find ‘LPortSet’ in module RAPID-CITY (/opt/librenms/mibs/nortel/RC-VLAN-MIB)
MIB search path: /opt/librenms/mibs:/opt/librenms/mibs/nortel
Cannot find module (RC-VRF-MIB): At line 13 in /opt/librenms/mibs/nortel/RC-VLAN-MIB
Did not find ‘LPortSet’ in module RAPID-CITY (/opt/librenms/mibs/nortel/RC-VLAN-MIB)
title:
name: librenms
private: 1
expire: 0
https://p.libren.ms/view/b6d49837
./poller.php -h r1101sw5 -r -f -d | ./pbin.sh
Paste endpoint: …
title:
name: librenms
private: 1
expire: 0
https://p.libren.ms/view/b9d65ab6
the snmpbulkwalk throws an error:after many SNMP values

No more variables left in this MIB View (It is past the end of the MIB tree)\n’, ‘text’, ‘0’, ‘librenms’, ‘Untitled’, ‘1’, ‘40863ffc’, 0, 0, ‘134.184.x.y’)

Filename: models/Pastes.php

Line Number: 140

A PHP Error was encountered

Severity: Warning

Message: Error while sending QUERY packet. PID=31306

Filename: mysqli/mysqli_driver.php

Line Number: 306

<p>Backtrace:</p>

A PHP Error was encountered

Severity: Warning

Message: Cannot modify header information - headers already sent by (output started at /opt/Stikked/htdocs/system/database/DB_driver.php:1781)

Filename: core/Common.php

Line Number: 573

<p>Backtrace:</p>

Database Error

::selection { background-color: #E13300; color: white; }
::-moz-selection { background-color: #E13300; color: white; }

body {
background-color: #fff;
margin: 40px;
font: 13px/20px normal Helvetica, Arial, sans-serif;
color: #4F5155;
}

a {
color: #003399;
background-color: transparent;
font-weight: normal;
}

h1 {
color: #444;
background-color: transparent;
border-bottom: 1px solid #D0D0D0;
font-size: 19px;
font-weight: normal;
margin: 0 0 14px 0;
padding: 14px 15px 10px 15px;
}

code {
font-family: Consolas, Monaco, Courier New, Courier, monospace;
font-size: 12px;
background-color: #f9f9f9;
border: 1px solid #D0D0D0;
color: #002166;
display: block;
margin: 14px 0 14px 0;
padding: 12px 10px 12px 10px;
}

#container {
margin: 10px;
border: 1px solid #D0D0D0;
box-shadow: 0 0 8px #D0D0D0;
}

p {
margin: 12px 15px 12px 15px;
}

A Database Error Occurred

Error Number: 2006

MySQL server has gone away

INSERT INTO `sessions` (`id`, `ip_address`, `timestamp`, `data`) VALUES ('5pqlgsjo0javs1god4eptaiaij', '134.184.x.y', 1524578191, '__ci_last_regenerate|i:1524578180;')

Filename: libraries/Session/drivers/Session_database_driver.php

Line Number: 236

A PHP Error was encountered

Severity: Warning

Message: Unknown: Cannot call session save handler in a recursive manner

Filename: Unknown

Line Number: 0

<p>Backtrace:</p>

A PHP Error was encountered

Severity: Warning

Message: Unknown: Failed to write session data using user defined save handler. (session.save_path: /var/opt/remi/php71/lib/php/session)

Filename: Unknown

Line Number: 0

<p>Backtrace:</p>

A PHP Error was encountered

Severity: Warning

Message: Cannot modify header information - headers already sent by (output started at /opt/Stikked/htdocs/system/database/DB_driver.php:1781)

Filename: core/Common.php

Line Number: 573

<p>Backtrace:</p>

Database Error

::selection { background-color: #E13300; color: white; }
::-moz-selection { background-color: #E13300; color: white; }

body {
background-color: #fff;
margin: 40px;
font: 13px/20px normal Helvetica, Arial, sans-serif;
color: #4F5155;
}

a {
color: #003399;
background-color: transparent;
font-weight: normal;
}

h1 {
color: #444;
background-color: transparent;
border-bottom: 1px solid #D0D0D0;
font-size: 19px;
font-weight: normal;
margin: 0 0 14px 0;
padding: 14px 15px 10px 15px;
}

code {
font-family: Consolas, Monaco, Courier New, Courier, monospace;
font-size: 12px;
background-color: #f9f9f9;
border: 1px solid #D0D0D0;
color: #002166;
display: block;
margin: 14px 0 14px 0;
padding: 12px 10px 12px 10px;
}

#container {
margin: 10px;
border: 1px solid #D0D0D0;
box-shadow: 0 0 8px #D0D0D0;
}

p {
margin: 12px 15px 12px 15px;
}

A Database Error Occurred

Error Number: 2006

MySQL server has gone away

SELECT RELEASE_LOCK('5pqlgsjo0javs1god4eptaiaij') AS ci_session_lock

Filename: libraries/Session/drivers/Session_database_driver.php

Line Number: 399

Tried a mysqlcheck, but:
librenms.wireless_sensors
note : The storage engine for the table doesn’t support repair

Is my storage engine wrong for librenms ?

TIA

murrant · 24 April 2018 14:15

Looks like you are having issues with your MySQL server… You need to fix them.

zoeloe · 24 April 2018 14:51

The mysqlcheck error points to the database using InnoDB tables.
Fix Mysql OK,… but how and what ?,… should the storage engine be MyISAM for librenms ?
The validate script says the database is OK.
Are there more stringent tools in librenms to verify/repair the database ?

TIA

zoeloe · 24 April 2018 16:55

Nope, it isn’t the snmpbulkwalk that throws an error. ./pbin.sh throws the error,… probably pastebin barfs…
Tested it with first capturing the snmpbulkwalk to a file and then piping the file through ./pbin.sh… result same error. SQL error is misleading…

zoeloe · 24 April 2018 20:15

The following screenshots show that sensors etc are working in overview, but no ports listed and no overview graph nor port list in overview. The Port tab is empty also. IP statistics are OK.

3 images in total, new user prevents 3 images in one post.

zoeloe · 24 April 2018 20:16

next image:

zoeloe · 24 April 2018 20:17

next image:

murrant · 26 April 2018 19:17

Perhaps you shouldn’t have posted that it was very misleading and hard to read.

Your discovery shows this for all ports:

ignored by ifDescr: Avaya Virtual Services Platform 7024XLS Module - Port 1  13, 21:19:15 (matched: irtual)

https://docs.librenms.org/Developing/os/Settings/#ignoring-interfaces

zoeloe · 26 April 2018 19:57

Indeed, the paste barf was misleading.
Now I feel silly, I should have looked at this discovery run output with the debug options carefully.
And indeed, removing “irtual” from the defaults brings back the graphs and interfaces, etc,…

Thanks a million indeed ! Greatly appreciated for solving this !
Thanks again. Regards

ospfbgp · 1 May 2018 11:25

The weird thing about the 7024 is that it is not really a VSP and that is misleading. Avaya called it that. All the mibs are ERS/BOSS code and so I moved it during rebranding from avaya to extreme.

This is the fix. Add this to your config.php.

// Ignore certain ifDescr
unset($config[‘bad_if’]);
$config[‘bad_if’][] = ‘voip-null’;
$config[‘bad_if’][] = ‘virtual-’;
$config[‘bad_if’][] = ‘unrouted’;
$config[‘bad_if’][] = ‘eobc’;
$config[‘bad_if’][] = ‘lp0’;
$config[‘bad_if’][] = ‘-atm’;
$config[‘bad_if’][] = ‘faith0’;
$config[‘bad_if’][] = ‘container’;
$config[‘bad_if’][] = ‘async’;
$config[‘bad_if’][] = ‘plip’;
$config[‘bad_if’][] = ‘-physical’;
$config[‘bad_if’][] = ‘container’;
$config[‘bad_if’][] = ‘unrouted’;
$config[‘bad_if’][] = ‘bluetooth’;
$config[‘bad_if’][] = ‘isatap’;
$config[‘bad_if’][] = ‘ras’;
$config[‘bad_if’][] = ‘qos’;
$config[‘bad_if’][] = ‘span rp’;
$config[‘bad_if’][] = ‘span sp’;
$config[‘bad_if’][] = ‘sslvpn’;
$config[‘bad_if’][] = ‘pppoe-’;
#$config[‘bad_if’][] = ‘irtual’;

zoeloe · 1 May 2018 17:55

Thanks for the explanation. I had already tweaked defaults.inc.php, but config.php is indeed the place to override the defaults. Thanks.

zoeloe · 1 May 2018 18:09

Tried to add to config.php, but some dashboard widgets like Top-devices and Top-interface are now empty… reverting to modding defaults.inc.php