topic Re: 40G stacking ports stayed down on two-member ICX7450 stack and after upgrading from 9.0.0. to 9. in ICX Switches

40G stacking ports stayed down on two-member ICX7450 stack and after upgrading from 9.0.0. to 9.0.1c

frnkblk — Tue, 27 Sep 2022 12:45:00 GMT

After upgrading from 9.0.0. to 9.0.1c the 40G stacking ports stayed down on two-member ICX7450 stack and after upgrading. These were 40G modules in the rear of the unit, in slots 3 and 4. We had unit 1 module 3 wired to unit 2 module 4.

Despite the configuration not changing, the 40G port would not come up. Swapped stacking cables, both modules, and rebooted countless times to take incremental steps before rebuilding the stack from scratch -- still no go. So we built the stack with 10G ports ... and then 15 minutes later the 40G ports came up, causing a traffic loop!

Any ideas why the 40G ports would not link up after the upgrade and many, many reboots?

Re: 40G stacking ports stayed down on two-member ICX7450 stack and after upgrading from 9.0.0. to 9.

BenBeck — Tue, 27 Sep 2022 12:47:40 GMT

This sounds like something that needs proper investigation. Please open a support case (see my signature).

Re: 40G stacking ports stayed down on two-member ICX7450 stack and after upgrading from 9.0.0. to 9.

frnkblk — Tue, 27 Sep 2022 12:57:44 GMT

Ok -- didn't know if I was missing something like have to force the 40G ports to be copper or 40G-full or something else.

I am working on the support contract side to get a case open -- I'm told my our consultants that it should have been covered under the project purchase , but when we contacted TAC they said it was not.

Re: 40G stacking ports stayed down on two-member ICX7450 stack and after upgrading from 9.0.0. to 9.

Chandini — Wed, 28 Sep 2022 17:24:08 GMT

Please try checking "Show stack " try checking if the units in stack are coming up correctly , example unit 1 should display as unit 1 in " show stack " output and unit 2 as unit 2 in " show stack " output . If you see any changes with respect to unit being displayed , try defaulting that member and have the stacking cables connected . The switch will automatically join the active member

Re: 40G stacking ports stayed down on two-member ICX7450 stack and after upgrading from 9.0.0. to 9.

frnkblk — Wed, 28 Sep 2022 18:28:44 GMT

Thanks for the suggestion. The stack wasn't re-forming after the software upgrade, or during any subsequent repair attempt, because the 40G ports weren't linking up.

Initially we defaulted just the member (unit 2), but that didn't make a difference, the 40G ports weren't linking up.

And then also defaulting the primary/master didn't make the 40G ports come up.

Only thing that allowed us to restore service to customers was building the stack on a 10G link.

Re: 40G stacking ports stayed down on two-member ICX7450 stack and after upgrading from 9.0.0. to 9.

Chandini — Thu, 29 Sep 2022 15:54:32 GMT

Were you using RUCKUS ICX7400-1X40GQ Module with the switch. Could you help us with the which model of 7400 series that you are using , Firmware version and if you are using 40G module or connecting to one of the port on the switch. Maybe you can refer the below two links , let me know if that helps. Thanks

https://docs.commscope.com/bundle/icx7450-installguide/resource/icx7450-installguide.pdf

https://docs.commscope.com/bundle/fastiron-08092-switchstackingguide/page/GUID-3918D027-A934-4691-8C38-F823A0633768.html

Re: 40G stacking ports stayed down on two-member ICX7450 stack and after upgrading from 9.0.0. to 9.

frnkblk — Thu, 29 Sep 2022 16:12:51 GMT

Yes, that's the 40G module we were using.

The switch is a ICX7450-48 (all copper ports).

Here's the software:

SSH@siouxcenter-ag1#show ver
Copyright (c) Ruckus Networks, Inc. All rights reserved.
UNIT 1: compiled on May 10 2022 at 17:43:41 labeled as SPS09010c
(29360128 bytes) from Primary SPS09010c.bin (UFI)
SW: Version 09.0.10cT211
Compressed Primary Boot Code size = 786944, Version:10.1.23T215 (spz10123)

We were using the 40G module.

Thanks for the links, but they were of no help.

To be clear, this was all working on 9.0.0 before the upgrade, and I have another ICX7450 (SFP ports) that is a three-stack switch, also using 40G to connect them together (two optical links, one copper), and that upgraded fine.

Re: 40G stacking ports stayed down on two-member ICX7450 stack and after upgrading from 9.0.0. to 9.

Chandini — Fri, 30 Sep 2022 17:02:51 GMT

Noted and Thanks for sharing. Could you share outputs of below commands for working and non working

Show media validation

Show modules

Show stack detail

Re: 40G stacking ports stayed down on two-member ICX7450 stack and after upgrading from 9.0.0. to 9.

frnkblk — Fri, 30 Sep 2022 17:07:17 GMT

Sure:

SSH@siouxcenter-ag1#show media validation

Port Supported Vendor Type
----------------------------------------------------------------------
1/2/1 Yes RUCKUS Type : 10GE SR 300m (SFP+)
1/2/2 Yes RUCKUS Type : 10GE SR 300m (SFP+)
1/2/3 Yes OTHERS Type : 10GE Passive Twinax 1m (SFP+)
1/3/1 Yes RUCKUS Type : 40GE-SR4 150m (QSFP+)
1/4/1 Yes RUCKUS Type : 40GE-Active Copper 1m (QSFP+)
2/2/1 Yes RUCKUS Type : 10GE SR 300m (SFP+)
2/2/2 Yes RUCKUS Type : 10GE SR 300m (SFP+)
2/2/3 Yes OTHERS Type : 10GE Passive Twinax 1m (SFP+)
2/3/1 Yes RUCKUS Type : 40GE-Active Copper 1m (QSFP+)
2/4/1 Yes RUCKUS Type : 40GE-SR4 150m (QSFP+)

SSH@siouxcenter-ag1#show module
Module Status Ports Starting MAC
U1:M1 ICX7450-48 48-port Management Module OK 48 c803.f516.7240
U1:M2 ICX7400-4X10GF 4-port 40G Module OK 4 c803.f516.7271
U1:M3 ICX7400-1X40GQ 1-port 40G Module OK 1 c803.f516.7275
U1:M4 ICX7400-1X40GQ 1-port 40G Module OK 1 c803.f516.7279
U2:M1 ICX7450-48 48-port Management Module OK 48 c803.f516.7240
U2:M2 ICX7400-4X10GF 4-port 40G Module OK 4 c803.f516.7431
U2:M3 ICX7400-1X40GQ 1-port 40G Module OK 1 c803.f516.7435
U2:M4 ICX7400-1X40GQ 1-port 40G Module OK 1 c803.f516.7275
SSH@siouxcenter-ag1#
SSH@siouxcenter-ag1#show stack detail
T=3d6h59m32.6: alone: standalone, 😧 dynamic cfg, S: static
ID Type Role Mac Address Pri State Comment
1 S ICX7450-48G active c803.f516.7240 255 local Ready
2 S ICX7450-48G standby c803.f516.7400 0 remote Ready

active standby
+---+ +---+
| 1 |2/3--2/3| 2 |
+---+ +---+
Standby u2 - protocols ready, can failover
Role history: N: standalone, A: active, S: standby, M: member
U1: N->A

Current stack management MAC is c803.f516.7240

Image-Auto-Copy is Enabled.

Stack Port Status Neighbors
Unit# Stack-port1 Stack-port2 Stack-port1 Stack-port2
1 up 1/2/3 none U2 (2/2/3) none
2 up 2/2/3 none U1 (1/2/3) none

Unit# System uptime
1 3 day(s) 6 hour(s) 59 minute(s) 32 second(s)
2 3 day(s) 6 hour(s) 56 minute(s) 6 second(s)
The system started at 05:58:06 Central Tue Sep 27 2022

SSH@siouxcenter-ag1#