Is ICX6450 having any stack related problems

manish_singh_7n — Tue, 17 Jul 2018 12:12:09 GMT

Hi All,

I'm using ICX6450-48 port 2-stacked switch in a my local environment, all stack ports are 10G.
I have configured stack ports on both switch units in trunk mode (Trunk1: [1/2/1, 1/2/2],
Trunk2: [1/2/3, 1/2/4]).

I have observed few link flipping issues on ports 1/2/2 and 1/2/4. In show statistics command, i see some InErrors as well as CRC. I exchanged stack cables even replaced units, but problem still persists.

I searched the release note "FastIron_08030s_ReleaseNotes_v2.1.pdf" for any issues related to stacking. i found below similar issue for model ICX7450.

Is it applicable for ICX6450 too ?

DEFECT000629828 --- 
	Symptom -- In an ICX7450 Switch/Router stacking configuration with the stack port is connected using passive
			cable, sometimes the link statistics for 40G port shows InErrors or CRC errors received.
			
	Condition -- The errors are only seen when the stacking port is connected using passive cable.
        Reported In Release:   FI 08.0.30
        Fixed In Release: FI 08.0.30n

Below are output of some switch commands,

****************************************************************************
1> show stack

T=188d14h20m19.5: alone: standalone, 😧 dynamic cfg, S: static
ID   Type          Role    Mac Address    Pri State   Comment
1 S ICX6450-48    active cc4e.24db.9400 128 local   Ready
2 S ICX6450-48    standby cc4e.24db.9200   0 remote Ready

    active       standby
     +---+        +---+
=2/3| 1 |2/1==2/3| 2 |2/1=
|   +---+        +---+   |
|                        |
|------------------------|
Standby u2 - protocols ready, can failover
Current stack management MAC is xxxx.xxxx.xxxx

****************************************************************************
2> show media

-- snip --
Port 1/1/1: Type : 1G M-C (Gig-Copper)
.
Port 1/2/1: Type : 10GE Active Twinax   1m (SFP +)
Port 1/2/2: Type : 10GE Active Twinax   1m (SFP +)
Port 1/2/3: Type : 10GE Active Twinax   1m (SFP +)
Port 1/2/4: Type : 10GE Active Twinax   1m (SFP +)
.
Port 2/2/1: Type : 10GE Active Twinax   1m (SFP +)
Port 2/2/2: Type : 10GE Active Twinax   1m (SFP +)
Port 2/2/3: Type : 10GE Active Twinax   1m (SFP +)
Port 2/2/4: Type : 10GE Active Twinax   1m (SFP +)
.
-- snip --

****************************************************************************
3> show statistics

Port             In Packets       Out Packets       In Errors      Out Errors
-- snip --
.
1/2/1           38939804407       38974460322            3998               0
1/2/2           40081232299       39038419529           45635               0
1/2/3           38932347483       38972475777          164239               0
1/2/4           38886919228       40060803557          137287               0
.
2/2/1           38972425084       38932490713            7956               0
2/2/2           40060758864       38887041223            3837               0
2/2/3           38974380267       38939731596            2861               0
2/2/4           38999040397       40081192297        38583818               0
-- snip --

****************************************************************************
4> show version

Copyright (c) 1996-2015 Brocade Communications Systems, Inc. All rights reserved.
    UNIT 1: compiled on Mar 30 2015 at 18:25:06 labeled as ICX64R08030
                (9693416 bytes) from Primary ICX64R08030.bin
        SW: Version 08.0.30T313
    UNIT 2: compiled on Mar 30 2015 at 18:25:06 labeled as ICX64R08030
                (9693416 bytes) from Primary ICX64R08030.bin
        SW: Version 08.0.30T313
Boot-Monitor Image size = 786944, Version:10.1.05T310 (kxz10105)
HW: Stackable ICX6450-48
==========================================================================
UNIT 1: SL 1: ICX6450-48 48-port Management Module
         Serial #: BZU3222L063
         License: ICX6450_BASE_ROUTER_SOFT_PACKAGE   (LID: dbwIHHHnFLI)
         P-ENGINE 0: type DEF0, rev 01
         P-ENGINE 1: type DEF0, rev 01
==========================================================================
UNIT 1: SL 2: ICX6450-SFP-Plus 4port 40G Module
==========================================================================
UNIT 2: SL 1: ICX6450-48 48-port Management Module
         Serial #: BZU3220L094
         License: ICX6450_BASE_ROUTER_SOFT_PACKAGE   (LID: dbwIHHFnFOJ)
         P-ENGINE 0: type DEF0, rev 01
         P-ENGINE 1: type DEF0, rev 01
==========================================================================
UNIT 2: SL 2: ICX6450-SFP-Plus 4port 40G Module
==========================================================================
800 MHz ARM processor ARMv5TE, 400 MHz bus
65536 KB flash memory
512 MB DRAM
STACKID 1 system uptime is 188 day(s) 14 hour(s) 20 minute(s) 18 second(s)
STACKID 2 system uptime is 188 day(s) 15 hour(s) 1 minute(s) 13 second(s)
The system started at 12:35:57 GMT+00 Wed Nov 29 2017

The system : started=warm start         reloaded=by "reload"
My stack unit ID = 1, bootup role = active

****************************************************************************
5> show run

Current configuration:
!
ver 08.0.30T313
!
stack unit 1
module 1 icx6450-48-port-management-module
module 2 icx6450-sfp-plus-4port-40g-module
priority 128
stack-trunk 1/2/1 to 1/2/2
stack-trunk 1/2/3 to 1/2/4
stack-port 1/2/1 1/2/3
stack unit 2
module 1 icx6450-48-port-management-module
module 2 icx6450-sfp-plus-4port-40g-module
stack-trunk 2/2/1 to 2/2/2
stack-trunk 2/2/3 to 2/2/4
stack-port 2/2/1 2/2/3
stack enable
stack mac xxxx.xxxx.xxxx
!
!
!
lag L30101 dynamic id 101
ports ethernet 1/1/3 ethernet 1/1/5 ethernet 1/1/27 ethernet 1/1/29 ethernet 2/1/3 ethernet 2/1/5 ethernet 2/1/27 ethernet 2/1/29
primary-port 1/1/3
deploy
!
lag L30201 dynamic id 102
ports ethernet 1/1/4 ethernet 1/1/6 ethernet 1/1/28 ethernet 1/1/30 ethernet 2/1/4 ethernet 2/1/6 ethernet 2/1/28 ethernet 2/1/30
primary-port 1/1/4
deploy
!
lag NODE01 static id 1
ports ethernet 1/1/20 ethernet 1/1/44 ethernet 2/1/20 ethernet 2/1/44
primary-port 1/1/20
deploy
!
lag NODE02 static id 2
ports ethernet 1/1/21 ethernet 1/1/45 ethernet 2/1/21 ethernet 2/1/45
primary-port 1/1/21
deploy
!
lag NODE03 static id 3
ports ethernet 1/1/22 ethernet 1/1/46 ethernet 2/1/22 ethernet 2/1/46
primary-port 1/1/22
deploy
!
lag NODE04 static id 4
ports ethernet 1/1/23 ethernet 1/1/47 ethernet 2/1/23 ethernet 2/1/47
primary-port 1/1/23
deploy
!
lag NODE05 static id 5
ports ethernet 1/1/24 ethernet 1/1/48 ethernet 2/1/24 ethernet 2/1/48
primary-port 1/1/24
deploy
!
lag NODE06 static id 6
ports ethernet 1/1/19 ethernet 1/1/43 ethernet 2/1/19 ethernet 2/1/43
primary-port 1/1/19
deploy
!
lag NODE07 static id 7
ports ethernet 1/1/18 ethernet 1/1/42 ethernet 2/1/18 ethernet 2/1/42
primary-port 1/1/18
deploy
!
lag NODE08 static id 8
ports ethernet 1/1/17 ethernet 1/1/41 ethernet 2/1/17 ethernet 2/1/41
primary-port 1/1/17
deploy
!
lag NODE09 static id 9
ports ethernet 1/1/16 ethernet 1/1/40 ethernet 2/1/16 ethernet 2/1/40
primary-port 1/1/16
deploy
!
lag NODE10 static id 10
ports ethernet 1/1/15 ethernet 1/1/39 ethernet 2/1/15 ethernet 2/1/39
primary-port 1/1/15
deploy
!
lag NODE11 static id 11
ports ethernet 1/1/14 ethernet 1/1/38 ethernet 2/1/14 ethernet 2/1/38
primary-port 1/1/14
deploy
!
lag NODE12 static id 12
ports ethernet 1/1/13 ethernet 1/1/37 ethernet 2/1/13 ethernet 2/1/37
primary-port 1/1/13
deploy
!
lag NODE13 static id 13
ports ethernet 1/1/12 ethernet 1/1/36 ethernet 2/1/12 ethernet 2/1/36
primary-port 1/1/12
deploy
!
lag NODE14 static id 14
ports ethernet 1/1/11 ethernet 1/1/35 ethernet 2/1/11 ethernet 2/1/35
primary-port 1/1/11
deploy
!
lag NODE15 static id 15
ports ethernet 1/1/10 ethernet 1/1/34 ethernet 2/1/10 ethernet 2/1/34
primary-port 1/1/10
deploy
!
!
vlan 1 name DEFAULT-VLAN by port
!
vlan 11 by port
tagged ethe 1/1/1 to 1/1/48 ethe 2/1/1 to 2/1/48
router-interface ve 11
!
vlan 4093 by port
tagged ethe 1/1/1 to 1/1/48 ethe 2/1/1 to 2/1/48
router-interface ve 4093
!
!
!
mstp scope all
mstp name abc
mstp revision 1
mstp instance 0 vlan 1
mstp instance 1 vlan 4093
mstp instance 2 vlan 11
mstp instance 3 vlan 12
mstp instance 4 vlan 13
mstp admin-pt2pt-mac ethe 1/1/3 to 1/1/4
mstp admin-edge-port ethe 1/1/1 to 1/1/2 ethe 1/1/7 to 1/1/26 ethe 1/1/31 to 1/1/33 ethe 2/1/1 to 2/1/2 ethe 2/1/7 to 2/1/9 ethe 2/1/25 to 2/1/26 ethe 2/1/31 to 2/1/33
mstp start
!
!
jumbo
enable telnet password .....
enable super-user-password .....
hostname L20101
ip dhcp-client disable
ip route 0.0.0.0/0 169.254.1.211
!
logging host 169.254.129.1
logging facility local4
snmp-server community ..... ro
snmp-server host 169.254.129.1 version v2c .....
!
!
!
!
ntp
disable serve
server 169.254.129.1
!
!
hitless-failover enable
!
!
!
interface ethernet 1/1/1
dual-mode 11
!
interface ethernet 1/1/2
dual-mode 11
!
interface ethernet 1/1/3
dual-mode 11
!
interface ethernet 1/1/4
dual-mode 11
!
interface ethernet 1/1/7
dual-mode 11
!
interface ethernet 1/1/8
dual-mode 11
!
interface ethernet 1/1/9
dual-mode 11
!
interface ethernet 1/1/10
dual-mode 11
!
interface ethernet 1/1/11
dual-mode 11
!
interface ethernet 1/1/12
dual-mode 11
!
interface ethernet 1/1/13
dual-mode 11
!
interface ethernet 1/1/14
dual-mode 11
!
interface ethernet 1/1/15
dual-mode 11
!
interface ethernet 1/1/16
dual-mode 11
!
interface ethernet 1/1/17
dual-mode 11
!
interface ethernet 1/1/18
dual-mode 11
!
interface ethernet 1/1/19
dual-mode 11
!
interface ethernet 1/1/20
dual-mode 11
!
interface ethernet 1/1/21
dual-mode 11
!
interface ethernet 1/1/22
dual-mode 11
!
interface ethernet 1/1/23
dual-mode 11
!
interface ethernet 1/1/24
dual-mode 11
!
interface ethernet 1/1/25
dual-mode 11
!
interface ethernet 1/1/26
dual-mode 11
!
interface ethernet 1/1/31
dual-mode 11
!
interface ethernet 1/1/32
dual-mode 11
!
interface ethernet 1/1/33
dual-mode 11
!
interface ethernet 2/1/1
dual-mode 11
!
interface ethernet 2/1/2
dual-mode 11
!
interface ethernet 2/1/7
dual-mode 11
!
interface ethernet 2/1/8
dual-mode 11
!
interface ethernet 2/1/9
dual-mode 11
!
interface ethernet 2/1/25
dual-mode 11
!
interface ethernet 2/1/26
dual-mode 11
!
interface ethernet 2/1/31
dual-mode 11
!
interface ethernet 2/1/32
dual-mode 11
!
interface ethernet 2/1/33
dual-mode 11
!
interface ve 11
ip address 169.254.1.201 255.255.255.0
!
interface ve 4093
ip address 169.254.129.201 255.255.128.0
!
!
!
!
!
!
!
!
!

****************************************************************************
6> dm statistics

real_transition-transit-sw_reset-discards:
1-0-0-0(1/1/1) 0-0-0-0(1/1/2) 0-0-0-0(1/1/3) 0-0-0-0(1/1/4)
0-0-0-0(1/1/5) 0-0-0-0(1/1/6) 0-0-0-0(1/1/7) 1-0-0-0(1/1/8)
0-0-0-0(1/1/9) 1-0-0-0(1/1/10) 1-0-0-0(1/1/11) 0-0-0-0(1/1/12)
0-0-0-0(1/1/13) 0-0-0-0(1/1/14) 0-0-0-0(1/1/15) 0-0-0-0(1/1/16)
0-0-0-0(1/1/17) 0-0-0-0(1/1/18) 0-0-0-0(1/1/19) 1-0-0-0(1/1/20)
1-0-0-0(1/1/21) 0-0-0-0(1/1/22) 0-0-0-0(1/1/23) 0-0-0-0(1/1/24)
0-0-0-0(1/1/25) 0-0-0-0(1/1/26) 0-0-0-0(1/1/27) 0-0-0-0(1/1/28)
0-0-0-0(1/1/29) 0-0-0-0(1/1/30) 0-0-0-0(1/1/31) 0-0-0-0(1/1/32)
0-0-0-0(1/1/33) 1-0-0-0(1/1/34) 1-0-0-0(1/1/35) 0-0-0-0(1/1/36)
0-0-0-0(1/1/37) 0-0-0-0(1/1/38) 0-0-0-0(1/1/39) 0-0-0-0(1/1/40)
0-0-0-0(1/1/41) 0-0-0-0(1/1/42) 0-0-0-0(1/1/43) 1-0-0-0(1/1/44)
1-0-0-0(1/1/45) 0-0-0-0(1/1/46) 0-0-0-0(1/1/47) 0-0-0-0(1/1/48)
9-0-0-0(1/2/1) 8-0-0-0(1/2/2) 9-0-0-0(1/2/3) 4-0-0-0(1/2/4)
1-0-0-0(2/1/1) 3-0-0-0(2/1/2) 0-0-0-0(2/1/3) 0-0-0-0(2/1/4)
0-0-0-0(2/1/5) 0-0-0-0(2/1/6) 0-0-0-0(2/1/7) 1-0-0-0(2/1/8)
0-0-0-0(2/1/9) 1-0-0-0(2/1/10) 1-0-0-0(2/1/11) 0-0-0-0(2/1/12)
0-0-0-0(2/1/13) 0-0-0-0(2/1/14) 0-0-0-0(2/1/15) 0-0-0-0(2/1/16)
0-0-0-0(2/1/17) 0-0-0-0(2/1/18) 0-0-0-0(2/1/19) 1-0-0-0(2/1/20)
1-0-0-0(2/1/21) 0-0-0-0(2/1/22) 0-0-0-0(2/1/23) 0-0-0-0(2/1/24)
0-0-0-0(2/1/25) 0-0-0-0(2/1/26) 0-0-0-0(2/1/27) 0-0-0-0(2/1/28)
0-0-0-0(2/1/29) 0-0-0-0(2/1/30) 0-0-0-0(2/1/31) 0-0-0-0(2/1/32)
0-0-0-0(2/1/33) 1-0-0-0(2/1/34) 1-0-0-0(2/1/35) 0-0-0-0(2/1/36)
0-0-0-0(2/1/37) 0-0-0-0(2/1/38) 0-0-0-0(2/1/39) 0-0-0-0(2/1/40)
0-0-0-0(2/1/41) 0-0-0-0(2/1/42) 0-0-0-0(2/1/43) 1-0-0-0(2/1/44)
1-0-0-0(2/1/45) 0-0-0-0(2/1/46) 0-0-0-0(2/1/47) 0-0-0-0(2/1/48)
13-0-0-0(2/2/1) 13-0-0-0(2/2/2) 7-0-0-0(2/2/3) 25-0-0-0(2/2/4)

****************************************************************************

Re: Is ICX6450 having any stack related problems

netwizz — Tue, 17 Jul 2018 17:37:15 GMT

The first thing I would do is upgrade the firmware for sure to ICX64R08030s.bin

It appears you already have the latest boot monitor.

The recommended procedure would be to backup the current firmware image to the other slot, first.

Basically, do a "show flash"

Also a "show boot"

Presuming it says that it is booting the default, which I presume given your configuration and that your "show ver" indicates you booted from Primary, you would want to back up your Primary to Secondary, first.

switch# copy flash flash secondary

then do another:

switch# show flash

From there, you want to compare the primary to the secondary to ensure the integrity of the secondary.

switch# verif md5 pri

switch# verif md5 sec

The checksums should match.

Now send your new firmware to Primary! 10.1.2.3 represents your TFTP server
- usually your workstation.

switch# copy tftp flash 10.1.2.3 ICX64R08030s.bin primary

That Bold R means it is Layer-3 "Routing" firmware. Double-check that otherwise it will loose all that functionality if it becomes a Layer-2 switch.

Verify it completed doing a "show flash"

Finally, you want to validate the integrity...

switch: verif md5 pri

There IS an MD5 file that comes with the Ruckus images. What it should be is in there.

Looks like it is FBE19838A00A940292195196BEE945AE according to my notes.

Assuming everything checks out it needs to be reloaded.

I notice you have NTP disabled. At any rate, you will want to do a "show clock" to verify the time is correct before scheduling a reboot at a specific time. You may want to adjust your time-zone etc.

On mine, I have: though you may be a different time-zone...
!
clock summer-time
clock timezone us Eastern
!

You could also do a "reload after dd:hh:mm"

At any rate, you probably want to schedule for after-hours.

Re: Is ICX6450 having any stack related problems

todd_adamson — Tue, 17 Jul 2018 17:54:34 GMT

I recently had a similar issue. The cause was incorrect cables were shipped to me. There should be a tag with a part # on it. Verify that you have the proper cables.

Re: Is ICX6450 having any stack related problems

manish_singh_7n — Mon, 30 Jul 2018 11:41:26 GMT

Hi TODD, NetWizz

Thank you for your information.

I have already tried with changing the cables as well as switch units. Errors is still occurring.

For updation of firmware, If any issue is confirmed in current firmware for stacking, then it will be possible for choosing newer firmware.

Is anything can be inferred form above shared statistics information.

topic Re: Is ICX6450 having any stack related problems in ICX Switches

Is ICX6450 having any stack related problems

Re: Is ICX6450 having any stack related problems

Re: Is ICX6450 having any stack related problems

Re: Is ICX6450 having any stack related problems