ICX7150-C12 network drops intermittently.

[adanbrown]

Good morning,

I have a Lennar home with an ICX7150-C12. It is configured in switch mode, and I have recently updated both primary and secondary to 08090k (in an attempt to fix my issue, which failed). 

It is hard to describe, but I will do my best. If I power cycle my switch, everything works flawlessly for about ~2 hours. After a couple of hours, wired and wireless clients experience continuous drops. YouTube TV starts to show buffering, I cannot join online conference calls, and webpages take 10-25 seconds to load. Just plain old simple continuous drops of internet. 

All devices work perfectly if I switch back to the regular four-port switch that the ATT Gateway has (taking the ICX Switch out of the picture).

Any suggestions you can provide for me to fix this would be greatly appreciated.

Thanks,

Adan

[Jayavidhya]

Hi @adanbrown

Please confirm if the issue is happening while it is connected to access points or when it is connected to ISP router. 

Please follow out the next steps.

1. Connect the computer to the ISP router with the ethernet cable. Run the speed test, and confirm if your speed is stable and search for websites,  make sure you have no issues.

2. You can perform the same step on wireless by connecting the computer to the Wi-Fi / SSID coming from the ISP router. (Note: Not the Wi-Fi coming from the access points.)

Guide to console in the ICX-7150-12CP 'Ruckus Switch'

https://community.ruckuswireless.com/t5/RUCKUS-Support-for-Lennar-Homes/How-to-console-in-the-ICX-71...

Also please share the output of the following commands to check the status of the interfaces in the switch.

show log

show interfaces brief

show lldp neighbor

show mac

To check cabling issue:

Access Points -->choose the AP -->Show AP Info -->scroll -->under Physical address must be on 1000Mbps .

NOTE: If the speed is in less than 1000Mbps then it indicates it indicates the cabling issue.

Also please share the logs of the access points for better understanding of the issue.

https://docs.commscope.com/bundle/unleashed-200.13-onlinehelp/page/GUID-0DA6A5D3-DC7C-4A2F-87D7-F24F...

Best regards,

Jayavidhya

Lennar Home Community

[adanbrown]

Here is the output to the above referenced commands:

ICX7150-C12 Switch>show log
Syslog logging: enabled ( 0 messages dropped, 0 flushes, 0 overruns)
Buffer logging: level ACDMEINW, 140 messages logged
level code: A=alert C=critical D=debugging M=emergency E=error
I=informational N=notification W=warning

Static Log Buffer:
May 6 23:25:02:I:System: Stack unit 1 POE PS 1, Internal Power supply with 124000 mwatts capacity is up

Dynamic Log Buffer (4000 lines):
May 7 20:13:47:I:Security: console login by adanbrown to USER EXEC mode
May 7 19:27:43:I:Security: Web session adanbrown from src IP 192.168.1.212 timed-out
May 7 19:22:27:I:STP: VLAN 1 Port 1/1/11 Bridge TC Event (FwdDlyExpiry)
May 7 19:22:27:I:STP: VLAN 1 Port 1/1/11 STP State -> FORWARDING (FwdDlyExpiry)
May 7 19:22:25:I:STP: VLAN 1 Port 1/1/11 STP State -> LEARNING (FwdDlyExpiry)
May 7 19:22:24:I:STP: VLAN 1 New RootBridge: 0000d0fcd0028d91 RootPort: 1/1/11 (BpduRcvd)
May 7 19:22:23:I:STP: VLAN 1 Port 1/1/11 STP State -> LISTENING (MakeFwding)
May 7 19:22:23:I:System: Interface ethernet 1/1/11, state up
May 7 19:21:29:I:System: Interface ethernet 1/1/2, state down
May 7 19:21:29:I:STP: VLAN 1 Bridge is RootBridge: 80003420e330b928 (PortDown)
May 7 19:21:29:I:STP: VLAN 1 Port 1/1/2 STP State -> FORWARDING (PortDown)
May 7 19:16:09:I:Security: Web login by adanbrown from src IP 192.168.1.212
May 7 07:25:27:I:System: PoE: Power disabled on port 1/1/3 because of PD disconnection.
May 7 07:25:27:I:System: Interface ethernet 1/1/3, state down
May 7 07:25:27:I:STP: VLAN 1 Port 1/1/3 STP State -> DISABLED (PortDown)
May 7 07:25:27:I:STP: VLAN 1 Port 1/1/3 STP State -> FORWARDING (PortDown)
May 7 07:25:06:I:System: Interface ethernet 1/1/4, state down
May 7 07:25:06:I:STP: VLAN 1 Port 1/1/4 STP State -> DISABLED (PortDown)
May 7 07:25:06:I:STP: VLAN 1 Port 1/1/4 STP State -> FORWARDING (PortDown)
May 7 01:56:49:I:Security: Web session adanbrown from src IP 192.168.1.212 timed-out
May 7 01:50:47:I:Security: Web login by adanbrown from src IP 192.168.1.212
May 7 00:40:07:I:Security: Web session adanbrown from src IP 192.168.1.212 timed-out
May 7 00:32:08:I:Security: Web login by adanbrown from src IP 192.168.1.212
May 7 00:03:15:I:Security: Web session adanbrown from src IP 192.168.1.212 timed-out
May 6 23:49:18:I:STP: VLAN 1 Port 1/1/4 STP State -> FORWARDING (FwdDlyExpiry)
May 6 23:49:16:I:STP: VLAN 1 Port 1/1/4 STP State -> LEARNING (FwdDlyExpiry)
May 6 23:49:13:I:STP: VLAN 1 Port 1/1/4 STP State -> LISTENING (MakeFwding)
May 6 23:49:13:I:System: Interface ethernet 1/1/4, state up
May 6 23:49:01:I:STP: VLAN 1 Port 1/1/3 STP State -> FORWARDING (FwdDlyExpiry)
May 6 23:48:59:I:STP: VLAN 1 Port 1/1/3 STP State -> LEARNING (FwdDlyExpiry)
May 6 23:48:57:I:STP: VLAN 1 Port 1/1/3 STP State -> LISTENING (MakeFwding)
May 6 23:48:57:I:System: Interface ethernet 1/1/3, state up
May 6 23:48:56:I:STP: VLAN 1 Port 1/1/5 STP State -> FORWARDING (FwdDlyExpiry)
May 6 23:48:54:I:STP: VLAN 1 Port 1/1/5 STP State -> LEARNING (FwdDlyExpiry)
May 6 23:48:53:I:System: Interface ethernet 1/1/3, state down
May 6 23:48:53:I:STP: VLAN 1 Port 1/1/3 STP State -> DISABLED (PortDown)
May 6 23:48:53:I:STP: VLAN 1 Port 1/1/3 STP State -> FORWARDING (PortDown)
May 6 23:48:52:I:STP: VLAN 1 Port 1/1/5 STP State -> LISTENING (MakeFwding)
May 6 23:48:52:I:System: Interface ethernet 1/1/5, state up
May 6 23:48:45:I:System: Interface ethernet 1/1/4, state down
May 6 23:48:45:I:STP: VLAN 1 Port 1/1/4 STP State -> DISABLED (PortDown)
May 6 23:48:45:I:STP: VLAN 1 Port 1/1/4 STP State -> FORWARDING (PortDown)
May 6 23:48:27:I:System: Interface ethernet 1/1/12, state down
May 6 23:48:27:I:STP: VLAN 1 Port 1/1/12 STP State -> DISABLED (PortDown)
May 6 23:48:27:I:STP: VLAN 1 Port 1/1/12 STP State -> FORWARDING (PortDown)
May 6 23:48:24:I:System: Interface ethernet 1/1/5, state down
May 6 23:48:24:I:STP: VLAN 1 Port 1/1/5 STP State -> DISABLED (PortDown)
May 6 23:48:24:I:STP: VLAN 1 Port 1/1/5 STP State -> LEARNING (PortDown)
May 6 23:48:24:I:STP: VLAN 1 Port 1/1/5 STP State -> LEARNING (FwdDlyExpiry)
May 6 23:48:21:I:STP: VLAN 1 Port 1/1/5 STP State -> LISTENING (MakeFwding)
May 6 23:48:21:I:System: Interface ethernet 1/1/5, state up
May 6 23:48:20:I:STP: VLAN 1 Port 1/1/3 STP State -> FORWARDING (FwdDlyExpiry)
May 6 23:48:19:I:System: PoE: Power enabled on port 1/1/5.
May 6 23:48:18:I:STP: VLAN 1 Port 1/1/3 STP State -> LEARNING (FwdDlyExpiry)
May 6 23:48:16:I:STP: VLAN 1 Port 1/1/3 STP State -> LISTENING (MakeFwding)
May 6 23:48:16:I:System: Interface ethernet 1/1/3, state up
May 6 23:48:10:I:System: PoE: Power enabled on port 1/1/3.
May 6 23:48:07:I:STP: VLAN 1 Port 1/1/4 Bridge TC Event (FwdDlyExpiry)
May 6 23:48:07:I:STP: VLAN 1 Port 1/1/4 STP State -> FORWARDING (FwdDlyExpiry)
May 6 23:48:05:I:STP: VLAN 1 Port 1/1/4 STP State -> LEARNING (FwdDlyExpiry)
May 6 23:48:02:I:STP: VLAN 1 Port 1/1/4 STP State -> LISTENING (MakeFwding)
May 6 23:48:02:I:System: Interface ethernet 1/1/4, state up
May 6 23:48:01:I:STP: VLAN 1 Port 1/1/6 Bridge TC Event (FwdDlyExpiry)
May 6 23:48:01:I:STP: VLAN 1 Port 1/1/6 STP State -> FORWARDING (FwdDlyExpiry)
May 6 23:47:59:I:STP: VLAN 1 Port 1/1/6 STP State -> LEARNING (FwdDlyExpiry)
May 6 23:47:56:I:STP: VLAN 1 Port 1/1/6 STP State -> LISTENING (MakeFwding)
May 6 23:47:56:I:System: Interface ethernet 1/1/6, state up
May 6 23:47:53:I:System: Interface ethernet 1/1/6, state down
May 6 23:47:53:I:STP: VLAN 1 Port 1/1/6 STP State -> DISABLED (PortDown)
May 6 23:47:53:I:STP: VLAN 1 Port 1/1/6 STP State -> FORWARDING (PortDown)
May 6 23:40:53:I:Security: Web login by adanbrown from src IP 192.168.1.212
May 6 23:40:13:I:Security: SSH terminated by super from src IP 192.168.1.216 from src MAC 8003.8425.22d0 from USER EXEC mode using RSA as Server Host Key.
May 6 23:40:11:I:Security: Access to PRIVILEGED EXEC is rejected for ssh session due to Incorrect username or password
May 6 23:40:06:I:Security: SSH login by super from src IP 192.168.1.216 from src MAC 8003.8425.22d0 to USER EXEC mode using RSA as Server Host Key.
May 6 23:39:50:I:Security: SSH access by user super from src IP 192.168.1.216 rejected, 2 attempt(s)
May 6 23:39:47:I:Security: SSH access by user super from src IP 192.168.1.216 rejected, 1 attempt(s)
May 6 23:37:43:I:STP: VLAN 1 Port 1/1/8 STP State -> FORWARDING (FwdDlyExpiry)
May 6 23:37:41:I:STP: VLAN 1 Port 1/1/8 STP State -> LEARNING (FwdDlyExpiry)
May 6 23:37:38:I:STP: VLAN 1 Port 1/1/8 STP State -> LISTENING (MakeFwding)
May 6 23:37:38:I:System: Interface ethernet 1/1/8, state up
May 6 23:37:38:I:STP: VLAN 1 Port 1/1/6 STP State -> FORWARDING (FwdDlyExpiry)
May 6 23:37:36:I:STP: VLAN 1 Port 1/1/6 STP State -> LEARNING (FwdDlyExpiry)
May 6 23:37:34:I:System: Interface ethernet 1/1/8, state down
May 6 23:37:34:I:STP: VLAN 1 Port 1/1/8 STP State -> DISABLED (PortDown)
May 6 23:37:34:I:STP: VLAN 1 Port 1/1/8 STP State -> FORWARDING (PortDown)
May 6 23:37:33:I:STP: VLAN 1 Port 1/1/6 STP State -> LISTENING (MakeFwding)
May 6 23:37:33:I:System: Interface ethernet 1/1/6, state up
May 6 23:37:29:I:System: Interface ethernet 1/1/6, state down
May 6 23:37:29:I:STP: VLAN 1 Port 1/1/6 STP State -> DISABLED (PortDown)
May 6 23:37:29:I:STP: VLAN 1 Port 1/1/6 STP State -> FORWARDING (PortDown)
May 6 23:37:01:I:STP: VLAN 1 Port 1/1/8 STP State -> FORWARDING (FwdDlyExpiry)
May 6 23:36:59:I:STP: VLAN 1 Port 1/1/8 STP State -> LEARNING (FwdDlyExpiry)
May 6 23:36:59:I:STP: VLAN 1 Port 1/1/6 STP State -> FORWARDING (FwdDlyExpiry)
May 6 23:36:56:I:STP: VLAN 1 Port 1/1/6 STP State -> LEARNING (FwdDlyExpiry)
May 6 23:36:56:I:STP: VLAN 1 Port 1/1/8 STP State -> LISTENING (MakeFwding)
May 6 23:36:56:I:System: Interface ethernet 1/1/8, state up
May 6 23:36:53:I:STP: VLAN 1 Port 1/1/6 STP State -> LISTENING (MakeFwding)
May 6 23:36:53:I:System: Interface ethernet 1/1/6, state up
May 6 23:36:49:I:System: PoE: Power enabled on port 1/1/8.
May 6 23:36:46:I:System: PoE: Power enabled on port 1/1/6.
May 6 23:36:03:I:System: U1-MSG: PoE Info: Firmware Download on slot 1.....100 percent completed.
May 6 23:34:57:I:System: U1-MSG: PoE Info: Firmware Download on slot 1.....90 percent completed.
May 6 23:33:52:I:System: U1-MSG: PoE Info: Firmware Download on slot 1.....80 percent completed.
May 6 23:32:46:I:System: U1-MSG: PoE Info: Firmware Download on slot 1.....70 percent completed.
May 6 23:31:41:I:System: U1-MSG: PoE Info: Firmware Download on slot 1.....60 percent completed.
May 6 23:30:34:I:System: U1-MSG: PoE Info: Firmware Download on slot 1.....50 percent completed.
May 6 23:29:29:I:System: U1-MSG: PoE Info: Firmware Download on slot 1.....40 percent completed.
May 6 23:28:23:I:System: U1-MSG: PoE Info: Firmware Download on slot 1.....30 percent completed.
May 6 23:28:16:D:DHCPC: TFTP unable to download running-configuration
May 6 23:27:59:D:DHCPC: sending TFTP request for bootfile name brocade.cfg
May 6 23:27:42:D:DHCPC: sending TFTP request for bootfile name default.cfg
May 6 23:27:24:D:DHCPC: sending TFTP request for bootfile name ICX7150-C12-Switch.cfg
May 6 23:27:18:I:System: U1-MSG: PoE Info: Firmware Download on slot 1.....20 percent completed.
May 6 23:27:07:D:DHCPC: sending TFTP request for bootfile name ICX7150-C12-Switch3420.e330.b928.cfg
May 6 23:26:49:D:DHCPC: sending TFTP request for bootfile name ICX7150-C12-Switch3420.e330.b928-config.cfg
May 6 23:26:32:D:DHCPC: sending TFTP request for bootfile name ICX7150-C12-Switch3420.e330.b928-config.cfg
May 6 23:26:16:D:DHCPC: sending TFTP request for bootfile name ICX7150-C12-Switch3420.e330.b928-config.cfg
May 6 23:26:12:I:System: U1-MSG: PoE Info: Firmware Download on slot 1.....10 percent completed.
May 6 23:25:59:D:DHCPC: sending TFTP request for bootfile name ICX7150-C12-Switch3420.e330.b928-config.cfg
May 6 23:25:43:D:DHCPC: sending TFTP request for bootfile name ICX7150-C12-Switch3420.e330.b928-config.cfg
May 6 23:25:27:I:DHCPC: ICX7150-C12 Switch configured with ip-address 192.168.1.214; subnet mask 255.255.255.0
May 6 23:25:27:D:DHCPC: sending TFTP request for bootfile name ICX7150-C12-Switch3420.e330.b928-config.cfg
May 6 23:25:11:I:STP: VLAN 1 Port 1/1/12 STP State -> FORWARDING (FwdDlyExpiry)
May 6 23:25:10:I:STP: VLAN 1 Port 1/1/2 Bridge TC Event (FwdDlyExpiry)
May 6 23:25:10:I:STP: VLAN 1 Port 1/1/2 STP State -> FORWARDING (FwdDlyExpiry)
May 6 23:25:09:I:STP: VLAN 1 Port 1/1/12 STP State -> LEARNING (FwdDlyExpiry)
May 6 23:25:08:I:STP: VLAN 1 Port 1/1/2 STP State -> LEARNING (FwdDlyExpiry)
May 6 23:25:06:I:STP: VLAN 1 Port 1/1/12 STP State -> LISTENING (MakeFwding)
May 6 23:25:06:I:System: Interface ethernet 1/1/12, state up
May 6 23:25:06:I:STP: VLAN 1 New RootBridge: 0000d0fcd0028d91 RootPort: 1/1/2 (BpduRcvd)
May 6 23:25:06:W:System: PoE Warning: Upgrading firmware in slot 65537....DO NOT SWITCHOVER OR POWER DOWN THE UNIT.
May 6 23:25:05:I:STP: VLAN 1 Port 1/1/2 STP State -> LISTENING (MakeFwding)
May 6 23:25:05:I:System: Interface ethernet 1/1/2, state up
May 6 23:25:04:I:PKI: Trustpoint DEVICE_TRUSTPNT: Successfully loaded Manufacturing certificate file.
May 6 23:25:04:C:System: PoE Severe Error: Unexpected controller reset encountered on PoE module.
May 6 23:25:04:I:System: Warm start
May 6 23:25:02:I:System: Stack unit 1 POE PS 1, Internal Power supply with 124000 mwatts capacity is up
May 6 23:25:01:D:DHCPC: starting dhcp client service
May 6 23:25:01:I:DHCPC: Found dynamic IP address 192.168.1.214 subnet mask 255.255.255.0 on port 1/1/1
May 6 23:25:00:I:Security: running-config was potentially changed by un-authenticated user from console

ICX7150-C12 Switch>show interfaces brief

Port Link State Dupl Speed Trunk Tag Pvid Pri MAC Name
1/1/1 Down None None None None No 1 0 3420.e330.b928
1/1/2 Down None None None None No 1 0 3420.e330.b929
1/1/3 Down None None None None No 1 0 3420.e330.b92a
1/1/4 Down None None None None No 1 0 3420.e330.b92b
1/1/5 Up Forward Half 100M None No 1 0 3420.e330.b92c
1/1/6 Up Forward Full 1G None No 1 0 3420.e330.b92d
1/1/7 Down None None None None No 1 0 3420.e330.b92e
1/1/8 Up Forward Full 1G None No 1 0 3420.e330.b92f
1/1/9 Down None None None None No 1 0 3420.e330.b930
1/1/10 Down None None None None No 1 0 3420.e330.b931
1/1/11 Up Forward Full 1G None No 1 0 3420.e330.b932
1/1/12 Down None None None None No 1 0 3420.e330.b933
1/2/1 Down None None None None No 1 0 3420.e330.b935
1/2/2 Down None None None None No 1 0 3420.e330.b936
1/3/1 Down None None None None No 1 0 3420.e330.b937
1/3/2 Down None None None None No 1 0 3420.e330.b938
mgmt1 Down None None None None No None 0 3420.e330.b928

ICX7150-C12 Switch>show lldp neighbor
Lcl Port Chassis ID Port ID Port Description System Name
1/1/6 8c7a.1523.29f0 8c7a.1523.29f0 eth0 Bedrooms_Hallw
1/1/8 8003.8425.22d0 8003.8425.22d0 eth0 Kitchen

Total active entries from all ports = 35
MAC-Address Port Type
0006.7876.4d20 1/1/11 Dynamic
001a.ae11.eeab 1/1/11 Dynamic
0026.7402.491f 1/1/11 Dynamic
0456.e576.4ed1 1/1/8 Dynamic
083a.882d.8659 1/1/5 Dynamic
1845.166b.2e27 1/1/11 Dynamic
1cb3.c90e.b2b1 1/1/11 Dynamic
246f.28ca.8c28 1/1/6 Dynamic
36d3.16fe.1d1b 1/1/11 Dynamic
3886.f714.a2c9 1/1/8 Dynamic
40a9.cf5c.d04c 1/1/6 Dynamic
5014.7999.624e 1/1/6 Dynamic
521a.996c.2ed5 1/1/6 Dynamic
8003.8425.22d0 1/1/8 Dynamic
84cc.a825.0664 1/1/6 Dynamic
8c7a.1523.29f0 1/1/6 Dynamic
9048.6cc8.e5e4 1/1/11 Dynamic
943c.c6bb.5f14 1/1/11 Dynamic
9c76.13aa.e378 1/1/11 Dynamic
a04a.5e0b.86a6 1/1/11 Dynamic
a406.e97a.7b10 1/1/8 Dynamic
MAC-Address Port Type
a406.e986.2e64 1/1/6 Dynamic
a406.e9b2.1246 1/1/11 Dynamic
a4e5.7cd7.d674 1/1/6 Dynamic
a88c.3ecd.3598 1/1/11 Dynamic
ac67.84e6.0416 1/1/11 Dynamic
ac67.b203.d9fc 1/1/6 Dynamic
ac67.b204.dd50 1/1/6 Dynamic
b037.95b3.adbe 1/1/11 Dynamic
d0fc.d002.8d91 1/1/11 Dynamic
d828.c95b.f827 1/1/6 Dynamic
dc91.bf70.4847 1/1/11 Dynamic
e415.f666.746f 1/1/11 Dynamic
f4cf.a2bd.ff40 1/1/6 Dynamic
fce9.d843.3f82 1/1/11 Dynamic

I can't access the access point website, can you provide a method to reset the user/password? SHould it be the same as the switch?

Thanks

[Jeronimo]

Hi friend.

You can confirm error, crc, err-disable, and so on using "show interface e 1/1/x".

Regards.

[Jayavidhya]

Hi @Jeronimo

Based on your description, you are getting CRC errors because you have a bad cable or switchport. Try a known good cable, then try another switchport if the replacement cable is no better.

Also please send the output of following commands.

Enable

Show version

Show flash 

I will leave some upgrade guides using a USB flash driver or TFTP / GUI 

How to Upgrade a Switch ICX-7150-C12P using a USB flash drive

https://community.ruckuswireless.com/t5/RUCKUS-Support-for-Lennar-Homes/How-to-Upgrade-a-Switch-ICX-...

How to perform an Upgrade via Web GUI (ICX7150 Switch)

https://community.ruckuswireless.com/t5/RUCKUS-Support-for-Lennar-Homes/How-to-perform-an-Upgrade-vi...

How to upgrade a Switch ICX7150-C12P via TFTP

https://community.ruckuswireless.com/t5/RUCKUS-Support-for-Lennar-Homes/How-to-Upgrade-a-Switch-ICX-...

Best regards,

Jayavidhya

Lennar Home Community

[adanbrown]

I am running the command. I assume that you mean I have to go port by port and look at the output. Can you provide a sample output to let me see where I would see the error? I can run it for all ports.