High CPU on ICX7450 running 09.0.10f

RUCKUS Community Forums are now in READ-ONLY mode while we migrate to a new platform.

You will still be able to read posts and knowledge articles, but will be unable to post new content until Go Live on the new platform Monday August 17.

Lennar Smart Home customers: please contact [email protected] for assistance during the week of August 9-17.

Last night we experienced several systems on our three-member ICX7450 stack:

alarms about BGP sessions bouncing
could not SSH in via inband or OOB interfaces
received alerts from some attached devices that some LACP-enabled LAGs bounced a few times
SNMP-based graphs were not
ICMP-based pings timed our had high latency

Everything pointed to a high CPU.

We failed to get proper serial interface in place, so we power cycled unit #1 and then took the opportunity to upgrade from 09.0.10c to 09.0.10f. Unfortunately a few hours later we lost SSH, saw ICMP ping failures, and SNMP-based graphing, though we haven't seen any BGP sessions bouncing.

Via the serial interface we could see CPU 0 was high, and these are the processes that high:

2564 root -20 1 678.8m 381.2m 8.0 19.1 48:00.38 R `- bcmINTR
2703 root 26 6 678.8m 381.2m 36.0 19.1 44:34.67 S `- bcmCNTR.0
2742 root 21 1 678.8m 381.2m 12.0 19.1 41:20.12 R `- bcmRX
2807 root -18 6 678.8m 381.2m 28.6 19.1 131:01.63 R `- ZMQbg/1
2988 root 26 6 678.8m 381.2m 16.0 19.1 89:58.03 S `- os_pkt_intx_tx

Best guess is that something is hitting the CPU pretty hard.

Is there a way to see what packets are hitting the CPU?

4 REPLIES 4