ICX7150-C12P – NAND/ECC Boot Errors, Password Recovery Issue & Risk After Power Outage

Elhadji

Hello RUCKUS Lennar Home Community Support,
I am troubleshooting the RUCKUS ICX7150-C12P switch installed in my Lennar home after my wired network stopped working.
Using a serial console connection with PuTTY, I was able to access the boot monitor. During startup, the switch reported errors including:
ecc_errors after reading...
iproc_nand_read_page returned 2
NAND read ... failed -22
Bad FIT kernel image format!
ERROR: can't get kernel image!
The primary image failed to boot, and the switch attempted the secondary image.
Following the RUCKUS password-recovery instructions provided in this community, at the ICX7150-Boot> prompt I entered:
no password
The switch responded:
OK! Skip password check when the system is up.
I then entered boot. The switch successfully booted, PoE returned, the Ethernet ports became active, my RUCKUS access points came back online, and my wired Ethernet service is currently working.
However, I still have two concerns:

1. Username/password recovery
   After the switch boots, I receive:
   User Access Verification
   Please Enter Login Name:
   Leaving the username and password blank results in User login failure, and the previous credentials I tried do not work.
   What exact steps should I follow after using no password to gain CLI access and create a new administrator username/password? I want to make sure the new credentials are permanently saved.
2. NAND/ECC errors and future power outages
   Because the switch produced NAND/ECC errors and could not load the primary kernel image, I am concerned that the switch may fail to boot normally after the next power outage or restart.
   Can you please advise:
   Whether these NAND/ECC and Bad FIT kernel image format errors indicate a corrupted primary firmware image or possible flash-memory failure.
   Whether the primary firmware image should be repaired/reinstalled.
   How to verify that both primary and secondary images are healthy.
   Whether the switch should be considered for replacement/RMA if the NAND/ECC errors persist.
   How to make sure the switch will automatically recover and boot normally after a future power outage without requiring another serial-console intervention.
   The network is currently operational, so I would prefer not to factory-reset the switch or make changes that could disrupt the working configuration unless necessary.
   Thank you for your assistance.

MariaC862

Hi @Elhadji,

Thank you for posting.

To answer your questions:

• What exact steps should I follow after using no password to gain CLI access and create a new administrator username/password?

After you have done the no password step, enter:

enable

config t

username (insert preferred username) password (insert new password)

write mem

These steps will create a new username and a new password,

• Whether these NAND/ECC and Bad FIT kernel image format errors indicate a
  corrupted primary firmware image or possible flash-memory failure.

Yes, these are a sign of a potential flash failure.

• 
  Whether the primary firmware image should be repaired/reinstalled.

Yes, this is the primary approach to recover the unit, please try these steps.

• How to verify that both primary and secondary images are healthy.

show flash (if the content shows as "empty" or weird symbols like ### or $$, then there is a flash failure)

• Whether the switch should be considered for replacement/RMA if the NAND/ECC errors persist.

If the issues persist after trying the software recovery steps, we will consider the RMA.

• How to make sure the switch will automatically recover and boot normally
  after a future power outage without requiring another serial-console
  intervention.

The best way to prevent these issues is to make sure the unit is running the stability version (08095g) and, ideally, have it connected to a surge protector.

• The network is currently operational, so I would prefer not to
  factory-reset the switch or make changes that could disrupt the working
  configuration unless necessary.

Understood, the software recovery does not delete the switch configuration.

However, if you would like to save a back up, you can login to the switch and copy all the output from show run into a notepad. (this is just in case you have any specific config on the switch, as for Lennar homes the switches normally operate on the default settings.)

Let me know how it goes and if you have any questions.

Thank you.