ICX 7150 Left the stack

[jasantbay]

Good Day

We had a pentest conducted on our environment and a few vulnerabilities were found with our Ruckus switch stack. We attempted to flash the stack during our maintenance weekend but it kept timing out. We then issued a reload command to reboot the stack. After the stack came back up it flashed fine. Fast forward to Monday morning and the branch complained that wifi in section of the building was down. To make a long story short the switch left the stack. The switch was removed and shipped to me to look at as we have another branch where the same issue has occurred. The power light is green and the syst light is orange. When a console cable is plugged the prompt just says "OS>". We attempted a software recovery and flashed the switch with SPR09010kufi.bin which is what we used for all other SPR stacks using the instructions here  . The only part I skipped was the setenv uboot and update_uboot as I dont have the boot.bin and I noted this:

Copying U-Boot image (mnz10127.bin) to Primary flash
sf erase 0x0 0xc0000
sf write 0x720c0f34 0x0 0xc0000
device 0 offset 0x0, size 0xc0000
U-Boot update Done.

After issuing the reset command, the switch reboots and just goes back to the OS prompt. Green Power Light, Orange System light. I am not sure what more to do. Firstly for some reason it boots from the secondary partition and at the end of the boot process it shows an error related to "Incompatible version of booted application (SPR09010k.bin) and packages (SPR09010e.bin) stored in UFI image" so I flashed to SPR09010eufi.bin

OS> reboot
OS> Stopping File Manager daemon...
Stopping health monitor daemon...
dhclientv4 executable file is not present.
dhcpdv4 executable file is not present.
Stopping poe daemon...
Stopping system statistics daemon...
Cannot open network namespace "fi": No such file or directory

After flashing back to the e firmware the switch booted fine.

Extract UFI FI version success, version = SPR09010e.bin
New packages found, uninstalling old packages if any..
Installing packages, this may take some time
Packages has been installed successfully.

[MEMBER]local-6@ICX7150-C12 Router>show flash
Stack unit 6:
NAND Type: Micron NAND 2GiB (x 1)
Compressed Pri Code size = 33554432, Version:09.0.10eT213 (SPR09010e.bin)
Compressed Sec Code size = 33554432, Version:09.0.10eT213 (SPR09010e.bin)
Compressed Pri Boot Code size = 786944, Version:10.1.25T225 (mnz10125)
Compressed Sec Boot Code size = 786944, Version:10.1.25T225 (mnz10125)
Code Flash Free Space = 714231808

After rebooting the switch again, it booted from primary flash: Crashkernel Disabled
device 0 offset 0xbfe00, size 0x200
Enter 'b' to stop at boot monitor: 0
device 0 offset 0x0, size 0xc0000
Uboot Checksum Verification: PASS
bootdelay: ===
Booting image from Primary

Processing packages from primary partition
Extract UFI FI version success, version = SPR09010k.bin
Incompatible version of booted application (SPR09010e.bin) and packages (SPR09010k.bin) stored in UFI image
Error, cannot install packages
Uninstalling old packages if any.
Error in processing packages
Package installation is incomplete, related functionalities may not be available

Any assistance would be appreciated.

[Mayank · Accepted solution]

Hi Jasanthbay,

Thank you for posting your query!

I understand that your switch is stuck in a boot loop, and you have already tried a software recovery, but the issue remains.

I have a question for you:

Have you tried to boot the ICX from the secondary code in boot mode? If not, please give it a try using the command below:

ICX7150-BOOT>boot_secondary

I noticed that you attempted a software recovery from SPR09010kufi.bin. Could you also try performing a software recovery from 08-0-80f?

Please refer to the following link for the 8080 code:

https://support.ruckuswireless.com/software/2463-ruckus-icx-fastiron-08-0-80f-ga-software-release-zi...

If this issue is not resolved, please log a ticket using the link below so that we can assist you further:

https://support.ruckuswireless.com/contact-us

I hope this information helps you. Please feel free to reach out if you have any concerns.

Note: If this has addressed your query, please feel free to mark the post as an ACCEPTED SOLUTION.

Thanks, 

Mayank

[jasantbay]

Thank you Mayank, before all the flashing all our Switchers were on SPR09010e or SPS09010e. After flashing to switch to the image you linked to, the switch appears to be working again. I ran "stack unconfigure" me to set it to a stand alone unit as I don't think my manager wants it to go back to the branch.

[Mayank]

Hi Jasanthbay,

I’m pleased to hear that the issue has been resolved.

Thanks

Mayank