Power off-on and no home internet. Is the ICX switch is working properly? access points no lights on

[sumantacdas]

The power was turned off and then on. After that there is no home internet. Unsure if the ICX switch is working properly. The access points do not have any lights on - signaling they are not getting any power via the PoE maybe?

The ICX7150 C12p switch has PWR = green and the SYST = amber light. The panel for "STATUS" led lights shows nothing. And the access points have no lights on - guessing they are not receiving any PoE. Please help. 

Attached is a picture. 

[sumantacdas · Accepted solution]

Hi @aalvarez6 

The problem has been resolved. Both access points are working fine and I have the same home WiFi back.

I could understand from your message that maybe the APs were not getting power and/or not getting enough power for them to operate.

I used my web browser to login to the ICX 7150 switch and changed / updated the following settings. 

Once that is done, the R510 access points got the power they needed and everything was back to normal. As you can see from below.

So to summarize, the overall solution was to:
1. Download the ICX 7150 software from https://support.ruckuswireless.com/software?filter=108#sort=relevancy&f:@source=[Software%20Download...

I downloaded the version 08090d.

2. Took my personal 2 GB USB drive -> formatted it to FAT32 -> copied the boot code file mnz10115.bin, and the  image file SPS08090dufi.bin onto it.

3. Consoled into the ICX 7150 switch using any USB-C to USB cable (I used my phone charger cable).  Used PuTTY software and for me it was COM3 port. 

4. Plugged the USB drive into the USB port available on the ICX 7150 switch.

5. Followed the steps from this article to load the image to both primary and secondary and then reboot: https://www.dentonsolutions.com/2018/08/01/ruckus-switch-firmware-upgrade-how-to/

6. This restored the ICX 7150 switch to being operational. I was able to use my web browser to connect to the ICX switch.

7. I also connected my laptop to any of the 12 Ethernet ports of the ICX switch using a LAN cable. And found that my laptop got an IP and was able to access the internet with no issues.

8. But the two R150 access points were not powering up. The PWR led was blinking red slowly.

9. Used the Web Browser login to the ICX 7150 switch and found that the Inline Power was "disabled". Enabled it as per the snippet shared earlier.

10. After sometime both access points were alive, connected and was transmitting / receiving.

Solved!

Thank you so much!

Regards,
Sumanta

[sumantacdas]

Is the switch is out from bootrom mode. Since I can't attach the putty log, let me extract some info from there and then paste it here.

1. Beginning, when I first established serial/console connection:

ICX7150-Boot>printenv
baudrate=9600
ipaddr=10.14.145.188
serverip=10.14.144.14
netmask=255.255.254.0
gatewayip=10.14.144.1
uboot=mnz10115.bin
image_name=SPR08090d.bin
ver=10.1.15T225 (Jan 30 2019 - 23:08:47 -0800)

Environment size: 192/16379 bytes

2. Next, I did setenv for ipaddr, netmask, serverip, uboot.

3. Then did update_uboot

ICX7150-Boot>update_uboot
Loading image to Uboot Partition 2
Change GMAC speed to 1000MB
Using bcm_xgs_gmac-0 device
TFTP from server 192.168.1.122; our IP address is 192.168.1.167
Filename 'mnz10115.bin'.
Load address: 0x61007dc0
Loading: *######################################################
5.5 MiB/s
done
Bytes transferred = 786944 (c0200 hex)
sf erase 0x0 0xc0000
copying uboot image to flash, it will take sometime...
sf write 0x61007fc0 0x0 0xc0000
device 0 offset 0x0, size 0xc0000
TFTP to Flash Done.
ICX7150-Boot>
ICX7150-Boot>
ICX7150-Boot>
ICX7150-Boot>
ICX7150-Boot>

Ruckus Wireless Bootloader: 10.1.15T225 (Jan 30 2019 - 23:08:47 -0800)

Booted from partition 2
DRAM: Validate Shmoo parameters stored in flash ..... OK

ICX7150-12 (POE), PVT1
SYS CPLD VER: 0x4 Released Ver: 0xa

device 0 offset 0xbfe00, size 0x200
device 0 offset 0x0, size 0xc0000
Enter 'b' to stop at boot monitor: 3  2  1  0
device 0 offset 0x0, size 0xc0000
bootdelay: ===
Booting image from Secondary

NAND read: device 0 offset 0x4000000, size 0x2000000
8 ecc_errors after reading 5b48000:5b49c00
iproc_nand_read_page returned 2
NAND read from offset 4000000 failed -22
0 bytes read: ERROR
## Loading kernel from FIT Image at 70000200 ...
Bad FIT kernel image format!
ERROR: can't get kernel image!
could not boot from secondary, no valid image; trying to boot from primary
device 0 offset 0x0, size 0xc0000
BOOTING image from Primary

NAND read: device 0 offset 0x0, size 0x2000000
8 ecc_errors after reading 1b48000:1b49c00
iproc_nand_read_page returned 2
NAND read from offset 0 failed -22
0 bytes read: ERROR
## Loading kernel from FIT Image at 70000200 ...
Bad FIT kernel image format!
ERROR: can't get kernel image!
ICX7150-Boot>could not boot from secondary, no valid image;                                                
ICX7150-Boot>
ICX7150-Boot>
ICX7150-Boot>
ICX7150-Boot>

4. Hence began the steps from here: https://community.ruckuswireless.com/t5/ICX-Switches/can-t-get-kernel-image-both-primary-and-seconda...

ICX7150-Boot>setenv image_name SPR08090d.bin update_primary
Updating PRIMARY image over TFTP

Load addr=0x70000000
Change GMAC speed to 1000MB
Using bcm_xgs_gmac-0 device
TFTP from server 192.168.1.122; our IP address is 192.168.1.167
Filename 'SPR08090d.bin'.
Load address: 0x70000000
Loading: *#################################################################
....

....

...

ICX7150-Boot>boot_primary
device 0 offset 0x0, size 0xc0000
BOOTING image from Primary

NAND read: device 0 offset 0x0, size 0x2000000
33554432 bytes read: OK
## Loading kernel from FIT Image at 70000200 ...
Using 'conf@1' configuration
Trying 'kernel@2' kernel subimage
Description: Ruckus Linux MN VER=08.0.90d
Type: Kernel Image
Compression: lzma compressed
Data Start: 0x7024fa14
Data Size: 2401258 Bytes = 2.3 MiB
Architecture: ARM
OS: Linux
Load Address: 0x61008000
Entry Point: 0x61008000
Hash algo: crc32
Hash value: ac67d750
## Loading kernel from FIT Image at 70000200 ...
Using 'conf@1' configuration
Trying 'kernel@2' kernel subimage
Description: Ruckus Linux MN VER=08.0.90d
Type: Kernel Image
Compression: lzma compressed
Data Start: 0x7024fa14
Data Size: 2401258 Bytes = 2.3 MiB
Architecture: ARM
OS: Linux
Load Address: 0x61008000
Entry Point: 0x61008000
Hash algo: crc32
Hash value: ac67d750
Verifying Hash Integrity ... crc32+ OK
## Loading ramdisk from FIT Image at 70000200 ...
Using 'conf@1' configuration
Trying 'ramdisk@1' ramdisk subimage
Description: Ramdisk -rootfs
Type: RAMDisk Image
Compression: lzma compressed
Data Start: 0x704a07b4
Data Size: 27682307 Bytes = 26.4 MiB
Architecture: ARM
OS: Linux
Load Address: 0x00000000
Entry Point: 0x00000000
Hash algo: crc32
Hash value: 011bd5e3
Verifying Hash Integrity ... crc32+ OK
## Loading fdt from FIT Image at 70000200 ...
Using 'conf@1' configuration
Trying 'fdt@3' fdt subimage
Description: Flattened Device Tree blob
Type: Flat Device Tree
Compression: uncompressed
Data Start: 0x7049e55c
Data Size: 8607 Bytes = 8.4 KiB
Architecture: ARM
Hash algo: crc32
Hash value: 6fc9a37b
Verifying Hash Integrity ... crc32+ OK
Loading fdt from 0x7049e55c to 0x65008000
Booting using the fdt blob at 0x65008000
Uncompressing Kernel Image ... OK
Using Device Tree in place at 65008000, end 6500d19e

Starting kernel ...

Mounting file system...
booting with 4.4 kernel
NAND Type: Micron NAND 2GiB (x 1)
PLATFORM MN
dd cmd: UBI
Config partition mounted
Resource partition is mounted!!
Processing packages from primary partition
Incompatible version of booted application and packages stored in UFI image
Error, cannot install packages
Uninstalling old packages if any..
Error in processing packages
Package installation is incomplete, related functionalities may not be available
dhcpd executable file is not present.
Starting up system statistics daemon...
Starting systatsd done
Starting up health monitor daemon...
Log Level 7: Daemonized systatsd
Systatsd Logging Env is not set, initializing loglevel to: 7
Setting connection to systemlogger
Starting hmond done
Hmond Logging Env is not set, initializing loglelvel to: I
Setting connection to systemlogger
Backup is fine
Kernel crashdump is disabled.
dma_mem_base: 0x96000000, dma_mem_len: 0x8000000, warm_mem_base: 0x9f500000, warm_mem_len: 0xb00000
Creating TUN device
Starting TPM Infra
Group tss and User tss created
kernel.hostname = localhost
hostname set to localhost
Starting TCSD Daemon
TCSD Up and Running
Enabling time stamp.
Starting the FastIron.
USER=root
boot_partition=pri_partition
HOME=/
GCOV_PREFIX=/fast_iron
ethaddr=34:20:e3:2f:6c:61?
TERM=vt102
PATH=/sbin:/usr/sbin:/bin:/usr/bin
crashkernel=64M@0x70000000
ip=192.168.1.167:192.168.1.122:10.14.144.1:255.255.255.0:MN:eth0:off
SHELL=/bin/sh
PWD=/
i2c-0 i2c Broadcom iProc I2C adapter I2C adapter 2
i2c-1 i2c Broadcom iProc I2C adapter I2C adapter 2
FIPS Disabled:PORT NOT DISABLED
platform type 90
OS>
Loaded Image SPR08090d from Pri Built on (UTC): Mon Sep 23 07:08:29 2019
Uboot and FI booted from different partitions, Uboot: Secondary, FI: Primary
Auto correcting the cross boot combination... going for auto reboot now
Auto Sampling : enabled
Min Time : 250
CPU Sampling d[ 77.510124] [BrcdSoftlockup]: root e501cd80 is not a valid rb_tree
isabled.
Stopping health monitor daemon...
Stopped health monitor daemon
Stopping system statistics daemon...
Stopped systatsd.
dhcpd executable file is not present.
Saving the configuration and license files...
Backup is fine
The system is going down NOW!
Sent SIGTERM to all processes
[ 79.219978] [BrcdSoftlockup]: sim_softwatchdog thread is detached on core=0
Sent SIGKILL to all processes
Requesting system reboot
[ 81.330359] reboot: Restarting system
[ 81.374258] Asserting GHPIO[7] reset sequence from Kernel ...

5. The switch went into reboot again

Ruckus Wireless Bootloader: 10.1.15T225 (Jan 30 2019 - 23:08:47 -0800)

Booted from partition 1
DRAM: Validate Shmoo parameters stored in flash ..... OK

ICX7150-12 (POE), PVT1
SYS CPLD VER: 0x4 Released Ver: 0xa
Writing Shmoo values into flash .....

device 0 offset 0xbfe00, size 0x200
device 0 offset 0x0, size 0xc0000
Enter 'b' to stop at boot monitor: 3  2  1  0
device 0 offset 0x0, size 0xc0000
bootdelay: ===
Booting image from Primary

NAND read: device 0 offset 0x0, size 0x2000000
33554432 bytes read: OK
## Loading kernel from FIT Image at 70000200 ...
Using 'conf@1' configuration
Trying 'kernel@2' kernel subimage
Description: Ruckus Linux MN VER=08.0.90d
Type: Kernel Image
Compression: lzma compressed
Data Start: 0x7024fa14
Data Size: 2401258 Bytes = 2.3 MiB
Architecture: ARM
OS: Linux
Load Address: 0x61008000
Entry Point: 0x61008000
Hash algo: crc32
Hash value: ac67d750
## Loading kernel from FIT Image at 70000200 ...
Using 'conf@1' configuration
Trying 'kernel@2' kernel subimage
Description: Ruckus Linux MN VER=08.0.90d
Type: Kernel Image
Compression: lzma compressed
Data Start: 0x7024fa14
Data Size: 2401258 Bytes = 2.3 MiB
Architecture: ARM
OS: Linux
Load Address: 0x61008000
Entry Point: 0x61008000
Hash algo: crc32
Hash value: ac67d750
Verifying Hash Integrity ... crc32+ OK
## Loading ramdisk from FIT Image at 70000200 ...
Using 'conf@1' configuration
Trying 'ramdisk@1' ramdisk subimage
Description: Ramdisk -rootfs
Type: RAMDisk Image
Compression: lzma compressed
Data Start: 0x704a07b4
Data Size: 27682307 Bytes = 26.4 MiB
Architecture: ARM
OS: Linux
Load Address: 0x00000000
Entry Point: 0x00000000
Hash algo: crc32
Hash value: 011bd5e3
Verifying Hash Integrity ... crc32+ OK
## Loading fdt from FIT Image at 70000200 ...
Using 'conf@1' configuration
Trying 'fdt@3' fdt subimage
Description: Flattened Device Tree blob
Type: Flat Device Tree
Compression: uncompressed
Data Start: 0x7049e55c
Data Size: 8607 Bytes = 8.4 KiB
Architecture: ARM
Hash algo: crc32
Hash value: 6fc9a37b
Verifying Hash Integrity ... crc32+ OK
Loading fdt from 0x7049e55c to 0x65008000
Booting using the fdt blob at 0x65008000
Uncompressing Kernel Image ... OK
Using Device Tree in place at 65008000, end 6500d19e

Starting kernel ...

Mounting file system...
booting with 4.4 kernel
NAND Type: Micron NAND 2GiB (x 1)
PLATFORM MN
dd cmd: UBI
Config partition mounted
Resource partition is mounted!!
Processing packages from primary partition
Incompatible version of booted application and packages stored in UFI image
Error, cannot install packages
Uninstalling old packages if any..
Error in processing packages
Package installation is incomplete, related functionalities may not be available
dhcpd executable file is not present.
Starting up system statistics daemon...
Starting systatsd done
Starting up health monitor daemon...
Log Level 7: Daemonized systatsd
Systatsd Logging Env is not set, initializing loglevel to: 7
Setting connection to systemlogger
Starting hmond done
Hmond Logging Env is not set, initializing loglelvel to: I
Setting connection to systemlogger
Backup is fine
Kernel crashdump is disabled.
dma_mem_base: 0x96000000, dma_mem_len: 0x8000000, warm_mem_base: 0x9f500000, warm_mem_len: 0xb00000
Creating TUN device
Starting TPM Infra
Group tss and User tss created
kernel.hostname = localhost
hostname set to localhost
Starting TCSD Daemon
TCSD Up and Running
Enabling time stamp.
Starting the FastIron.
USER=root
boot_partition=pri_partition
HOME=/
GCOV_PREFIX=/fast_iron
ethaddr=34:20:e3:2f:6c:61?
TERM=vt102
PATH=/sbin:/usr/sbin:/bin:/usr/bin
crashkernel=64M@0x70000000
ip=192.168.1.167:192.168.1.122:10.14.144.1:255.255.255.0:MN:eth0:off
SHELL=/bin/sh
PWD=/
i2c-0 i2c Broadcom iProc I2C adapter I2C adapter 2
i2c-1 i2c Broadcom iProc I2C adapter I2C adapter 2
FIPS Disabled:PORT NOT DISABLED
platform type 90
OS>
Loaded Image SPR08090d from Pri Built on (UTC): Mon Sep 23 07:08:29 2019
Enabling Console Logging
Hotplugger Daemon Initialized ..
External USB disk is not mounted or plugged in.
set_board_level: gi_board_type = 116[ 65.876792] linux-kernel-bde: map phys range 0x3200000-0x3240000 to 0xb0d07000-0xb0d47000
[ 66.123215] linux-kernel-bde: map phys range 0x88100000-0x90100000 to 0xa8b8f000-0xb0b8f000
DMA pool size: 134217728
PHY Reset De-asserted
sw_pp_sdk_init:136 ToR init
SOC unit 0 attached to PCI device BCM56160_B0
Firmware version from File: 2.1.1
Pre Parsing Config Data ...

Done with Pre-allocating nexthop id's for Unicast & Openflow
Warning: This operation would close all existing SSH connection.
Parsing Config Data ...
Error! 1/3/1 speed is 1G. A stack-port needs at least 10G speed.
Error! 1/3/2 speed is 1G. A stack-port needs at least 10G speed.
Invalid input ->address 192.168.0.124 255.255.255.0 dynamic
Type ? for a list
Invalid input ->default-gateway 192.168.0.1 dynamic
Type ? for a list

Going to sleep forever...
System initialization completed...console going online.
Copyright (c) Ruckus Networks, Inc. All rights reserved.
UNIT 1: compiled on Sep 23 2019 at 00:00:25 labeled as SPR08090d
(32539748 bytes) from Primary SPR08090d.bin (Non-UFI)
SW: Version 08.0.90dT213
Compressed Primary Boot Code size = 786944, Version:10.1.15T225 (mnz10115)
Compiled on Thu Jan 31 07:08:55 2019

HW: Stackable ICX7150-C12-POE
==========================================================================
UNIT 1: SL 1: ICX7150-C12-2X1G POE 12-port Management Module
Serial #:FEK3849R29N
Software Package: ICX7150_BASE_L3_SOFT_PACKAGE
Current License: 2X1G
P-ASIC 0: type B160, rev 11 Chip BCM56160_B0
==========================================================================
UNIT 1: SL 2: ICX7150-2X1GC 2-port 2G Module
==========================================================================
UNIT 1: SL 3: ICX7150-2X10GF 2-port 20G Module
==========================================================================
1000 MHz ARM processor ARMv7 88 MHz bus
8192 KB boot flash memory
2048 MB code flash memory
1024 MB DRAM
STACKID 1 system uptime is 9 second(s)
The system started at 00:12:27 GMT+00 Sat Jan 01 2000

The system : started=cold start

======================================================================================
=============== WARNING: FI image is not booted from UFI!!! ===============
====== Please download UFI image and reboot the system for full functionality ======
======================================================================================

Press Enter key to login

Successfully notified stack role 'none' to hmond

Creating certificate, please wait...

SSL Client Certificate is successfully created

Press Enter key to login

PS 1, Internal Power supply detected.
PS 1, Internal Power supply is up.
PoE: Stack unit 1 PS 1, Internal Power supply with 124000 mwatts capacity is up
PoE Info: Adding new 54V capacity of 124000 mW, total capacity is 124000, total free capacity is 124000
PoE Info: PoE module 1 of Unit 1 on ports 1/1/1 to 1/1/12 detected. Initializing....
2000 log entries of PoE Event Trace Log Buffer is allocated on unit 1 for unit 1
PoE Event Trace Logging enabled for unit 1
PoE Info: PoE module 1 of Unit 1 initialization is done.
TFTP session timed out
TFTP session timed out
TFTP session timed out

User Access Verification

As you can see from above that it is throwing a warning about FI image. This is where I am right now.

[sumantacdas]

BTW, I have only shared what I have done till yesterday. 

Let me now go through the new stuff that you have shared and revert back to you.

[aalvarez6]

Hello @sumantacdas 

From the last output looks like the switch is able to boot using the primary partition, are the APs still down?If they are, can you please share a show inline power and show inline power detail with us?

The non-UFI warning means that you need to boot the system using a UFI image, if you have a USB drive I recommend that you upgrade the switch to 8095g UFI or re-flash the image to 8090d UFI, here is how to do it: https://www.dentonsolutions.com/2018/08/01/ruckus-switch-firmware-upgrade-how-to/

Please let us know how it goes. 

Best Regards,

Ayleth Alvarez | Sr Technical Support Engineer | TAC Wired 

[sumantacdas]

Hi. Yes, the APs are still down.

Please find the output of the two commands that you asked for.

ICX7150-C12-Router>show inline power

Power Capacity: Total is 124000 mWatts. Current Free is 124000 mWatts.

Power Allocations: Requests Honored 11 times

Port Admin Oper ---Power(mWatts)--- PD Type PD Class Pri Fault/
State State Consumed Allocated Error
--------------------------------------------------------------------------
1/1/1 On Non-PD 0 0 n/a n/a 3 n/a
1/1/2 On Off 0 0 n/a n/a 3 n/a
1/1/3 On Off 0 0 n/a n/a 3 n/a
1/1/4 On Off 0 0 n/a n/a 3 n/a
1/1/5 On Off 0 0 n/a n/a 3 n/a
1/1/6 On Off 0 0 n/a n/a 3 n/a
1/1/7 On Off 0 0 n/a n/a 3 n/a
1/1/8 On Off 0 0 n/a n/a 3 n/a
1/1/9 On Off 0 0 n/a n/a 3 n/a
1/1/10 On Off 0 0 n/a n/a 3 n/a
1/1/11 On Off 0 0 n/a n/a 3 n/a
1/1/12 On Off 0 0 n/a n/a 3 n/a
--------------------------------------------------------------------------
Total 0 0

ICX7150-C12-Router>show inline power detail

Power Supply Data On unit 1:
++++++++++++++++++

Power Supply Data:
++++++++++++++++++

Power Supply #1:
Max Curr: 2.3 Amps
Voltage: 54.0 Volts
Capacity: 124 Watts
PoePower: 124 Watts

POE Details Info. On Unit 1 :

General PoE Data:
+++++++++++++++++

Firmware
Version
----------------
02.1.1 Build 002

Hardware
Version
----------------
V2R4

Cumulative Port State Data:
+++++++++++++++++++++++++++

#Ports #Ports #Ports #Ports #Ports #Ports #Ports
Admin-On Admin-Off Oper-On Oper-Off Off-Denied Off-No-PD Off-Fault
-------------------------------------------------------------------------
12 0 0 12 0 11 0

Cumulative Port Power Data:
+++++++++++++++++++++++++++

#Ports #Ports #Ports Power Power
Pri: 1 Pri: 2 Pri: 3 Consumption Allocation
-----------------------------------------------
0 0 12 0.000 W 0.000 W

ICX7150-C12-Router>

[sumantacdas]

@Nidhihegde , @aalvarez6, anyone?

The ICX switch seems to be working fine. I connected a LAN cable to the switch and then to my laptop. It assigned an IP and I was able to access internet.

I have then connected the fat blue PoE cable to one of the 12 sockets which then connects to the R510 ap at the PoE socket. On doing so I found that the PWR led is slowly blinking red. And that's it. Nothing else is happening. What to do next?

The R510 ap is