topic ICX6610-48P - PoE Error: Device 0/1 failed to start on PoE module in ICX Switches

ICX6610-48P - PoE Error: Device 0/1 failed to start on PoE module

shane_waldrop — Fri, 23 Nov 2018 17:28:02 GMT

Upon boot-up (cold or reload) the switch is failing to initialize the PoE module. Is there anything I can try to resolve this?

ICX6610-48P Router>PoE Info: PoE module 1 of Unit 1 on ports 1/1/1 to 1/1/48 det ected. Initializing....
PoE Error: Device 0 failed to start on PoE module.
PoE Error: Device 1 failed to start on PoE module.
Resetting module in slot 1 again to recover from dev fault
PoE Info: Hard Resetting in slot 1....
PoE Info: Resetting module in slot 1....completed.
PoE Error: Device 0 failed to start on PoE module.
PoE Error: Device 1 failed to start on PoE module.

Re: ICX6610-48P - PoE Error: Device 0/1 failed to start on PoE module

oscar_badilla — Fri, 23 Nov 2018 18:12:58 GMT

Good afternoon Shane. Sorry to hear you are having PoE issues with your ICX6610. If you have already tried to reload the unit with no success, I would advise trying to re-install the PoE Firmware. I am not sure the version you are running, but you can just download the file from the Ruckus website, locate the file in a TFTP server and run the command below:

- device # inline power install-firmware stack-unit 1 tftp

It could be that the Firmware is corrupted and re-installing it will help.

If no luck with that, please run the command “show inline power detail” and open a case with TAC for further support.

Hope this information helps. Have a great day.

Re: ICX6610-48P - PoE Error: Device 0/1 failed to start on PoE module

hashim_bharooc1 — Fri, 23 Nov 2018 18:44:24 GMT

Hi Shane,
Please try to upgrade to the latest code train for the version of code you are running.
If the upgrade does not work please open a case with Ruckus TAC to replace the switch.

I recommend doing an upgrade of the boot code, the image version and the POE firmware to latest version on your code stream for example for 8030 code 8030s to try to recover the POE.

If the upgrade does not work then you will need to proceed by replacing the switch.

Here is how to perform an upgrade with a TFTP server.

1) Go to the Ruckus site https://support.ruckuswireless.com/ and download the software to your desktop and un-compress the files. We need to s

2) We need a TFTP server installed to copy the files.

3) Make sure your tftp server has IP connectivity to the Switch and has the files in the root directory of TFTP Server.

4) From the switch run the following commands:

For the boot:

Switch# copy tftp flash bootrom

Once it is copied, you can continue with the image:

Switch# copy tftp flash primary

(Either the primary or secondary partition need to be selected.)

Once the files are copied you need to save the configuration by running the “write memory" command

Then we need to make sure that the system will boot from where you copied the files to, by running the following command:

Switch#(config) boot system flash primary or Switch#(config) boot system flash secondary.

Switch#(config) write memory

Switch# reload (this will restart the switch) SO please make sure you have a downtime arranged before running this command.

Finally, you can confirm that the system boots using the new software by issuing the command: “show version “

POE FIRMWARE UPGRADE

1) Download the PoE firmware to a TFTP server

2) We need to be able to ping the IP address of the TFTP server from the switch.

3) Enter the following command:

Switch# inline power install-firmware stack-unit 1 tftp a.b.c.d

In the example above the letter "a.b.c.d" is IP address of the tftp server and then we enter the file name containing (_poeplus_02.1.0.b002.fw) and click enter.

4) We need to save the configuration by issuing the command "write memory" from privilege mode.

Switch#write memory

Re: ICX6610-48P - PoE Error: Device 0/1 failed to start on PoE module

shane_waldrop — Fri, 23 Nov 2018 20:13:50 GMT

Below is a full flash from A to B and still no joy on the POE module. Any other ideas?

Monitor>copy tftp flash 192.168.0.220 grz10100.bin boot
Loading image from Tftp server..TFTP: received error request -- code 1

Monitor>copy tftp flash 192.168.0.220 grz10100.bin boot
Loading image from Tftp server.................................................................Done
Programming boot flash, please wait..
Erasing....
Writing
Done
Monitor>copy tftp flash 192.168.0.220 fcxr08030sa.bin primary
......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................Done
.Monitor>factory set-default
This command will remove configuration and keys detail.
Do you want to continue? (Y/N) y
Done.
Monitor>reset
ICX Boot Code Version 10.1.00 (grz10100)
Enter 'a' to stop at memory test
Enter 'b' to stop at boot monitor
BOOT INFO: load monitor from boot flash, cksum = 71f1
BOOT INFO: verify flash files....
BOOT INFO: load image from primary copy...

platform type = 12
PCIE-1 LTSSM status: 22
PCIE Switch status: 0
..............................
Firmware integrity checksum passed
.......
Starting Main Task .Applying factory defaults..
INFO: startup config data is not available, try to read from backup
INFO: startup config data in the backup area is not available
..CPSS DxCh Version: cpss3.4p1 release
Pre Parsing Config Data ...
INFO: empty config data in the primary area, try to read from backup
INFO: empty config data in the backup area also

Parsing Config Data ...
INFO: empty config data in the primary area, try to read from backup
INFO: empty config data in the backup area also

System initialization completed...console going online.
Copyright (c) 1996-2016 Brocade Communications Systems, Inc. All rights reserved.
UNIT 1: compiled on Aug 31 2018 at 07:07:11 labeled as FCXR08030sa
(10539398 bytes) from Primary fcxr08030sa.bin
SW: Version 08.0.30saT7f3
Boot-Monitor Image size = 370695, Version:10.1.00T7f5 (grz10100)
HW: Stackable ICX6610-48-HPOE
==========================================================================
UNIT 1: SL 1: ICX6610-48P POE 48-port Management Module
Serial #: BXK3805L04D
License: ICX6610_ADV_ROUTER_SOFT_PACKAGE (LID: dzmINFKnFJf)
P-ENGINE 0: type E02B, rev 01
P-ENGINE 1: type E02B, rev 01
==========================================================================
UNIT 1: SL 2: ICX6610-QSFP 10-port 160G Module
==========================================================================
UNIT 1: SL 3: ICX6610-8-port Dual Mode(SFP/SFP+) Module
==========================================================================
800 MHz Power PC processor 8544E (version 0021/0023) 400 MHz bus
65536 KB flash memory
512 MB DRAM
STACKID 1 system uptime is 2 minute(s) 32 second(s)
The system : started=warm start reloaded=by "reload"

ICX6610-48P Router>
Power supply 2 detected.

Power supply 2 detected.
Power supply 2 is up.
PoE: Stack unit 1 Power supply 2 with 748000 mwatts capacity is up
PoE Info: Adding new 55V capacity of 748000 mW, total capacity is 748000, total free capacity is 748000
PoE Info: PoE module 1 of Unit 1 on ports 1/1/1 to 1/1/48 detected. Initializing....
PoE Event Trace Log Buffer for 2000 log entries allocated
PoE Event Trace Logging enabled...
PoE Error: Device 0 failed to start on PoE module.
PoE Error: Device 1 failed to start on PoE module.
Resetting module in slot 1 again to recover from dev fault
PoE Info: Hard Resetting in slot 1....
PoE Info: Resetting module in slot 1....completed.
PoE Error: Device 0 failed to start on PoE module.
PoE Error: Device 1 failed to start on PoE module.

BAD_POE#inline power install-firmware stack-unit 1 tftp 192.168.0.220 fcx_poeplus_02.1.0.b004.fw
BAD_POE#Flash Memory Write (8192 bytes per dot) .........
tftp download successful file name = poe-fw
Sending PoE Firmware to Unit 1.

#show inline power detailPower Supply Data On stack 1:
++++++++++++++++++

Power Supply Data:
++++++++++++++++++

power supply 1 is not present
Power Supply #2:
Max Curr: 13.6 Amps
Voltage: 55.0 Volts
Capacity: 748 Watts

POE Details Info. On Stack 1 :

General PoE Data:
+++++++++++++++++

Firmware
Version
----------------
02.1.0 Build 004

Cumulative Port State Data:
+++++++++++++++++++++++++++

#Ports #Ports #Ports #Ports #Ports #Ports #Ports
Admin-On Admin-Off Oper-On Oper-Off Off-Denied Off-No-PD Off-Fault
-------------------------------------------------------------------------
5 43 0 48 0 0 0

Cumulative Port Power Data:
+++++++++++++++++++++++++++

#Ports #Ports #Ports Power Power
Pri: 1 Pri: 2 Pri: 3 Consumption Allocation
-----------------------------------------------
0 0 5 0.0 W 0.0 W

#show version

Copyright (c) 1996-2016 Brocade Communications Systems, Inc. All rights reserved.
UNIT 1: compiled on Aug 31 2018 at 07:07:11 labeled as FCXR08030sa
(10539398 bytes) from Primary fcxr08030sa.bin
SW: Version 08.0.30saT7f3
Boot-Monitor Image size = 370695, Version:10.1.00T7f5 (grz10100)
HW: Stackable ICX6610-48-HPOE
==========================================================================
UNIT 1: SL 1: ICX6610-48P POE 48-port Management Module
Serial #: BXK3805L04D
License: ICX6610_ADV_ROUTER_SOFT_PACKAGE (LID: dzmINFKnFJf)
P-ENGINE 0: type E02B, rev 01
P-ENGINE 1: type E02B, rev 01
==========================================================================
UNIT 1: SL 2: ICX6610-QSFP 10-port 160G Module
==========================================================================
UNIT 1: SL 3: ICX6610-8-port Dual Mode(SFP/SFP+) Module
==========================================================================
800 MHz Power PC processor 8544E (version 0021/0023) 400 MHz bus
65536 KB flash memory
512 MB DRAM
STACKID 1 system uptime is 24 minute(s) 50 second(s)
The system : started=warm start reloaded=by "reload"

#reload
PoE: Stack unit 1 Power supply 2 with 748000 mwatts capacity is up
PoE Info: Adding new 55V capacity of 748000 mW, total capacity is 748000, total free capacity is 748000
PoE Info: PoE module 1 of Unit 1 on ports 1/1/1 to 1/1/48 detected. Initializing....
PoE Event Trace Log Buffer for 2000 log entries allocated
PoE Event Trace Logging enabled...
PoE Error: Device 0 failed to start on PoE module.
PoE Error: Device 1 failed to start on PoE module.
Resetting module in slot 1 again to recover from dev fault
PoE Info: Hard Resetting in slot 1....
PoE Info: Resetting module in slot 1....completed.
PoE Error: Device 0 failed to start on PoE module.
PoE Error: Device 1 failed to start on PoE module.

Re: ICX6610-48P - PoE Error: Device 0/1 failed to start on PoE module

hashim_bharooc1 — Sat, 24 Nov 2018 21:12:33 GMT

Hi Shane,
If you run command: "show inline power detail" and "show inline power detail debug-info" do you see the POE version for the POE chip. If you do not see the POE chip and it's hardware version in above commands most likely the POE has been busted. In that case you will need RMA.

Seems like Power supplies are OK but not sure about POE chip showing with the above command.

I think this might be a damaged POE chip as you got the latest firmware as well.

Please open a ticket and request RMA and provide the outputs I requested as well the mention you went to latest 8030 code.
LINK for opening a new ticket with TAC:
https://support.ruckuswireless.com/cases/new

Re: ICX6610-48P - PoE Error: Device 0/1 failed to start on PoE module

netwizz — Mon, 26 Nov 2018 13:51:44 GMT

Do me a huge favor... Do a "sh chassis"

I have had an ICX 6430-48P a couple years ago that had a PoE failure, and the power supply showed as bad under the "sh chassis"

Let's just rule that out, first... because those are less effort to replace than the entire switch chassis.

Re: ICX6610-48P - PoE Error: Device 0/1 failed to start on PoE module

shane_waldrop — Mon, 26 Nov 2018 15:30:36 GMT

#show inline power detail

Power Supply Data On stack 1:
++++++++++++++++++

Power Supply Data:
++++++++++++++++++

power supply 1 is not present
Power Supply #2:
Max Curr: 13.6 Amps
Voltage: 55.0 Volts
Capacity: 748 Watts

POE Details Info. On Stack 1 :

General PoE Data:
+++++++++++++++++

Firmware
Version
----------------
02.1.0 Build 004

Cumulative Port State Data:
+++++++++++++++++++++++++++

#Ports #Ports #Ports #Ports #Ports #Ports #Ports
Admin-On Admin-Off Oper-On Oper-Off Off-Denied Off-No-PD Off-Fault
-------------------------------------------------------------------------
5 43 0 48 0 0 0

Cumulative Port Power Data:
+++++++++++++++++++++++++++

#Ports #Ports #Ports Power Power
Pri: 1 Pri: 2 Pri: 3 Consumption Allocation
-----------------------------------------------
0 0 5 0.0 W 0.0 W

------------------------------------------------------------------------------------------------

#sh chassis
The stack unit 1 chassis info:

Power supply 1 not present
Power supply 2 (AC - PoE) present, status ok
Model Number: 23-0000142-02
Serial Number: FSG
Firmware Ver: B
Power supply 2 Fan Air Flow Direction: Front to Back

Fan 1 ok, speed (auto): [[1]]<->2
Fan 2 ok, speed (auto): [[1]]<->2

Fan controlled temperature: 44.5 deg-C

Fan speed switching temperature thresholds:
Speed 1: NM<----->84 deg-C
Speed 2: 79<-----> 87 deg-C (shutdown)

Fan 1 Air Flow Direction: Front to Back
Fan 2 Air Flow Direction: Front to Back
MAC 1 Temperature Readings:
Current temperature : 30.0 deg-C
MAC 2 Temperature Readings:
Current temperature : 41.5 deg-C
CPU Temperature Readings:
Current temperature : 42.5 deg-C
sensor A Temperature Readings:
Current temperature : 28.5 deg-C
sensor B Temperature Readings:
Current temperature : 33.5 deg-C
sensor C Temperature Readings:
Current temperature : 34.5 deg-C
stacking card Temperature Readings:
Current temperature : 44.5 deg-C
Warning level.......: 82.0 deg-C
Shutdown level......: 87.0 deg-C
Boot Prom MAC : cc4e.24bf.fa24
Management MAC: cc4e.24bf.fa24
-----------------------------------------------------------------------------------------

I couldn't find anything on additional commands to type after "detail"

#show inline power detail debug-info
Invalid input -> debug-info
Type ? for a list

Thanks guys for trying to help out. Any ideas?

Re: ICX6610-48P - PoE Error: Device 0/1 failed to start on PoE module

netwizz — Mon, 03 Dec 2018 13:58:31 GMT

I think you need to RMA

Re: ICX6610-48P - PoE Error: Device 0/1 failed to start on PoE module

shane_waldrop — Mon, 03 Dec 2018 15:04:36 GMT

Unfortunately, I'm not able to RMA it because it was purchased used. I was hoping there was something that could be done but after all the help so far, concerning this issue, it just wan't meant to be. Thank you everyone.

Re: ICX6610-48P - PoE Error: Device 0/1 failed to start on PoE module

netwizz — Mon, 03 Dec 2018 15:11:01 GMT

Gosh... Have you tried engaging the seller then? I have always worked for the initial purchaser, who is my employer, but if I were a seller and this happened, I would probably RMA it for you at most charging you shipping.

Ruckus actually covers the shipping in our case they send the replacement with a return label. That said, we have had very few devices fail overall... Not a single 6610 at this point in time *knocks on wood*