12-29-2023 12:10 PM
ICX-7150 -C12P will not reset after power outage, system light continually flashes green. I have done the hard reset a dozen times and it returns to a flashing green light on the system LED. I have done the software recovery several times and it still ends up going back to a flashing green light. below is the message I get after resetting.
Backtrace:
[<c0225518>] (hex_dump_to_buffer) from [<c0225a8c>] (print_hex_dump+0xa4/0x118)
[<c02259e8>] (print_hex_dump) from [<c01ca444>] (ubifs_dump_node+0x97c/0xbe0)
[<c01c9ac8>] (ubifs_dump_node) from [<c01a8224>] (ubifs_check_node+0x1c0/0x308)
[<c01a8064>] (ubifs_check_node) from [<c01af8e4>] (ubifs_scan_a_node+0xd0/0x1f4)
[<c01af814>] (ubifs_scan_a_node) from [<c01c1f80>] (ubifs_recover_leb+0x578/0x7e0)
[<c01c1a08>] (ubifs_recover_leb) from [<c01b11f0>] (ubifs_replay_journal+0xdd0/0x1540)
[<c01b0420>] (ubifs_replay_journal) from [<c01a5adc>] (ubifs_mount+0x1190/0x192c)
[<c01a494c>] (ubifs_mount) from [<c00d9bdc>] (mount_fs+0x14/0x40)
[<c00d9bc8>] (mount_fs) from [<c00f1bf4>] (vfs_kern_mount+0x50/0xf8)
[<c00f1ba4>] (vfs_kern_mount) from [<c00f4cc4>] (do_mount+0x1a8/0xc40)
[<c00f4b1c>] (do_mount) from [<c00f5acc>] (SyS_mount+0x7c/0xa8)
[<c00f5a50>] (SyS_mount) from [<c000a4a0>] (ret_fast_syscall+0x0/0x3c)
Code: 02a0cee5 cf00000a 010054e1 d100003a (0130f7e5)
[BrcdSoftlockup]: BUG: soft lockup - CPU#0 stuck for 690s! [mount:565]
---[ end trace 4f6ee43f2f722965 ]---
note: mount[565] exited with preempt_count 1
Segmentation fault
Mounting Config partition failed, non-recoverable file system corruption
Reformatting the flash, please download config and keys again ...
ubidetach: error!: cannot detach mtd2
error 16 (Device or resource busy)
ubiformat: error!: please, first detach mtd2 (/dev/mtd2) from ubi0
Formatting Doneubi0 error: ubi_attach_mtd_dev: mtd2 is already attached to ubi0
ubiattach: error!: cannot attach mtd2
error 17 (File exists)
ubimkvol: error!: UBI device does not have free logical erasebloubi1: attaching mtd3
cks
!!!ERROR:ubimkvol failed for config partition
ubi1: scanning is finished
ubi1: attached mtd3 (name "resources", size 512 MiB)
ubi1: PEB size: 1048576 bytes (1024 KiB), LEB size: 1040384 bytes
ubi1: min./max. I/O unit sizes: 4096/4096, sub-page size 4096
ubi1: VID header offset: 4096 (aligned 4096), data offset: 8192
ubi1: good PEBs: 504, bad PEBs: 8, corrupted PEBs: 0
ubi1: user volume: 1, internal volumes: 1, max. volumes count: 128
ubi1: max/mean erase counter: 1/0, WL threshold: 4096, image sequence number: 2109703266
ubi1: available PEBs: 0, total reserved PEBs: 504, PEBs reserved for bad PEB handling: 32
ubi1: background thread "ubi_bgt1d" started, PID 582
UBIFS (ubi1:0): background thread "ubifs_bgt1_0" started, PID 586
UBIFS (ubi1:0): recovery needed
UBIFS (ubi1:0): recovery completed
UBIFS (ubi1:0): UBIFS: mounted UBI device 1, volume 0, name "resources"
UBIFS (ubi1:0): LEB size: 1040384 bytes (1016 KiB), min./max. I/O unit sizes: 4096 bytes/4096 bytes
UBIFS (ubi1:0): FS size: 476495872 bytes (454 MiB, 458 LEBs), journal size 23928832 bytes (22 MiB, 23 LEBs)
UBIFS (ubi1:0): reserved for root: 4952683 bytes (4836 KiB)
UBIFS (ubi1:0): media format: w4/r0 (latest is w4/r0), UUID C0C4B1D3-A91F-41C1-96D9-1C56C51301CD, small LPT model
UBIFS (ubi1:0): full atime support is enabled.
Resource partition is mounted!!
Restore is Done
Kernel crashdump is disabled.
Backup is fine
dma_mem_base: 0x96000000, dma_mem_len: 0x8000000, warm_mem_base: 0x9f500000, warm_mem_len: 0xb00000
Creating TUN device
Starting TPM Infra
Group tss and User tss created
kernel.hostname = localhost
hostname set to localhost
Starting TCSD Daemon
TCSD Up and Running
Enabling time stamp.
Starting the FastIron.
USER=root
HOME=/
GCOV_PREFIX=/fast_iron
ethaddr=d4:c1:9e:88:72:a5?
TERM=vt102
PATH=/sbin:/usr/sbin:/bin:/usr/bin
crashkernel=64M@0x70000000
ip=192.168.0.3:192.168.0.2:192.168.0.2:255.255.255.0:MN:eth0:off
SHELL=/bin/sh
PWD=/
i2c-0 i2c Broadcom iProc I2C adapter I2C adapter 2
i2c-1 i2c Broadcom iProc I2C adapter I2C adapter 2
!!!WARNING: Unable to read Filesystem information!!!
Total no. of blocks in FS = 0
Total no. of free blocks = 0
FIPS Disabled:PORT NOT DISABLED
platform type 90
OS>
Loaded Image SPS08080f from Pri Built on (UTC): Tue Apr 7 05:34:07 2020
Enabling Console Logging
Applying factory defaults..
flash_file=0.
INFO: startup config data is not available, try to read from backup
INFO: startup config data in the backup area is not available
Hotplugger Daemon Initialized ..
External USB disk is not mounted or plugged in.
set_board_level: gi_board_type = 116[ 803.281214] linux-kernel-bde: map phys range 0x3200000-0x3240000 to 0xb0e01000-0xb0e41000
[ 803.463811] linux-kernel-bde: map phys range 0x88100000-0x90100000 to 0xa8d00000-0xb0d00000
DMA pool size: 134217728
PHY Reset De-asserted
sw_pp_sdk_init:137 ToR init
SOC unit 0 attached to PCI device BCM56160_B0
license: system does not have any SAU license, then set its default SAU option
Firmware version from File: 2.1.1
Pre Parsing Config Data ...
INFO: empty config data in the primary area, try to read from backup
INFO: empty config data in the backup area also
***********************************************************
Reading from Booted Active partition=0
***********************************************************
Per Dot(.) represents 65536 Bytes
................
***********************************************************
Writing to non-Active partition=1
***********************************************************
Each Dot(.) represents 65536 bytes
............
completed
Please advise. Thanks.
Solved! Go to Solution.
01-02-2024 12:43 PM
Hi @Spencer
Thank you for sharing the requested information.
Based on the troubleshooting done, your ICX-7150-C12P Switch is unable to provide a console access and there is no IP Address getting assigned to it by the Router to access CLI. Even you tried to hard reset it. However, the failure persists. This Switch unit Should be RMA (Return Merchandise Authorization) in simple words replacing it.
Feel free to contact us via chat, comment you already have a post, copy the link from the post (URL), and paste it into the chat to start the unit replacement.
Please follow the steps as shown in the below example:
As shown in the below picture, copy the link and share it via chat from the link provided below:
The below link is to contact us by chat (only)
https://support.ruckuswireless.com/contact-us
Did I answer your queries? If yes, hit the Kudos buttons and also accept the answers as Accepted solutions.
Please let me know if you have any queries in this regard.
Thank you again for your patience and understanding.
Best regards,
Imran Sanadi
RUCKUS Lennar Home Community.
01-02-2024 10:03 AM
Hi @Spencer
Thank you for the information you shared.
Please try to password recovery as described below and try to get the console to the Switch once again.
Short Guide for Password Recovery:
Video link as a reference: https://www.youtube.com/watch?v=XJS28DWbHM4
1. Start a CLI session over the serial (console access) interface to the RUCKUS ICX device.
2-Enter OS mode. This uses a key combination and drops below the Fastron operating system
Key Combination: Ctrl+y, release, tap 'm', tap 'Enter'
OS>
3-just write reset
OS>reset
4-While the system is booting, before the initial system prompt appears,
enter b to enter the boot monitor mode.
Enter 'b' to stop at boot monitor: 0
In this part, you have to press B before the counter ends
5-Enter no password. (You cannot abbreviate this command.)
ICX7650-Boot> no password
00 00 00 00
OK! Skip password check when the system is up.
6-Enter boot. This command causes the device to bypass the system password
check.
ICX7650-Boot> boot
7-After the console prompt reappears, assign a new password.
Reset your new credentials as mentioned in the steps below:
Edit the current or create a new password and username by using the below commands:
enable
configure terminal
device(config)# username super password pass
Where the username is ’super’ and password ‘pass’
In order to allow the correct authentication please run the following commands:
Device(config)#crypto key generate rsa
device(config)#aaa authentication login default local
Now you could try using your new credentials to log in on Console. (If new credentials do not work, please wait for some time and try again later)
Please let me know if you have any queries in this regard.
Thank you again for your patience and understanding.
Best regards,
Imran Sanadi
RUCKUS Lennar Home Community.
01-02-2024 10:56 AM
Steps 1 -3 above were not an option for me, like I said the first screen I come to when I enter via putty is blank, when I press crtl+y nothing happens. So I went to step 4, like I said i can get to ICX7650-Boot> prompt by hitting the reset button with a paperclip and entering "b" at the boot monitor. When I enter the no password command under boot and then enter boot the system just begins to reboot and below is the end result when it stops. Please look at what I am sending you for what is being displayed, does it provide any insight as to what is going on. From my reading it seems like something is missing because of the "empty config data" message at the end of the string. See below.
ff ff ff ff ff ff ff ff ff ff ff
00031f20: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
00031f40: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
00031f60: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
00031f80: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
00031fa0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
Unable to handle kernel paging request at virtual address f0ca1000
pgd = d092c000
[f0ca1000] *pgd=86163811, *pte=00000000, *ppte=00000000
Internal error: Oops - BUG: 7 [#1] PREEMPT SMP ARM
Modules linked in:
CPU: 0 PID: 565 Comm: mount Not tainted 4.4.0 #0
Hardware name: BRCM XGS iProc
task: e51a3900 ti: d0918000 task.ti: d0918000
PC is at hex_dump_to_buffer+0x158/0x4d0
LR is at 0xd0919b9a
pc : [<c0225670>] lr : [<d0919b9a>] psr: 20000213
sp : d0919b00 ip : 00000034 fp : d0919b4c
r10: 00000020 r9 : c0432298 r8 : 00000020
r7 : f0ca0fff r6 : 00000010 r5 : 00000066 r4 : 00000083
r3 : 00000066 r2 : 00000030 r1 : 00000032 r0 : 00000031
Flags: nzCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment none
Control: 12c5387d Table: 7192c059 DAC: 00000051
Process mount (pid: 565, stack limit = 0xd0918190)
Stack: (0xd0919b00 to 0xd091a000)
9b00: c0066134 c0065a4c 00000001 f0ca0ff0 00000061 00000000 00000020 00000020
9b20: d0919b74 00000020 00031fc0 0804e820 d0919b6d 00000002 f0ca0ff0 c051ca08
9b40: d0919c1c d0919b50 c0225a8c c0225524 d0919b6d 00000083 00000000 c05aec50
9b60: 00000000 c04d83f8 d0919bd4 d0666620 66662066 66206666 20666620 66662066
9b80: 66206666 20666620 66662066 66206666 20666620 66662066 66206666 20666620
9ba0: 66662066 66206666 20666620 66662066 66206666 20666620 66662066 66206666
9bc0: 20666620 66662066 66206666 00919bd8 c0066134 c0065a4c c04e9ac0 d0919c14
9be0: d0919c0c d0919bf0 c00a1064 c0066114 c01c96cc f0c6f030 08080800 e51f7000
9c00: f0c6f000 000000e4 c042963c c042a148 d0919c94 d0919c20 c01ca444 c02259f4
9c20: 00000001 f0c6f030 08080800 00000000 00000041 20103532 2836352c 20646174
9c40: 612c2031 30363231 39342900 c0065a4c c04e5754 d0919c8c d0919c84 d0919c68
9c60: c00a1064 c0066114 c05b55a6 ffffffea 000cc000 e51f7000 f0c6f000 000000e4
9c80: c042963c c042a148 d0919ccc d0919c98 c01a8224 c01c9ad4 c042963c 000000e4
9ca0: 000cc000 c042a148 f0c6f000 e51f7000 000000e4 000000e4 00032000 f0c6f000
9cc0: d0919cfc d0919cd0 c01af8e4 c01a8070 00000000 00000001 000cc000 000cc000
9ce0: d0919d4c 000cc000 d0b6fdc0 e51f7000 d0919d4c d0919d00 c01c1f80 c01af820
9d00: 000cc000 00000000 d0b6b748 00000200 00000001 f0ba3000 00000000 fffffffd
9d20: d0919d4c 00000000 000158db 000000e4 d0b6b748 d0a80d80 e51f7000 d0b6b748
9d40: d0919e2c d0919d50 c01b11f0 c01c1a14 00000002 00000001 00000000 000158db
9d60: 00000000 d0919dc8 00000000 00000000 00000000 01524c00 e51f793c e51f7a2c
9d80: d0a80d00 e51f7a2c d0919dfc f0da1000 e51f7a34 d0919da0 00000000 00000000
9da0: 00000000 000156df c05b6ed0 00000000 d0b6b740 d0919df8 0000006a d0919dc8
9dc0: 000000e3 e51f7000 00000000 00000018 31181006 d0919de0 c01bd670 c01a7da8
9de0: 0000000d 00000001 00001000 00000002 00000002 000fe000 f0da100c 00000004
9e00: 000fdf10 e51f7000 e51f7000 00000000 000fdf10 e534d800 e51f7008 00000000
9e20: d0919ec4 d0919e30 c01a5adc c01b042c e51f78a4 d0919e40 c00b8170 c040f4ec
9e40: d0919e64 d0919e50 c00d23e0 d0919e64 c05b6ea8 00000004 80000213 00009d00
9e60: 00000000 000fe000 00000000 01cc6000 00000000 01760e00 e53016c0 e51f78e8
9e80: e51f7250 c058c1e0 e51f7000 e534ee80 d0919eac e534ea45 c00b8204 e53016c0
9ea0: e534ea40 00008010 00000000 c05950cc c0590e9c c05950cc d0919edc d0919ec8
9ec0: c00d9bdc c01a4958 00000000 e53016c0 d0919f04 d0919ee0 c00f1bf4 c00d9bd4
9ee0: 00000000 00000000 00000020 00008010 e534ea40 e534e180 d0919f6c d0919f08
9f00: c00f4cc4 c00f1bb0 00000000 e534ea40 0000000c 00000000 0000000c c00b43b0
9f20: 0000000c 00001000 e5019010 e4c054c8 d0919f5c d0919f40 c00b4420 c00b4338
9f40: bea21f10 e534e180 e534ea40 00000000 00008010 bea21f1c d0918000 00000000
9f60: d0919fa4 d0919f70 c00f5acc c00f4b28 00000000 d0919f80 c00c46c0 00000000
9f80: b6e61000 00000000 00000000 000000d8 00000015 c000a664 00000000 d0919fa8
9fa0: c000a4a0 c00f5a5c 00000000 00000000 bea21f10 bea21f1c bea21f02 00008010
9fc0: 00000000 00000000 000000d8 00000015 00000000 00000000 b6f0d000 00000000
9fe0: b6e11071 bea21a18 00051149 b6e11078 80000230 bea21f10 495c6094 077fa3cd
Backtrace:
[<c0225518>] (hex_dump_to_buffer) from [<c0225a8c>] (print_hex_dump+0xa4/0x118)
[<c02259e8>] (print_hex_dump) from [<c01ca444>] (ubifs_dump_node+0x97c/0xbe0)
[<c01c9ac8>] (ubifs_dump_node) from [<c01a8224>] (ubifs_check_node+0x1c0/0x308)
[<c01a8064>] (ubifs_check_node) from [<c01af8e4>] (ubifs_scan_a_node+0xd0/0x1f4)
[<c01af814>] (ubifs_scan_a_node) from [<c01c1f80>] (ubifs_recover_leb+0x578/0x7e0)
[<c01c1a08>] (ubifs_recover_leb) from [<c01b11f0>] (ubifs_replay_journal+0xdd0/0x1540)
[<c01b0420>] (ubifs_replay_journal) from [<c01a5adc>] (ubifs_mount+0x1190/0x192c)
[<c01a494c>] (ubifs_mount) from [<c00d9bdc>] (mount_fs+0x14/0x40)
[<c00d9bc8>] (mount_fs) from [<c00f1bf4>] (vfs_kern_mount+0x50/0xf8)
[<c00f1ba4>] (vfs_kern_mount) from [<c00f4cc4>] (do_mount+0x1a8/0xc40)
[<c00f4b1c>] (do_mount) from [<c00f5acc>] (SyS_mount+0x7c/0xa8)
[<c00f5a50>] (SyS_mount) from [<c000a4a0>] (ret_fast_syscall+0x0/0x3c)
Code: 02a0cee5 cf00000a 010054e1 d100003a (0130f7e5)
[BrcdSoftlockup]: BUG: soft lockup - CPU#0 stuck for 690s! [mount:565]
---[ end trace db2ba77d3ad782b7 ]---
note: mount[565] exited with preempt_count 1
Segmentation fault
Mounting Config partition failed, non-recoverable file system corruption
Reformatting the flash, please download config and keys again ...
ubidetach: error!: cannot detach mtd2
error 16 (Device or resource busy)
ubiformat: error!: please, first detach mtd2 (/dev/mtd2) from ubi0
Formatting Doneubi0 error: ubi_attach_mtd_dev: mtd2 is already attached to ubi0
ubiattach: error!: cannot attach mtd2
error 17 (File exists)
ubimkvol: error!: UBI device does not have free logical erasebloubi1: attaching mtd3
cks
!!!ERROR:ubimkvol failed for config partition
ubi1: scanning is finished
ubi1: attached mtd3 (name "resources", size 512 MiB)
ubi1: PEB size: 1048576 bytes (1024 KiB), LEB size: 1040384 bytes
ubi1: min./max. I/O unit sizes: 4096/4096, sub-page size 4096
ubi1: VID header offset: 4096 (aligned 4096), data offset: 8192
ubi1: good PEBs: 504, bad PEBs: 8, corrupted PEBs: 0
ubi1: user volume: 1, internal volumes: 1, max. volumes count: 128
ubi1: max/mean erase counter: 1/0, WL threshold: 4096, image sequence number: 2109703266
ubi1: available PEBs: 0, total reserved PEBs: 504, PEBs reserved for bad PEB handling: 32
ubi1: background thread "ubi_bgt1d" started, PID 582
UBIFS (ubi1:0): background thread "ubifs_bgt1_0" started, PID 586
UBIFS (ubi1:0): recovery needed
UBIFS (ubi1:0): recovery completed
UBIFS (ubi1:0): UBIFS: mounted UBI device 1, volume 0, name "resources"
UBIFS (ubi1:0): LEB size: 1040384 bytes (1016 KiB), min./max. I/O unit sizes: 4096 bytes/4096 bytes
UBIFS (ubi1:0): FS size: 476495872 bytes (454 MiB, 458 LEBs), journal size 23928832 bytes (22 MiB, 23 LEBs)
UBIFS (ubi1:0): reserved for root: 4952683 bytes (4836 KiB)
UBIFS (ubi1:0): media format: w4/r0 (latest is w4/r0), UUID C0C4B1D3-A91F-41C1-96D9-1C56C51301CD, small LPT model
UBIFS (ubi1:0): full atime support is enabled.
Resource partition is mounted!!
Restore is Done
Kernel crashdump is disabled.
Backup is fine
dma_mem_base: 0x96000000, dma_mem_len: 0x8000000, warm_mem_base: 0x9f500000, warm_mem_len: 0xb00000
Creating TUN device
Starting TPM Infra
Group tss and User tss created
kernel.hostname = localhost
hostname set to localhost
Starting TCSD Daemon
TCSD Up and Running
Enabling time stamp.
Starting the FastIron.
USER=root
HOME=/
GCOV_PREFIX=/fast_iron
ethaddr=d4:c1:9e:88:72:a5?
TERM=vt102
PATH=/sbin:/usr/sbin:/bin:/usr/bin
crashkernel=64M@0x70000000
ip=192.168.0.3:192.168.0.2:192.168.0.2:255.255.255.0:MN:eth0:off
SHELL=/bin/sh
PWD=/
i2c-0 i2c Broadcom iProc I2C adapter I2C adapter 2
i2c-1 i2c Broadcom iProc I2C adapter I2C adapter 2
!!!WARNING: Unable to read Filesystem information!!!
Total no. of blocks in FS = 0
Total no. of free blocks = 0
FIPS Disabled:PORT NOT DISABLED
platform type 90
OS>
Loaded Image SPS08080f from Pri Built on (UTC): Tue Apr 7 05:34:07 2020
Enabling Console Logging
Applying factory defaults..
flash_file=0.
INFO: startup config data is not available, try to read from backup
INFO: startup config data in the backup area is not available
Hotplugger Daemon Initialized ..
External USB disk is not mounted or plugged in.
set_board_level: gi_board_type = 116[ 800.941369] linux-kernel-bde: map phys range 0x3200000-0x3240000 to 0xb0c4f000-0xb0c8f000
[ 801.123708] linux-kernel-bde: map phys range 0x88100000-0x90100000 to 0xa8c4f000-0xb0c4f000
DMA pool size: 134217728
PHY Reset De-asserted
sw_pp_sdk_init:137 ToR init
SOC unit 0 attached to PCI device BCM56160_B0
license: system does not have any SAU license, then set its default SAU option
Firmware version from File: 2.1.1
Pre Parsing Config Data ...
INFO: empty config data in the primary area, try to read from backup
INFO: empty config data in the backup area also
01-02-2024 12:43 PM
Hi @Spencer
Thank you for sharing the requested information.
Based on the troubleshooting done, your ICX-7150-C12P Switch is unable to provide a console access and there is no IP Address getting assigned to it by the Router to access CLI. Even you tried to hard reset it. However, the failure persists. This Switch unit Should be RMA (Return Merchandise Authorization) in simple words replacing it.
Feel free to contact us via chat, comment you already have a post, copy the link from the post (URL), and paste it into the chat to start the unit replacement.
Please follow the steps as shown in the below example:
As shown in the below picture, copy the link and share it via chat from the link provided below:
The below link is to contact us by chat (only)
https://support.ruckuswireless.com/contact-us
Did I answer your queries? If yes, hit the Kudos buttons and also accept the answers as Accepted solutions.
Please let me know if you have any queries in this regard.
Thank you again for your patience and understanding.
Best regards,
Imran Sanadi
RUCKUS Lennar Home Community.