This website uses cookies. By clicking Accept, you consent to the use of cookies. Click Here to learn more about how we use cookies.
Accept
Reject
RUCKUS Self Help |   ASK the Pack
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Ruckus ICX7150 Stuck at Query state while connecting to smartzone

fauzan_slim
New Contributor III

‎08-24-2022 12:41 AM

Hi Ruckus Community,

We have 800++ ICX 7150 switches spread across many locations (branch office) connected to SmartZone in Data Center via Cisco SD-WAN. Almost 30% of the switch are indicated offline in the SmartZone, but actually, they are online and working properly. All the switches which disconnected/offline in the SmartZone are stuck at Query state.
Our switches are :
- all using UFI images
- firmware is vary , some using 08090d some using 08095d
- ports ranging from 24 to 48 port
- the WAN latency between DC and branch is under 100ms

Troubleshooting that we try:
- trigger the 'query registrar'
- disable and enable the manager on the switch side
- doing zeroize on crypto key and re-regenerate the SSL certificate on the switch, the doing restart on the switch 
- not all the switch is offline, even on the same branch we often found that only several switches is indicated offline on the SmartZone

After we do the step above, it appears some switch is back to an online state again, but after several days the switch is back to offline again

the last step we do is restarting all offline switches but this appears doesn't seem to help that much

is there any WAN link or firewall policy consideration or limitation that causing those issues?

13 REPLIES 13

fauzan_slim
New Contributor III
In response to Vineet_nejwala

‎08-24-2022 09:51 PM

Hi  Vineet

Heres the output below ,

ICX SWITCH

1.show version

Copyright (c) Ruckus Networks, Inc. All rights reserved.
UNIT 1: compiled on Sep 23 2019 at 00:00:25 labeled as SPR08090d
(32539748 bytes) from Secondary SPR08090d.bin (UFI)
SW: Version 08.0.90dT213
Compressed Secondary Boot Code size = 786944, Version:10.1.15T225 (mnz10115)
Compiled on Thu Jan 31 07:08:55 2019

HW: Stackable ICX7150-48-POE
==========================================================================
UNIT 1: SL 1: ICX7150-48P-4X1G POE 48-port Management Module
Serial #:FEC3241R015
Software Package: ICX7150_BASE_L3_SOFT_PACKAGE
Current License: 4X1G
P-ASIC 0: type B160, rev 11 Chip BCM56160_B0
==========================================================================
UNIT 1: SL 2: ICX7150-2X1GC 2-port 2G Module
==========================================================================
UNIT 1: SL 3: ICX7150-4X10GF 4-port 40G Module
==========================================================================
1000 MHz ARM processor ARMv7 88 MHz bus
8192 KB boot flash memory
2048 MB code flash memory
1024 MB DRAM
STACKID 1 system uptime is 61 day(s) 13 hour(s) 18 minute(s) 20 second(s)
The system started at 16:23:12 GMT+00 Fri Jun 24 2022

The system : started=warm start reloaded=by "reload"

 
2.show sz status

============ SZ Agent State Info ===================
Config Status: None Operation Status: Enabled
State: SZ QUERY Prev State: SZ SSH CONNECTED Event: SZ QUERY RESPONSE

SWR List : None
Active List : 172.15.98.73, 172.15.98.29
DHCP Option 43 : No
DHCP Opt 43 List : None
Passive List : None
Merged List : 172.15.98.73, 172.15.98.29
Merged Idx: 0 IP : 172.15.98.73
Switch registrar host: sw-registrar.ruckuswireless.com
Switch registrar discovery retry count: 14
Switch registrar host resolve failure count: 14

SZ IP Used : 172.15.98.29
SZ Query Status :
In Progress. Response Not Received.

SSH Tunnel Status - :
Tunnel Status : Not Initiated
CLI IP/Port : /0
SNMP IP/Port : /0
Syslog IP/Port : /0
HTTP SERVER IP/Port: /0
HTTP CLIENT IP/Port: /0

Timer Status : Running
Timer Details in msec
Start Time Stamp : 962187078
Duration : 64601212
Current Time Stamp: 1023435120
Time Left : 3353170


3.sh sz client-log detail

there is no such command in the switch , instead I will display you the 'sh sz logs' command

Aug 24 11:00:56:https_connmgr_send_request>Entered.
Aug 24 11:00:56:sz_execute_state_machine>Exit with state/event: SZ QUERY/5, TIMER/2002 RC: 1
Aug 24 11:00:57:sz_execute_state_machine>Entering with state/event: SZ QUERY/5, SZ QUERY RESPONSE/2007
Aug 24 11:00:57:sz_parse_sz_query_response -- Status: 600 <<
Aug 24 11:00:57:sz_execute_state_machine>Exit with state/event: SZ QUERY/5, SZ QUERY RESPONSE/2007 RC: 1
Aug 24 11:00:57:HTTP Request Error:Http remote connection close called.
Aug 25 03:48:38:Sending SZ_SWR_QUERY_RESTART event...
Aug 25 03:48:38:Failed to resolve sw-registrar.ruckuswireless.com
Aug 25 03:49:38:Failed to resolve sw-registrar.ruckuswireless.com
Aug 25 03:50:38:Failed to resolve sw-registrar.ruckuswireless.com
End i/max/iter 167/167/0

4.show sz server-log detail

there is no such command in the switch

SMARTZONE CONTROLLER

1.vSZ#show service

fauzan_slim_1-1661403102812.png

 

2.vSZ#show version

fauzan_slim_2-1661403102814.png

 

3.vSZ#show system-capacity

fauzan_slim_3-1661403102814.png

 

4.vSZ#show cpuinfo

fauzan_slim_4-1661403102815.png

 

5.vSZ#show diskinfo

fauzan_slim_5-1661403102816.png

 

6.vSZ#show meminfo

fauzan_slim_6-1661403102816.png

 

 

Regards ,

Fauzan

0 Kudos

fauzan_slim
New Contributor III
In response to Vineet_nejwala

‎08-24-2022 09:59 PM

Hi @Vineet_nejwala 

Heres the output below ,

ICX SWITCH

1.show version

Copyright (c) Ruckus Networks, Inc. All rights reserved.
UNIT 1: compiled on Sep 23 2019 at 00:00:25 labeled as SPR08090d
(32539748 bytes) from Secondary SPR08090d.bin (UFI)
SW: Version 08.0.90dT213
Compressed Secondary Boot Code size = 786944, Version:10.1.15T225 (mnz10115)
Compiled on Thu Jan 31 07:08:55 2019

HW: Stackable ICX7150-48-POE
==========================================================================
UNIT 1: SL 1: ICX7150-48P-4X1G POE 48-port Management Module
Serial #:FEC3241R015
Software Package: ICX7150_BASE_L3_SOFT_PACKAGE
Current License: 4X1G
P-ASIC 0: type B160, rev 11 Chip BCM56160_B0
==========================================================================
UNIT 1: SL 2: ICX7150-2X1GC 2-port 2G Module
==========================================================================
UNIT 1: SL 3: ICX7150-4X10GF 4-port 40G Module
==========================================================================
1000 MHz ARM processor ARMv7 88 MHz bus
8192 KB boot flash memory
2048 MB code flash memory
1024 MB DRAM
STACKID 1 system uptime is 61 day(s) 13 hour(s) 18 minute(s) 20 second(s)
The system started at 16:23:12 GMT+00 Fri Jun 24 2022

The system : started=warm start reloaded=by "reload"

 
2.show sz status

============ SZ Agent State Info ===================
Config Status: None Operation Status: Enabled
State: SZ QUERY Prev State: SZ SSH CONNECTED Event: SZ QUERY RESPONSE

SWR List : None
Active List : 172.15.98.73, 172.15.98.29
DHCP Option 43 : No
DHCP Opt 43 List : None
Passive List : None
Merged List : 172.15.98.73, 172.15.98.29
Merged Idx: 0 IP : 172.15.98.73
Switch registrar host: sw-registrar.ruckuswireless.com
Switch registrar discovery retry count: 14
Switch registrar host resolve failure count: 14

SZ IP Used : 172.15.98.29
SZ Query Status :
In Progress. Response Not Received.

SSH Tunnel Status - :
Tunnel Status : Not Initiated
CLI IP/Port : /0
SNMP IP/Port : /0
Syslog IP/Port : /0
HTTP SERVER IP/Port: /0
HTTP CLIENT IP/Port: /0

Timer Status : Running
Timer Details in msec
Start Time Stamp : 962187078
Duration : 64601212
Current Time Stamp: 1023435120
Time Left : 3353170


3.sh sz client-log detail

there is no such command in the switch , instead I will display you the 'sh sz logs' command

Aug 24 11:00:56:https_connmgr_send_request>Entered.
Aug 24 11:00:56:sz_execute_state_machine>Exit with state/event: SZ QUERY/5, TIMER/2002 RC: 1
Aug 24 11:00:57:sz_execute_state_machine>Entering with state/event: SZ QUERY/5, SZ QUERY RESPONSE/2007
Aug 24 11:00:57:sz_parse_sz_query_response -- Status: 600 <<
Aug 24 11:00:57:sz_execute_state_machine>Exit with state/event: SZ QUERY/5, SZ QUERY RESPONSE/2007 RC: 1
Aug 24 11:00:57:HTTP Request Error:Http remote connection close called.
Aug 25 03:48:38:Sending SZ_SWR_QUERY_RESTART event...
Aug 25 03:48:38:Failed to resolve sw-registrar.ruckuswireless.com
Aug 25 03:49:38:Failed to resolve sw-registrar.ruckuswireless.com
Aug 25 03:50:38:Failed to resolve sw-registrar.ruckuswireless.com
End i/max/iter 167/167/0

4.show sz server-log detail

there is no such command in the switch

0 Kudos

fauzan_slim
New Contributor III
In response to Vineet_nejwala

‎08-24-2022 10:02 PM - edited ‎08-24-2022 10:03 PM

Hi  @Vineet_nejwala 

Heres the output below ,

ICX SWITCH

1.show version

fauzan_slim_0-1661403701798.png

2.show sz status

fauzan_slim_1-1661403701800.png


3.sh sz client-log detail

there is no such command in the switch , instead I will display you the 'sh sz logs' command

fauzan_slim_2-1661403701801.png



4.show sz server-log detail

there is no such command in the switch

SMARTZONE CONTROLLER

1.vSZ#show service

fauzan_slim_3-1661403701802.png

2.vSZ#show version

fauzan_slim_4-1661403701802.png

3.vSZ#show system-capacity

fauzan_slim_5-1661403701803.png

4.vSZ#show cpuinfo

fauzan_slim_6-1661403701804.png

5.vSZ#show diskinfo

fauzan_slim_7-1661403701804.png

6.vSZ#show meminfo

fauzan_slim_8-1661403701804.png

 

 

Regards ,

Fauzan

fauzan_slim
New Contributor III

‎08-24-2022 08:49 PM

Hi @Vineet_nejwala ,

Thanks for the response , here's the output

ON THE ICX SWITCH

1. show version

The output of 'show version'
switch#show version
Copyright (c) Ruckus Networks, Inc. All rights reserved.
UNIT 1: compiled on Sep 23 2019 at 00:00:25 labeled as SPR08090d
(32539748 bytes) from Secondary SPR08090d.bin (UFI)
SW: Version 08.0.90dT213
Compressed Secondary Boot Code size = 786944, Version:10.1.15T225 (mnz10115)
Compiled on Thu Jan 31 07:08:55 2019

HW: Stackable ICX7150-48-POE
==========================================================================
UNIT 1: SL 1: ICX7150-48P-4X1G POE 48-port Management Module
Serial #:FEC3241R015
Software Package: ICX7150_BASE_L3_SOFT_PACKAGE
Current License: 4X1G
P-ASIC 0: type B160, rev 11 Chip BCM56160_B0
==========================================================================
UNIT 1: SL 2: ICX7150-2X1GC 2-port 2G Module
==========================================================================
UNIT 1: SL 3: ICX7150-4X10GF 4-port 40G Module
==========================================================================
1000 MHz ARM processor ARMv7 88 MHz bus
8192 KB boot flash memory
2048 MB code flash memory
1024 MB DRAM
STACKID 1 system uptime is 61 day(s) 12 hour(s) 55 minute(s) 34 second(s)
The system started at 16:23:11 GMT+00 Fri Jun 24 2022

The system : started=warm start reloaded=by "reload"

2. show sz status

SSH@SW-00014-JakartaHarmoni-Ac24-R7150#show sz status

============ SZ Agent State Info ===================
Config Status: None Operation Status: Enabled
State: SZ QUERY Prev State: SZ SSH CONNECTED Event: SZ QUERY RESPONSE

SWR List : None
Active List : 172.15.98.73, 172.15.98.29
DHCP Option 43 : No
DHCP Opt 43 List : None
Passive List : None
Merged List : 172.15.98.73, 172.15.98.29
Merged Idx: 0 IP : 172.15.98.73
Switch registrar host: sw-registrar.ruckuswireless.com
Switch registrar discovery retry count: 88617
Switch registrar host resolve failure count: 88616

SZ IP Used : 172.15.98.29
SZ Query Status :
In Progress. Response Not Received.

SSH Tunnel Status - :
Tunnel Status : Not Initiated
CLI IP/Port : /0
SNMP IP/Port : /0
Syslog IP/Port : /0
HTTP SERVER IP/Port: /0
HTTP CLIENT IP/Port: /0

Timer Status : Running
Timer Details in msec
Start Time Stamp : 962187078
Duration : 64601212
Current Time Stamp: 1022134722
Time Left : 4653568

3. sh sz client-log detail

there is no option to that command instead, I will give the output of 'sh sz logs'

Aug 24 11:00:57:https_connmgr_send_request>Entered.
Aug 24 11:00:57:sz_execute_state_machine>Exit with state/event: SZ QUERY/5, TIMER/2002 RC: 1
Aug 24 11:00:57:sz_execute_state_machine>Entering with state/event: SZ QUERY/5, SZ QUERY RESPONSE/2007
Aug 24 11:00:57:sz_parse_sz_query_response -- Status: 600 <<
Aug 24 11:00:57:sz_execute_state_machine>Exit with state/event: SZ QUERY/5, SZ QUERY RESPONSE/2007 RC: 1
Aug 24 11:00:57:HTTP Request Error:Http remote connection close called.
Aug 25 03:48:38:Sending SZ_SWR_QUERY_RESTART event...
Aug 25 03:48:38:Failed to resolve sw-registrar.ruckuswireless.com
End i/max/iter 165/165/0

4. show sz server-log detail 

there is no such command in the switch side

ON THE SZ CONTROLLER

1. show service

fauzan_slim_0-1661399124118.png

2. show version

fauzan_slim_1-1661399179554.png

3.show system-capacity

fauzan_slim_2-1661399213304.png

4. show cpuinfo

fauzan_slim_3-1661399246924.png

5. show diskinfo

fauzan_slim_4-1661399270381.png

6. show meminfo

fauzan_slim_5-1661399290934.png

Best Regards,

Fauzan

0 Kudos

fauzan_slim
New Contributor III

‎08-24-2022 09:07 PM

Hi @Vineet_nejwala 

Heres the output below ,

ICX SWITCH

1.show version

Copyright (c) Ruckus Networks, Inc. All rights reserved.
UNIT 1: compiled on Sep 23 2019 at 00:00:25 labeled as SPR08090d
(32539748 bytes) from Secondary SPR08090d.bin (UFI)
SW: Version 08.0.90dT213
Compressed Secondary Boot Code size = 786944, Version:10.1.15T225 (mnz10115)
Compiled on Thu Jan 31 07:08:55 2019

HW: Stackable ICX7150-48-POE
==========================================================================
UNIT 1: SL 1: ICX7150-48P-4X1G POE 48-port Management Module
Serial #:FEC3241R015
Software Package: ICX7150_BASE_L3_SOFT_PACKAGE
Current License: 4X1G
P-ASIC 0: type B160, rev 11 Chip BCM56160_B0
==========================================================================
UNIT 1: SL 2: ICX7150-2X1GC 2-port 2G Module
==========================================================================
UNIT 1: SL 3: ICX7150-4X10GF 4-port 40G Module
==========================================================================
1000 MHz ARM processor ARMv7 88 MHz bus
8192 KB boot flash memory
2048 MB code flash memory
1024 MB DRAM
STACKID 1 system uptime is 61 day(s) 13 hour(s) 18 minute(s) 20 second(s)
The system started at 16:23:12 GMT+00 Fri Jun 24 2022

The system : started=warm start reloaded=by "reload"

 
2.show sz status

============ SZ Agent State Info ===================
Config Status: None Operation Status: Enabled
State: SZ QUERY Prev State: SZ SSH CONNECTED Event: SZ QUERY RESPONSE

SWR List : None
Active List : 172.15.98.73, 172.15.98.29
DHCP Option 43 : No
DHCP Opt 43 List : None
Passive List : None
Merged List : 172.15.98.73, 172.15.98.29
Merged Idx: 0 IP : 172.15.98.73
Switch registrar host: sw-registrar.ruckuswireless.com
Switch registrar discovery retry count: 14
Switch registrar host resolve failure count: 14

SZ IP Used : 172.15.98.29
SZ Query Status :
In Progress. Response Not Received.

SSH Tunnel Status - :
Tunnel Status : Not Initiated
CLI IP/Port : /0
SNMP IP/Port : /0
Syslog IP/Port : /0
HTTP SERVER IP/Port: /0
HTTP CLIENT IP/Port: /0

Timer Status : Running
Timer Details in msec
Start Time Stamp : 962187078
Duration : 64601212
Current Time Stamp: 1023435120
Time Left : 3353170


3.sh sz client-log detail

there is no such command in the switch , instead I will display you the 'sh sz logs' command

Aug 24 11:00:56:https_connmgr_send_request>Entered.
Aug 24 11:00:56:sz_execute_state_machine>Exit with state/event: SZ QUERY/5, TIMER/2002 RC: 1
Aug 24 11:00:57:sz_execute_state_machine>Entering with state/event: SZ QUERY/5, SZ QUERY RESPONSE/2007
Aug 24 11:00:57:sz_parse_sz_query_response -- Status: 600 <<
Aug 24 11:00:57:sz_execute_state_machine>Exit with state/event: SZ QUERY/5, SZ QUERY RESPONSE/2007 RC: 1
Aug 24 11:00:57:HTTP Request Error:Http remote connection close called.
Aug 25 03:48:38:Sending SZ_SWR_QUERY_RESTART event...
Aug 25 03:48:38:Failed to resolve sw-registrar.ruckuswireless.com
Aug 25 03:49:38:Failed to resolve sw-registrar.ruckuswireless.com
Aug 25 03:50:38:Failed to resolve sw-registrar.ruckuswireless.com
End i/max/iter 167/167/0

4.show sz server-log detail

there is no such command in the switch

SMARTZONE CONTROLLER

1.vSZ#show service

fauzan_slim_0-1661400257057.png

2.vSZ#show version

fauzan_slim_1-1661400326830.png

3.vSZ#show system-capacity

fauzan_slim_2-1661400366115.png

4.vSZ#show cpuinfo

fauzan_slim_3-1661400384356.png

5.vSZ#show diskinfo

fauzan_slim_4-1661400405575.png

6.vSZ#show meminfo

fauzan_slim_5-1661400428387.png

0 Kudos
Copyright © 2024 Khoros, LLC