Hi Abi
I don't know of a way of disabling the console port completely, if this were done and the password lost there would not be any way of recovering the switch. Setting a strong password on the switch is probably the best option and making sure the device is physically secure as the password recovery process via the boot-interrupt is very disruptive (it requires the switch to be restarted twice) and requires physical access to the switch so it is not considered a security issue in normal environments.
Another option is to put the switch into FIPS mode which disables password recovery is disabled, this also enforces a number of other security policies so please study the FIPS guide closely before enabling it.
https://docs.arris.com/bundle/fastiron-08090-fipscc-config/page/GUID-C97DB143-3D67-4D0C-BDA3-96432B1...
Simon