If you have a VPS/Dedicated Server then I highly suggest you change the default SSH port from 22 no matter how secure your password is as this will easily help to mitigate a lot of attempts to brute force your server via SSH as a lot of servers use 22. If you want to take it a step further then change a few other default services ports as well!