There are some security tips for your sshd_config at http://www.debian-tutorials.com/5-steps-to-secure-your-ssh-server however the third one, Change the SSH Port on the server, is a lot of hot air.
“By changing the default port you will make SSH server more secure. By changing the default port you will reduce the amount of brute force attacks.”
Only the second phrase of this statement is truthful, but still, not by a wide margin…
Security by obscurity never works, it’s better to follow the other 4 advices and use fail2ban or something similar.