rsync over a non standard SSH port

Use the -e option:

rsync -avz -e "ssh -p $portNumber" user@remoteip:/path/to/files/ /local/path/