Use rsync as follows:

rsync -avz -e ssh <directories_or_files> other.server.com:/path/to/directory