How to use rsync for transferring files over ssh

How do you install and use rsync to synchronize files and directories from one location (or one server) to another location? - A common question asked by new sys admin.

rsync is a free software computer program for Unix and Linux like systems which synchronizes files and directories from one location to another while minimizing data transfer using delta encoding when appropriate. An important feature of rsync not found in most similar programs/protocols is that the mirroring takes place with only one transmission in each direction.

So what is unique about rsync?

It can perform differential uploads and downloads (synchronization) of files across the network, transferring only data that has changed. The rsync remote-update protocol allows rsync to transfer just the differences between two sets of files across the network connection.

How do I install rsync?

Use any one of the following commands to install rsync.

If you are using Debian or Ubuntu Linux, type the following command

# apt-get install rsync

$ sudo apt-get install rsync

If you are using Red Hat Enterprise Linux (RHEL), type the following command

# up2date rsync

If you are using CentOS/Fedora Core Linux, type the following command

# yum install rsync

If you are using FreeBSD, type the following command

# cd /usr/ports/net/rsync
# make install clean

Always use rsync over ssh

Since rsync does not provide any security while transferring data it is recommended that you use rsync over ssh . This allows a secure remote connection. Now let us see some examples of rsync.

rsync command common options

--delete : delete files that don't exist on sender (system)
-v : Verbose (try -vv for more detailed information)
-e "ssh options" : specify the ssh as remote shell
-a : archive mode
-r : recurse into directories
-z : compress file data

Example : Copy file from a local computer to a remote server

Copy file from /home/test/www.tar.gz to a remote server called www.example.com

$ rsync -v -e ssh /home/test/www.tar.gz user@www.example.com:~

Output:

Password:
sent 15099 bytes  received 37 bytes  1003.43 bytes/sec
total size is 15014  speedup is 0.89

Please note that symbol ~ indicate the users home directory (/home/user).

Example : Copy file from a remote server to a local computer

Copy file /home/user/readme.txt from a remote server www.example.com to a local computer /tmp directory:

$ rsync -v -e ssh user@www.example.com:~/readme.txt /tmp

Password

Example: Synchronize a local directory with a remote directory

$ rsync -r -a -v -e "ssh -l user" --delete www.example.com:/var/www /local/www

Example: Synchronize a remote directory with a local directory

$ rsync -r -a -v -e "ssh -l user" --delete /local/www www.example.com:/var/www

Example: Synchronize a local directory with a remote rsync server

$ rsync -r -a -v --delete rsync://cvs.example.com/cvs /home/user/cvs

Example: Mirror a directory between my "old" and "new" web server

You can mirror a directory between my "old" (old.example.com) and "new" web server with the command (assuming that ssh keys are set for password less authentication)

$ rsync -zavrR --delete --links --rsh="ssh -l user" old.example.com:/home/user/dir1 /home/user/dir1

Date: 2012-01-19 22:03:36 and last modified: 2012-01-19 22:26:42