The Linux Administration group is for the discussion of technical issues technical issues that arise during the administration of Linux systems, including maintaining the operating system and supporting end-user applications.

There is, I believe, a certain amount of overhead in encrypted communications. If you are on a completely secure network (e.g. both systems are on your own LAN) or this is not crucial data, you may want to use just old-fashioned ftp. I ran comparisons a couple of years ago, and ftp was definitely faster than other the other methods I tried (namely scp, rsync, sftp) (I used "tar" first - then ftp'd the tar files).
BTW: if your rsync failed, you may want to check on the "timeout" setting in either your rsync command-line or in /etc/rsyncd.conf - each number is worth 1 second (i.e. "timeout = 30" would cause rsync to give up after 30 seconds - the default is zero).

Help the community by fixing grammatical or spelling errors, summarizing or clarifying the solution, and adding supporting information or resources. Always respect the original author.

>
> Hi there
>
> how to copy large files to another Linux host?
> I used rsync command but after hours it hang( Afrer copying some files).
>
> what should I do?
>
> Thanks

NOTICE: This communication is intended only for the use of the individual or entity to which it is addressed and may contain information that is privileged, confidential and exempt from disclosure under applicable law. If the reader of this communication is not the intended recipient or the employee or agent responsible for delivering the communication, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify me immediately by replying to this email.

REMINDER: The disclosure of medical information is strictly prohibited by federal regulation. Unauthorized release of medical information may result in administrative, civil and criminal sanctions.

Ssh and scp (and sftp) are all wonderful tools, but depending on the size of the files in question, tar or cpio combined with gzip/gunzip can save you tons of time and bandwidth. If the file is larger than say 2 or 4 GB, then you might as well use ssh/scp/sftp because you aren't going to be able to compress/decompress them in any simple fashion (unless they are text files).

There is, I believe, a certain amount of overhead in encrypted communications. If you are on a completely secure network (e.g. both systems are on your own LAN) or this is not crucial data, you may want to use just old-fashioned ftp. I ran comparisons a couple of years ago, and ftp was definitely faster than other the other methods I tried (namely scp, rsync, sftp) (I used "tar" first - then ftp'd the tar files).
BTW: if your rsync failed, you may want to check on the "timeout" setting in either your rsync command-line or in /etc/rsyncd.conf - each number is worth 1 second (i.e. "timeout = 30" would cause rsync to give up after 30 seconds - the default is zero).

I think some software/hardware problem exists on your computers/network.
Try to isolate error by reading error messages or by reading log files.
If you can find problem, try to split large files to smaller files by
"split" command.
Then copy to remote computer.

Assuming you copying across the LAN. Make sure you network connectivity is always up. Ensure enough space is available at the destination. Hope the large file is not beyond the filesystem limitation.
Scp Or Sftp should be sufficient to copy the files across...

"screen" will allow you to disconnect from the session and resume it later
on (with "screen -r")

What flags are you using on rsync? It is capable of doing its own
compression -- I use rsync almost daily - my typical command line
is: rsync -azv --progress -e ssh __source__ email@removed:
/path/to/destination