RSYNC error .tar.gz 14gb file

salimshahzad · 03-10-2010, 06:26 AM

dear sirs

hello good day i am trying to transfer a file from my live linux machine to remote linux machine it is a mail server and single .tar.gz file include all data. but during transfer it stop working. how can i work and trouble shooot the matter. is there any better way then this to transfer huge 14 gb file over network,vpn,wan transfer. the speed is 1mbps,rest of the file it copy it.

rsync -avz --stats bkup_1.tar.gz root@10.1.1.22:/var/opt/bkup

[root@sa1 logs_os_backup]# less remote.log
Wed Mar 10 09:12:01 AST 2010
building file list ... done
bkup_1.tar.gz
deflate on token returned 0 (87164 bytes left)
rsync error: error in rsync protocol data stream (code 12) at token.c(274)
building file list ... done
axigen.log
end.txt
end_transfer.txt
remote.log
start.txt
start_transfer.txt

Number of files: 7
Number of files transferred: 6
Total file size: 353008 bytes
Total transferred file size: 353008 bytes
Literal data: 20107 bytes
Matched data: 332942 bytes
File list size: 162
Total bytes sent: 3392
Total bytes received: 3536

sent 3392 bytes received 3536 bytes 4618.67 bytes/sec
total size is 353008 speedup is 50.95

troop · 03-10-2010, 06:37 AM

Quote:

rsyncing a .gz file is not very worthwhile
because the rsync algorithm does not do a good job of efficiently
transferring them, unless you've got a modified gzip that adds a
--rsyncable option and you used the option.

If I do a dry run, it appears that it will work
successfully, but when I remove the --dry-run, it fails.

http://lists.samba.org/archive/rsync...er/004520.html