Resume download function

ust · 11-26-2008, 02:47 AM

I would like to transfer a large file to another server , but I found that the connection is not stable so that the line often broken , that the file is incomplete transferred , can advise is there any command ( eg. ftp , scp ) / method could be resume download after the line is disconnected ? thx

billymayday · 11-26-2008, 03:16 AM

I thought rsync could do this, but I can't see any explicit mention in the man page - perhaps I'm confusing file sets with individual files. Give it a try.

You could also do it over http, wget has a resume option.

colucix · 11-26-2008, 03:24 AM

Quote:

Originally Posted by billymayday

You could also do it over http, wget has a resume option.

wget works through the ftp protocol, too.

billymayday · 11-26-2008, 03:50 AM

rsync with -P (equivalent to --progress --partial) seems to do the trick.

ust · 11-26-2008, 06:27 AM

Quote:

Originally Posted by billymayday

rsync with -P (equivalent to --progress --partial) seems to do the trick.

thx reply ,

When use the command below , it pops the error , can advise do I need to config sth in remote server ?

rsync -e test.txt root@192.168.0.1:/tmp

error
=====
Failed to exec test.txt : Permission denied
rsync error: error in IPC code (code 14) at pipe.c(82)
rsync: connection unexpectedly closed (0 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(165)

colucix · 11-26-2008, 06:48 AM

The -e option of rsync specifies the remote shell to use. It requires an argument, for example

Code:

rsync -e ssh blah blah blah

tells rsync to transfer files through ssh. In your example you tell to use test.txt (the file you want to sync) as the remote shell. It is obviously not correct.

ust · 11-26-2008, 08:01 AM

Quote:

Originally Posted by colucix

The -e option of rsync specifies the remote shell to use. It requires an argument, for example

Code:

rsync -e ssh blah blah blah

tells rsync to transfer files through ssh. In your example you tell to use test.txt (the file you want to sync) as the remote shell. It is obviously not correct.

thx , I tried -e ssh , it works fine to remote file to remote server,
but I do the testing , copy a large file to remote server , then reboot this remote file , the local server pops the below error , then the copy process stopped and not resumed again , if I want it will be resume download until the file copying is complete , what can i do ? thx

rsync: writefd_unbuffered failed to write 4 bytes: phase "unknown": Broken pipe
rsync error: error in rsync protocol data stream (code 12) at io.c(515)

billymayday · 11-26-2008, 01:45 PM

Did you read my post and use at least --partial?

Have a read of the man page for rsync to see some examples of usage

colucix · 11-26-2008, 01:58 PM

I don't really understand the situation. What do you mean with "reboot this remote file"? Did you shutdown the server during the file transfer? Anyway, I'd follow the advice by billymayday.

ust · 11-26-2008, 07:18 PM

Quote:

Originally Posted by billymayday

Did you read my post and use at least --partial?

Have a read of the man page for rsync to see some examples of usage

Yes ,I tried add -P , it shows the transfer status when transferring , but after the remote server is reboot , the transfer will not be resumed , can advise how can make it automatically resume ? thx

billymayday · 11-26-2008, 08:48 PM

Well I tested it earlier and it resumes for me. Why are you rebooting the server?

Note that it doesn't say "resuming" or anything, it just flies through the part that's already copied.

ust · 11-26-2008, 09:11 PM

Quote:

Originally Posted by billymayday

Well I tested it earlier and it resumes for me. Why are you rebooting the server?

Note that it doesn't say "resuming" or anything, it just flies through the part that's already copied.

thx reply ,

I tried stop the network daemon then wait 10 minutes to restart it , the transfer really could be resume , but if I reboot the remote server , it could not be resumed , I think I should not test reboot serve .

thx for all help , it should be ok for me .