LinuxQuestions.org
View the Most Wanted LQ Wiki articles.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Networking
User Name
Password
Linux - Networking This forum is for any issue related to networks or networking.
Routing, network cards, OSI, etc. Anything is fair game.

Notices



Reply
 
Search this Thread
Old 11-27-2011, 01:58 PM   #1
carolus
Member
 
Registered: Feb 2008
Posts: 45

Rep: Reputation: 15
download/upload manager for ssh on flaky network


I am having trouble transferring large backup tarfiles to a ssh server on my home network. The connection gets interrupted several times an hour, while the file transfer may take several hours. I've used wget extensively for overnight ftp or http downloads over a bad dial-up connection and found it quite trustworthy, so I am looking for a similar download/upload manager that works with ssh and can resume automatically after a broken connection.

I tried the manager "curl", which indeed resumed after a broken connection and eventually reported 100% completion, but the uploaded file was corrupted. If anyone has experience with a file manager that can can resume sftp transfers reliably on a broken connection, please let me know.
 
Old 11-28-2011, 06:06 AM   #2
klearview
Member
 
Registered: Aug 2006
Location: London
Distribution: Debian, Kubuntu
Posts: 572

Rep: Reputation: 75
Rsync:

Quote:
rsync -vzP -e ssh /path/to/local_file username@hostname:/path/to/remote_file
v - verbose
z - compress
P - partial, display progress

If your ssh is on a non-standard port do:

Quote:
-e 'ssh -p XXX'
 
1 members found this post helpful.
Old 11-28-2011, 03:41 PM   #3
carolus
Member
 
Registered: Feb 2008
Posts: 45

Original Poster
Rep: Reputation: 15
Thanks. It worked fine, but maybe my network is having a good day. From what I find on the web, rsync will not automatically try to reconnect, unlike curl or lftp. You have to retry manually or from a script, but worth the trouble if rsync is the most reliable.
 
Old 11-28-2011, 04:06 PM   #4
klearview
Member
 
Registered: Aug 2006
Location: London
Distribution: Debian, Kubuntu
Posts: 572

Rep: Reputation: 75
Here is a simple script to resume rsync automatically:
http://x-ian.net/2009/05/15/resume-r...nection-crash/

Notice '--partial --progress' in his script - this is the same as '-P' in my answer above.
 
  


Reply

Tags
curl, lftp, sftp, ssh, upload


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Any Tool which can monitor upload/ download in network? your_shadow03 Linux - Newbie 8 02-24-2010 08:27 AM
Very Flaky, Weird, and Infuriating Network Anomalies on Ubuntu Box doctorcisco Linux - Networking 3 05-22-2008 10:19 PM
Network connectivity flaky, fine on other systems exodist Linux - Networking 7 12-13-2006 09:39 PM
command Line SSH download-upload mirat46 Linux - Newbie 1 05-11-2006 05:12 PM
hdd-related download problem(upload 4-5MB/s, download ~1MB/s) tine Linux - Hardware 4 09-15-2004 04:06 PM


All times are GMT -5. The time now is 06:16 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration