Register a domain and help support LQ
Go Back > Forums > Linux Forums > Linux - Networking
User Name
Linux - Networking This forum is for any issue related to networks or networking.
Routing, network cards, OSI, etc. Anything is fair game.


  Search this Thread
Old 09-25-2012, 11:40 PM   #1
Registered: Sep 2009
Posts: 89

Rep: Reputation: 0
copying thousands of files via SCP

Dear experts,

I am currently downloading thousands of files from remote file server using scp command.
What happen was, after downloading 1/3 of total files the connection had broken. Then I started from scratch to download again.

I would like to know if there is any command that can do the copying only the remaining files but not those files which are already have been downloaded.

note: When searched internet, I came across something like

yes | cp folder1/* folder2/
If there are files same file name then it will say 'yes' with copying. But I want for SCP not for CP command

Many thanks in advance.
Old 09-26-2012, 12:06 AM   #2
LQ Guru
Registered: Jan 2009
Location: Japan
Distribution: Mostly Debian and Scientific Linux
Posts: 5,753

Rep: Reputation: 1288Reputation: 1288Reputation: 1288Reputation: 1288Reputation: 1288Reputation: 1288Reputation: 1288Reputation: 1288Reputation: 1288

you should be using rsync for this. Eg something like:

rsync -auv -e ssh user@remotehost:/path/to/somedir .
You may not need the "-e ssh" since rsync is usually setup to transfer over ssh by default.


1 members found this post helpful.



Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
Problem by copying files with SCP thomas2004ch Linux - Newbie 10 10-21-2009 03:59 AM
Strange scp issue while copying files gettons_slack Linux - Software 2 08-26-2006 06:33 AM
Strange scp issue while copying files gettons_slack Slackware 7 08-25-2006 02:53 PM

All times are GMT -5. The time now is 04:40 AM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration