Visit Jeremy's Blog.
Go Back > Forums > Linux Forums > Linux - General
User Name
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.


  Search this Thread
Old 01-14-2010, 02:55 PM   #1
Registered: Nov 2003
Posts: 789

Rep: Reputation: 39
Feedback Requested on a planned multiple filesystem copy

Hi there --

I am going to be involved with a massive filesystem copy from a local to a remote server in the next couple of weeks. There are ten filesystems in involved in this process. All, except one, are one hundred gigabytes in size, with the remaining one at twenty gigabytes.

The cp command with the -pr options will be used to copy the directories to their new location. A speed test, involving ten directories, was done to determine the average amount of time it would take to complete the process. The ten directories used in this test ranged in size from 2.3 gigabytes to 4.3 gigabytes. The results indicated the average amount time to complete the copy was around one minute and thirty seconds.

The question I have is the following: Is it better to interactively go to each filesystem and run the cp -pr command there, or should I write a script that will automatically go to each filesystem and run the copy?
Old 01-14-2010, 06:12 PM   #2
Registered: Jan 2005
Location: Shropshire, England, UK
Distribution: RedHat, Fedora, CentOS..........
Posts: 121

Rep: Reputation: 19
Its just a thought but have you considered that by using cp you could have an issue if any of the copies fail. A possible alternative would be to consider the program rsync with the options --whole-file (check the manual page for the best options to suit your environment).

At least using something like rsync your copy process is restartable without having to copy the whole of the directory again.

On the script part, I would suggest that your script is less likely to induce errors (typo's etc...) during your copy process so long as you carefully check it. Possibly putting a sleep with a few echo's to give you time to abort the next copy should the copy process fail and also getting the script to log the output from the copy to a file so if you have a failure you can see what happened by examining the log file.

P.S. rsync has a -n option that allows you to simulate what it would do without actually doing it.



Last edited by cardy; 01-14-2010 at 06:13 PM. Reason: typo


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
Subversion - Could not open the requested SVN filesystem Braynid Linux - Server 9 03-04-2009 07:33 AM
Linux Install Notes, Feedback Requested snowman156 Slackware 3 09-17-2004 05:35 PM
Many questions, feedback requested Fatal Error Linux - Newbie 2 08-22-2004 12:41 PM
New Howto Feedback Requested... souljah Debian 2 03-22-2004 06:29 AM > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 12:05 AM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration