LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices

Reply
 
Search this Thread
Old 01-14-2010, 02:55 PM   #1
kaplan71
Member
 
Registered: Nov 2003
Posts: 718

Rep: Reputation: 39
Feedback Requested on a planned multiple filesystem copy


Hi there --

I am going to be involved with a massive filesystem copy from a local to a remote server in the next couple of weeks. There are ten filesystems in involved in this process. All, except one, are one hundred gigabytes in size, with the remaining one at twenty gigabytes.

The cp command with the -pr options will be used to copy the directories to their new location. A speed test, involving ten directories, was done to determine the average amount of time it would take to complete the process. The ten directories used in this test ranged in size from 2.3 gigabytes to 4.3 gigabytes. The results indicated the average amount time to complete the copy was around one minute and thirty seconds.

The question I have is the following: Is it better to interactively go to each filesystem and run the cp -pr command there, or should I write a script that will automatically go to each filesystem and run the copy?
 
Old 01-14-2010, 06:12 PM   #2
cardy
Member
 
Registered: Jan 2005
Location: Shropshire, England, UK
Distribution: RedHat, Fedora, CentOS..........
Posts: 121

Rep: Reputation: 19
Its just a thought but have you considered that by using cp you could have an issue if any of the copies fail. A possible alternative would be to consider the program rsync with the options --whole-file (check the manual page for the best options to suit your environment).

At least using something like rsync your copy process is restartable without having to copy the whole of the directory again.

On the script part, I would suggest that your script is less likely to induce errors (typo's etc...) during your copy process so long as you carefully check it. Possibly putting a sleep with a few echo's to give you time to abort the next copy should the copy process fail and also getting the script to log the output from the copy to a file so if you have a failure you can see what happened by examining the log file.

P.S. rsync has a -n option that allows you to simulate what it would do without actually doing it.

Regards

Lee

Last edited by cardy; 01-14-2010 at 06:13 PM. Reason: typo
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Subversion - Could not open the requested SVN filesystem Braynid Linux - Server 9 03-04-2009 07:33 AM
Linux Install Notes, Feedback Requested snowman156 Slackware 3 09-17-2004 05:35 PM
Many questions, feedback requested Fatal Error Linux - Newbie 2 08-22-2004 12:41 PM
New Howto Feedback Requested... souljah Debian 2 03-22-2004 06:29 AM


All times are GMT -5. The time now is 01:00 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration