LinuxQuestions.org
Latest LQ Deal: Latest LQ Deals
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 03-17-2009, 11:36 PM   #1
Dan8080
LQ Newbie
 
Registered: Jun 2006
Distribution: CentOS 4.3
Posts: 25

Rep: Reputation: 15
dd & rsync questions


Hi,

Is there a way to limit the amount of i/o usage used by the command "dd"? I have been trying to figure this one out but I don't know if it can be done. I am trying to back up but I want to limit its usage.

My second question is about rsync...

It appears to be quite slow to count my files, because it has 4 million files to count. What's the fastest way to get rsync to count the files up? It literally takes it 7 hours to count and go through them all before a file transfer even starts. I am just using rsync to go from a SATA HD to a USB 2.0 drive.

Thank you. Also, does anyone recommend how to handle this situation, if there's a better way to take a backup of these?

Last edited by Dan8080; 03-17-2009 at 11:51 PM.
 
Old 03-18-2009, 11:42 AM   #2
AlucardZero
Senior Member
 
Registered: May 2006
Location: USA
Distribution: Debian
Posts: 4,824

Rep: Reputation: 615Reputation: 615Reputation: 615Reputation: 615Reputation: 615Reputation: 615
Look into the "ionice" command and to a lesser extent "nice".

As for counting the files.. upgrade your processor and/or RAM? Or split the rsync command into multiple?
 
Old 03-18-2009, 01:05 PM   #3
Dan8080
LQ Newbie
 
Registered: Jun 2006
Distribution: CentOS 4.3
Posts: 25

Original Poster
Rep: Reputation: 15
Thanks. I don't see why it would take so long though on a system with 3GB of RAM and a Pentium D 2.4 ghz processor. I have a hard time believing that it can't count this stuff faster.

Could you elaborate on what you mean by splitting it into multiple? Do you mean multiple folders? Isn't possible for me because the files I'm backing up have to stay all in one folder.
 
Old 03-18-2009, 03:46 PM   #4
AlucardZero
Senior Member
 
Registered: May 2006
Location: USA
Distribution: Debian
Posts: 4,824

Rep: Reputation: 615Reputation: 615Reputation: 615Reputation: 615Reputation: 615Reputation: 615
Make sure rsync is all updated, too.

By multiple I mean you could split it into several rsync commands with a little scripts, say take a*-h* on the first, i*-m* on the second, etc.
 
Old 03-21-2009, 04:36 AM   #5
archtoad6
Senior Member
 
Registered: Oct 2004
Location: Houston, TX (usa)
Distribution: MEPIS, Debian, Knoppix,
Posts: 4,727
Blog Entries: 15

Rep: Reputation: 234Reputation: 234Reputation: 234
Quote:
Originally Posted by AlucardZero View Post
Look into the "ionice" command ...
I did & I don't have it. It's supposed to be part of the util-linux package: http://freshmeat.net/search/?q=ionice,
http://packages.debian.org/lenny/i38...linux/filelist

It's missing from MEPIS 7, maybe in 8. From the man page:
Quote:
Linux supports io scheduling priorities and classes since 2.6.13 with the CFQ io scheduler.
Code:
$ uname -r
2.6.22-1-mepis-smp
My kernel is, apparently, advanced enough; I may need to post in a MEPIS forum.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
rsync questions crazy8 Linux - Newbie 11 04-05-2008 12:59 PM
Rsync & NFS Help bdowns Linux - Software 1 11-16-2007 10:27 AM
Rsync Questions progrock Linux - Networking 2 11-14-2007 11:41 AM
rsync questions slack66 Linux - General 4 11-05-2005 12:31 AM
rsync questions csross Linux - General 3 06-25-2004 10:10 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 02:58 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration