Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum. |
Notices |
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
Are you new to LinuxQuestions.org? Visit the following links:
Site Howto |
Site FAQ |
Sitemap |
Register Now
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
|
 |
03-18-2009, 12:36 AM
|
#1
|
LQ Newbie
Registered: Jun 2006
Distribution: CentOS 4.3
Posts: 25
Rep:
|
dd & rsync questions
Hi,
Is there a way to limit the amount of i/o usage used by the command "dd"? I have been trying to figure this one out but I don't know if it can be done. I am trying to back up but I want to limit its usage.
My second question is about rsync...
It appears to be quite slow to count my files, because it has 4 million files to count. What's the fastest way to get rsync to count the files up? It literally takes it 7 hours to count and go through them all before a file transfer even starts. I am just using rsync to go from a SATA HD to a USB 2.0 drive.
Thank you. Also, does anyone recommend how to handle this situation, if there's a better way to take a backup of these?
Last edited by Dan8080; 03-18-2009 at 12:51 AM.
|
|
|
03-18-2009, 12:42 PM
|
#2
|
Senior Member
Registered: May 2006
Location: USA
Distribution: Debian
Posts: 4,824
|
Look into the "ionice" command and to a lesser extent "nice".
As for counting the files.. upgrade your processor and/or RAM? Or split the rsync command into multiple?
|
|
|
03-18-2009, 02:05 PM
|
#3
|
LQ Newbie
Registered: Jun 2006
Distribution: CentOS 4.3
Posts: 25
Original Poster
Rep:
|
Thanks. I don't see why it would take so long though on a system with 3GB of RAM and a Pentium D 2.4 ghz processor. I have a hard time believing that it can't count this stuff faster.
Could you elaborate on what you mean by splitting it into multiple? Do you mean multiple folders? Isn't possible for me because the files I'm backing up have to stay all in one folder.
|
|
|
03-18-2009, 04:46 PM
|
#4
|
Senior Member
Registered: May 2006
Location: USA
Distribution: Debian
Posts: 4,824
|
Make sure rsync is all updated, too.
By multiple I mean you could split it into several rsync commands with a little scripts, say take a*-h* on the first, i*-m* on the second, etc.
|
|
|
03-21-2009, 05:36 AM
|
#5
|
Senior Member
Registered: Oct 2004
Location: Houston, TX (usa)
Distribution: MEPIS, Debian, Knoppix,
Posts: 4,727
|
Quote:
Originally Posted by AlucardZero
Look into the "ionice" command ...
|
I did & I don't have it. It's supposed to be part of the util-linux package: http://freshmeat.net/search/?q=ionice,
http://packages.debian.org/lenny/i38...linux/filelist
It's missing from MEPIS 7, maybe in 8. From the man page:
Quote:
Linux supports io scheduling priorities and classes since 2.6.13 with the CFQ io scheduler.
|
Code:
$ uname -r
2.6.22-1-mepis-smp
My kernel is, apparently, advanced enough; I may need to post in a MEPIS forum.
|
|
|
All times are GMT -5. The time now is 11:49 PM.
|
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.
|
Latest Threads
LQ News
|
|