LinuxQuestions.org
Did you know LQ has a Linux Hardware Compatibility List?
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Slackware
User Name
Password
Slackware This Forum is for the discussion of Slackware Linux.

Notices

Reply
 
Search this Thread
Old 11-02-2005, 06:13 AM   #1
Swift&Smart
Member
 
Registered: Jan 2003
Location: Hong Kong,China
Distribution: Slackware,OpenSUSE
Posts: 472

Rep: Reputation: 30
Talking Speed up partimage backup


Hello! I have question regarding how to speed up backup with partimage on my slackware box.

Like many others, I have tasted partimage by using Knoppix Live CD to backup my Linux partition. However, it is too slow to backup a 7GB partition with about 1 hr with my 1st attempt! After searching, I know a script hdparm can improve the performance of harddrive speed. Fortunately, the speed is improved by half. However, I would like to ask:

1.Is it the limit of the backup speed of partimage?

2.As long as I remember,I have enabled DMA,32bit,multicount and other parameters. What parameters would I miss out if I am using a 80GB Maxtor hard drive (7200RPM,ATA,133MHZ)

Finally, do you guys have similar experience like me regarding the speed of backup?Please kindly drop me a line if you also have some solution on this one. Thanks a million.
 
Old 11-02-2005, 08:09 AM   #2
kilgoretrout
Senior Member
 
Registered: Oct 2003
Posts: 2,320

Rep: Reputation: 141Reputation: 141
I usually get about 300 to 400MB/min to image and nearly 1GB/min to restore with partimage using gzip. If you use bzip, it is much slower. 7GB takes about 20 minutes to image. Also, I do not have to make any hdparm adjustments to get those speeds. I generally do not use knoppix, but rather kannotix or a custom livecd I made based on slax. The image file is located on a different hard drive than the hard drive of the imaged partition; this speeds things up significantly as the hard drive head does not have to go back and forth to read and then write to the same drive. Try kannotix and see if that helps your speed. The main hdparm parameter is dma which should always be enabled to get those speeds; I believe dma is enabled by default in kannotix.
 
Old 11-02-2005, 11:07 PM   #3
Swift&Smart
Member
 
Registered: Jan 2003
Location: Hong Kong,China
Distribution: Slackware,OpenSUSE
Posts: 472

Original Poster
Rep: Reputation: 30
Where to download kannotix livecd?

kilgoretrout ,thanks for your help. Your speed is much more faster than me regarding backup time.

However,where can I download this nice livecd?I seldom heard of kannotix. By the way, I use gzip as the backup compression option. The speed is not acceptable even I make several changes by hdparm.I also make the image file to my secondary hard drive (I have 2 hard drive). So,same situation as you,but the speed is much more slower.

I would be appreciated if you would kindly provide a link for me to download this nice LiveCD.
 
Old 11-03-2005, 03:59 AM   #4
Alien Bob
Slackware Contributor
 
Registered: Sep 2005
Location: Eindhoven, The Netherlands
Distribution: Slackware
Posts: 5,307

Rep: Reputation: Disabled
Re: Where to download kannotix livecd?

Quote:
Originally posted by Swift&Smart
I would be appreciated if you would kindly provide a link for me to download this nice LiveCD.
http://kanotix.com/index.php?&newlang=eng

Eric
 
Old 11-03-2005, 05:06 AM   #5
Swift&Smart
Member
 
Registered: Jan 2003
Location: Hong Kong,China
Distribution: Slackware,OpenSUSE
Posts: 472

Original Poster
Rep: Reputation: 30
Thanks a lot,Eric.

Do you use it?How is it if using for backup with partimage?
 
Old 11-03-2005, 06:01 AM   #6
Alien Bob
Slackware Contributor
 
Registered: Sep 2005
Location: Eindhoven, The Netherlands
Distribution: Slackware
Posts: 5,307

Rep: Reputation: Disabled
No, I do not use Kanotix. It is a Debian based live-CD and although it seems to have very good hardware detection and -confuguration, I prefer to stay with Slackware.

Cheers, Eric
 
Old 11-03-2005, 08:57 AM   #7
kilgoretrout
Senior Member
 
Registered: Oct 2003
Posts: 2,320

Rep: Reputation: 141Reputation: 141
If you are using an external usb hard drive to back up to, one thing I remember about knoppix is that it would write to the usb drive at usb 1.1 speeds instead of the much faster usb 2.0 speeds. That resulted in about 60MB/min speed with partimage which is dog slow. Kannotix runs the external drive at usb 2.0 speeds resulting in a partimage transfer rate of about 300MB/min. That was the main reason I switched to kannotix.

If you want a slackware based live cd, take a look at slax:

http://slax.linux-live.org/

It doesn't have partimage on it but they have a "module" system that allows you to add it fairly easily. I made a module for partimage and uploaded it to their site(go to modules>other on the slax site).

Another nice live cd which includes partimage and many other useful utilities is Insert:

http://www.inside-security.de/insert_en.html

Both slax and insert give speeds similar to kannotix but are much smaller downloads, slax is about 180MB and Insert is about 50MB.
 
Old 11-03-2005, 08:42 PM   #8
Swift&Smart
Member
 
Registered: Jan 2003
Location: Hong Kong,China
Distribution: Slackware,OpenSUSE
Posts: 472

Original Poster
Rep: Reputation: 30
kilgoretrout,thanks for your reply.

Right now,I have a slackware linux partition waiting for me to backup to my secondary IDE hard-drive. I will try out Kannotix as it has already included partimage. If all goes well, I will do the same to my server but back hard drive up to an external hard-drive. (Because as you said,Kannotix would support USB 2.0 to speed things up.

No matter what distribution,what I care about is "SPEED".It's frustrating for us to wait 1 hr just backup 7GB partition with normal compression.

Thanks for your help again,kilgoretrout.
 
Old 11-06-2005, 05:27 AM   #9
Swift&Smart
Member
 
Registered: Jan 2003
Location: Hong Kong,China
Distribution: Slackware,OpenSUSE
Posts: 472

Original Poster
Rep: Reputation: 30
kilgoretrout,I've followed your instruction and download the Slax livecd with partimage(module).

Unfortunately,7GB partition spent me about 40 mins to backup.I backup this partition in the same drive,different partition.Is this the reason which cause me this long time?

Thanks for your concern.

P.S. Backup speed: 130-140 MB per sec.

Last edited by Swift&Smart; 11-06-2005 at 05:28 AM.
 
Old 11-06-2005, 08:01 AM   #10
kilgoretrout
Senior Member
 
Registered: Oct 2003
Posts: 2,320

Rep: Reputation: 141Reputation: 141
Using the same drive undoubtedly slows things down as the drive head has to move back and forth but what you are getting seems extreme. Have you tried checking your hard drive speed using hdparm while running slack? Just run:

# hdparm -t /dev/hdx

I'm wondering if this is a hardware problem. The above will tell if you are getting abnormally slow read/writes from the drive. You should be getting around 40MB/sec or better. Did you build this box yourself or is it factory prebuilt? Does your motherboard support ATA 133 speeds? If you put this drive in an old box that only supports ATA 66, the hard drive will operate at the slower ATA 66 speeds.
 
Old 11-07-2005, 04:47 AM   #11
Swift&Smart
Member
 
Registered: Jan 2003
Location: Hong Kong,China
Distribution: Slackware,OpenSUSE
Posts: 472

Original Poster
Rep: Reputation: 30
Thanks for your reply,kilgoretrout.

If you have looked at my P.S, the speed is faster than 40MB/sec. I built my desktop 4 years ago which I think it is using ATA 100 but not ATA66.When you haven't review the specification of your computer,you will forget about that. My bad. Moreover, I will try to back it up to my secondary hard drive. I hope this will speed things up.

P.S. Before, I was excited because I can use SLAX with partimage module with just 177MB in a CD. However,the speed didn't improve drastically or even on hold. Anyway, I will try to figure it out. Because it is the trial of partimage. If it is successful, I will do the same with my server,which "also put on hold" after I bought it last December. I have no time to manage it,indeed.

Again,thanks for your continuous help,kilgoretrout. I will drop a line if I tried again.
 
Old 11-10-2005, 12:04 AM   #12
Swift&Smart
Member
 
Registered: Jan 2003
Location: Hong Kong,China
Distribution: Slackware,OpenSUSE
Posts: 472

Original Poster
Rep: Reputation: 30
kilgoretrout,I got most of the answers from your post.

Firstly, I found out that my motherboard will only support UDMA 100 as my hard drive is UDMA 133.

Anyway,this background information cannot be changed. After I backup my linux partition to "another" hard drive,the speed is 130-140MB per sec, which also takes about 40 mins to backup 7GB partition. Obviously, the speed doesn't even change after I used Slax with partimage. So, the hard drive factor is eliminated.

I am trying another LiveCD,Kanotix as you suggested. I hope this will speed things up...
 
Old 11-11-2005, 07:32 AM   #13
kilgoretrout
Senior Member
 
Registered: Oct 2003
Posts: 2,320

Rep: Reputation: 141Reputation: 141
Those speeds look like ATA 66 or 33 to me. My ATA 100 drives can do 300 to 400MB/min in partimage. Check your hard drive cable. Is it an 80 wire or 40 wire cable? ATA 100 and above requires an 80 wire cable. If you connect it with a 40 wire cable(the ones commonly used on optical drives), you will be limited to ATA 66 or 33 speeds IIRC. You can tell the difference because the bumps on an 80 wire ribbon cable are much finer than on a 40 wire cable.

Also, please post the output of:

# hdparm -tT /dev/hdx

where 'x' corresponds to the slow drive device file. I checked your prior psts but didn't see this data. That will tell me for sure whether you are running at ATA 66.

Last edited by kilgoretrout; 11-11-2005 at 08:20 AM.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Backup FC3 installation using partimage linuxmandrake Fedora 3 07-19-2005 02:43 PM
Tar and partimage backup strategy jrdioko Linux - Software 1 06-08-2005 07:50 PM
backup to CD (mondo-rescue, dar or partimage) simon196405 Linux - Software 1 11-27-2004 03:09 AM
Partimage backup questions jrdioko Linux - Newbie 11 09-24-2004 04:22 PM
Using partimage with network backup Swift&Smart Linux - Software 2 06-19-2003 11:42 PM


All times are GMT -5. The time now is 07:58 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration