LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Debian
User Name
Password
Debian This forum is for the discussion of Debian Linux.

Notices


Reply
  Search this Thread
Old 11-23-2007, 02:46 PM   #1
mikep-fl
LQ Newbie
 
Registered: Nov 2007
Location: Central FL
Distribution: Debian, OpenSuSe, Knoppix primarily
Posts: 3

Rep: Reputation: 0
Debian Installer + Software RAID5 + LVM2 + ext3 = write performance of ?


Have a Debian Etch install which is showing some poor performance when writing to the drives. According to top, my IOWaits get into the 70% to 100% range while trying to write to the drives files of more than a few megabytes. Writing a file with gigabytes of data will put the server into this high IOWaits state for tens of minutes after the writing of the file displays as completed at the command line.

Setup is four 500GB SATA drives with Software RAID5 to bind them together and LVM2 to create separate logical volumes with EXT3 as the top level filesystem. This is running on an Opteron system with 4GB of RAM using the motherboard's SATA controller to connect the drives.

Reading through the Software RAID howto, I found the stride=nn option for mkfs.ext3. Unfortunately, I do not find anything confirming if the Debian installer recognizes the option should be used when creating a ext3 filesystem ontop of a software RAID. With the write scheme RAID5 uses, I could see the stride option not being used as a significant contributing factor to the poor write performance I'm seeing.

During my google searches, I found a fellow on another site having a similarly described problem asking the same question in the last year. However, he never received an answer to the Debian installer functionality question.

Last edited by mikep-fl; 11-23-2007 at 02:48 PM.
 
Old 11-24-2007, 06:13 PM   #2
Dutch Master
Senior Member
 
Registered: Dec 2005
Posts: 1,686

Rep: Reputation: 124Reputation: 124
Just an idea: perhaps one (or worse: more then 1) of your disks might be failing. Not likely if they're quite new though...

Ext3 isn't the best of filesystems for dealing with large files. So the performance-hit you see may not be so unexpected. Check this comparision between the various filesystems on Wiki: http://en.wikipedia.org/wiki/Comparison_of_file_systems Also, I've read a review from someone, but didn't bookmark it and I can't find it now. But that review put XFS as the best suitable filesystem for dealing with large files, closely followed by JFS and on some distance ReiserFS.
 
Old 11-26-2007, 07:47 AM   #3
mikep-fl
LQ Newbie
 
Registered: Nov 2007
Location: Central FL
Distribution: Debian, OpenSuSe, Knoppix primarily
Posts: 3

Original Poster
Rep: Reputation: 0
Drives were delivered over the summer. Hardware failuring is always a possiblity, but I would expect to get some alerts in the logs from SMART or mdadm if any of the drives are. None have been seen so far.

Another possiblity I have run across is the size of the 'stripe cache'. I've found a couple references promoting making it larger to improve write performance under RAID5. Etch's default appears to be 256.
 
Old 11-26-2007, 09:22 AM   #4
mikep-fl
LQ Newbie
 
Registered: Nov 2007
Location: Central FL
Distribution: Debian, OpenSuSe, Knoppix primarily
Posts: 3

Original Poster
Rep: Reputation: 0
Things found while researching. Figuring they may be of use to others.

http://wiki.novell.com/index.php/File_System_Primer
http://wiki.novell.com/index.php/Linux_Data_Management
http://www.ubuntugeek.com/how-to-inc...rformance.html
http://oss.sgi.com/projects/xfs/
http://wiki.centos.org/HowTos/Disk_Optimization
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
MD Raid5 Performance issue yepp Linux - Hardware 1 10-11-2006 09:30 AM
Debian Installer - Is Ext3 Default Filesystem? mikieboy Debian 1 03-01-2006 08:14 AM
lvm2 booting - can't find ext3 yorgodillo Fedora 2 11-18-2005 04:02 PM
Software RAID5 - poor write performance & freezing Nitrowolf Linux - Hardware 3 09-25-2005 09:49 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Debian

All times are GMT -5. The time now is 12:38 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration