LinuxQuestions.org
Help answer threads with 0 replies.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices

Reply
 
Search this Thread
Old 03-11-2010, 10:39 AM   #1
rontay
LQ Newbie
 
Registered: Mar 2010
Posts: 5

Rep: Reputation: 0
RAID1 resync very VERY slow using mdadm


I am running Kernel 2.6.18-128.el5 on a 64bit quad core machine with 8GB RAM. Using "mdadm" I setup a RAID1 array between two Western Digital 1.5TB drives. The problem is that the resync is running VERY slow. Here is a current status.

[root@royalflush shared]# cat /proc/mdstat Personalities : [raid1]
md1 : active raid1 hdc5[1] hda5[0]
1304493952 blocks [2/2] [UU]
[=>...................] resync = 6.2% (81592192/1304493952) finish=4280156.0min speed=4K/sec

unused devices: <none>
 
Old 03-11-2010, 11:02 AM   #2
troop
Member
 
Registered: Feb 2010
Distribution: gentoo, arch, fedora, freebsd
Posts: 379

Rep: Reputation: 96
try echo 10000 > /proc/sys/dev/raid/speed_limit_min
would't bad sectors on hdd? smart is clear?
 
Old 03-11-2010, 01:59 PM   #3
rontay
LQ Newbie
 
Registered: Mar 2010
Posts: 5

Original Poster
Rep: Reputation: 0
Quote:
Originally Posted by troop View Post
try echo 10000 > /proc/sys/dev/raid/speed_limit_min
would't bad sectors on hdd? smart is clear?

I tried "10000 > /proc/sys/dev/raid/speed_limit_min", but it did not change the speed at all.


The are drives are new and work fine as a single drive.

"smart is clear?" not sure what you are asking here.
 
Old 03-11-2010, 02:52 PM   #4
KZeeSoft
Member
 
Registered: Mar 2010
Location: MD, USA
Distribution: Debian Lenny 5.0.4
Posts: 40

Rep: Reputation: 17
What motherboard do you have, what interface are you using for the drives, are the HDDs WD Caviar "Green"s or another type of 5400rpm drive?

Did you configure this setup using LVM?

Was it installed at inital setup of Linux or after initial installation?

What is the reason for the resync?
 
Old 03-11-2010, 03:04 PM   #5
rontay
LQ Newbie
 
Registered: Mar 2010
Posts: 5

Original Poster
Rep: Reputation: 0
Quote:
Originally Posted by KZeeSoft View Post
What motherboard do you have, what interface are you using for the drives, are the HDDs WD Caviar "Green"s or another type of 5400rpm drive?

Did you configure this setup using LVM?

Was it installed at inital setup of Linux or after initial installation?

What is the reason for the resync?


I think the motherboard is an INTEL DG43GT.

The drives are WD Caviar Green (SATA 3.0G WD15EADS)

They are configured as RAID1 using mdadm. No LVM.
This was done after initial install.
Its actually just continuing its initial sync.
At 6% over 15 hours. See the drive info below.

Another strange thing is that they show up as hda instead of sda.



[root@royalflush ~]# hdparm -i /dev/hda

/dev/hda:

Model=WDC WD15EADS-00S2B0, FwRev=04.05G04, SerialNo=WD-WCAVY0902668
Config={ HardSect NotMFM HdSw>15uSec SpinMotCtl Fixed DTR>5Mbs FmtGapReq }
RawCHS=16383/16/63, TrkSize=0, SectSize=0, ECCbytes=50
BuffType=unknown, BuffSize=32767kB, MaxMultSect=16, MultSect=16
CurCHS=16383/16/63, CurSects=16514064, LBA=yes, LBAsects=268435455
IORDY=on/off, tPIO={min:120,w/IORDY:120}, tDMA={min:120,rec:120}
PIO modes: pio0 pio3 pio4
DMA modes: mdma0 mdma1 mdma2
UDMA modes: udma0 udma1 udma2
AdvancedPM=yes: unknown setting WriteCache=enabled
Drive conforms to: Unspecified: ATA/ATAPI-1 ATA/ATAPI-2 ATA/ATAPI-3 ATA/ATAPI-4 ATA/ATAPI-5 ATA/ATAPI-6 ATA/ATAPI-7

* signifies the current active mode

[root@royalflush ~]# hdparm -i /dev/hdc

/dev/hdc:

Model=WDC WD15EADS-00P8B0, FwRev=01.00A01, SerialNo=WD-WCAVU0323312
Config={ HardSect NotMFM HdSw>15uSec SpinMotCtl Fixed DTR>5Mbs FmtGapReq }
RawCHS=16383/16/63, TrkSize=0, SectSize=0, ECCbytes=50
BuffType=unknown, BuffSize=32767kB, MaxMultSect=16, MultSect=16
CurCHS=16383/16/63, CurSects=16514064, LBA=yes, LBAsects=268435455
IORDY=on/off, tPIO={min:120,w/IORDY:120}, tDMA={min:120,rec:120}
PIO modes: pio0 pio3 pio4
DMA modes: mdma0 mdma1 mdma2
UDMA modes: udma0 udma1 udma2
AdvancedPM=no WriteCache=enabled
Drive conforms to: Unspecified: ATA/ATAPI-1 ATA/ATAPI-2 ATA/ATAPI-3 ATA/ATAPI-4 ATA/ATAPI-5 ATA/ATAPI-6 ATA/ATAPI-7

* signifies the current active mode
 
Old 03-11-2010, 07:16 PM   #6
KZeeSoft
Member
 
Registered: Mar 2010
Location: MD, USA
Distribution: Debian Lenny 5.0.4
Posts: 40

Rep: Reputation: 17
OK, so we know that:

- your drives are only capable of handling 5400rpm
- your drives are running abnormally slow in the resync(4k/s)
- you already had a working partitioning scheme prior to using mdadm
- your first drive and second drive differ by:

AdvancedPM=yes: unknown setting WriteCache=enabled

AdvancedPM=no WriteCache=enabled



From this, I can say that it is possible your setup of mdadm was wrong. Did you change the ports in which your mobo served these sata drives?
If there was no hardware changes or bios changes, I would say you would be better to reinstall your system, this time setting up your RAID array in the installation of Linux, rather than trying to set it up after the fact. If your drives are under heavy load while it is trying to setup a RAID array, this can also cause this.

In my opinion... backup your data, wipe the drives and start from scratch.

It may take awhile to get it done, but it won't take the days it currently is showing to complete.
 
Old 03-12-2010, 07:56 AM   #7
rontay
LQ Newbie
 
Registered: Mar 2010
Posts: 5

Original Poster
Rep: Reputation: 0
Quote:
Originally Posted by KZeeSoft View Post
OK, so we know that:

- your drives are only capable of handling 5400rpm
- your drives are running abnormally slow in the resync(4k/s)
- you already had a working partitioning scheme prior to using mdadm
- your first drive and second drive differ by:

AdvancedPM=yes: unknown setting WriteCache=enabled

AdvancedPM=no WriteCache=enabled



From this, I can say that it is possible your setup of mdadm was wrong. Did you change the ports in which your mobo served these sata drives?
If there was no hardware changes or bios changes, I would say you would be better to reinstall your system, this time setting up your RAID array in the installation of Linux, rather than trying to set it up after the fact. If your drives are under heavy load while it is trying to setup a RAID array, this can also cause this.

In my opinion... backup your data, wipe the drives and start from scratch.

It may take awhile to get it done, but it won't take the days it currently is showing to complete.


So, It turns out there are some reported issues with the "WD15EADS-00P8B0" model drives. This is the newest one I added to the system. I plan to return it for a different one. I am thinking I may go with Seagate this time. WD seems to be going downhill. Also, I am going to wipe and reload like you suggested. I think this time I will create a RAID 1 array for the system and data. The previous RAID 1 was only for data partition. Are there any suggestions as far as what not to use RAID 1 for on Linux? I assume the swap partition would be the only thing I would not want to mirror.
 
Old 03-13-2010, 10:13 AM   #8
KZeeSoft
Member
 
Registered: Mar 2010
Location: MD, USA
Distribution: Debian Lenny 5.0.4
Posts: 40

Rep: Reputation: 17
On my server, I have 8 partitions. I have them all in RAID 1 except the swap. I would suggest adding the swap as a RAID 0, that way if your server hits heavy load it can benefit from the RAID 0 striping. Plus that would double the amount of swap you put out =)
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
How do I Avoid a full raid resync with mdadm. JivanAmara Linux - Software 1 08-01-2010 02:50 PM
mdadm raid1 both bootable chiendarret Linux - Server 1 03-09-2009 07:53 AM
Very slow raid5 resync alex6666 Linux - Hardware 3 12-12-2008 08:27 AM
How do I resync a "dirty" software raid1? isync Linux - Server 2 06-04-2007 01:12 AM
Can't stop mdadm resync! mackdav Linux - Server 3 03-27-2007 12:57 PM


All times are GMT -5. The time now is 02:19 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration