Slow raid 10 hardware (10MB/s on 10 disks)

cedivad · 10-25-2011, 10:27 AM

I have this setup:

http://pastebin.com/F4uXX3tv

In other words, i store millions (200 millions) of little files on this system.

hdparm shows a results of 10MB/s, on average, i'm using ext4, red hat 6.

Any idea?

TenTenths · 10-25-2011, 11:02 AM

I have to ask... what hardware are you using that'll take all those disks?

cedivad · 10-25-2011, 11:28 AM

Quote:

Originally Posted by TenTenths

I have to ask... what hardware are you using that'll take all those disks?

This is the hardware:

http://www.ovh.co.uk/dedicated_servers/hg_2011_core.xml

(12 cores, hardware raid with BBU, MegaRAID SAS card 9280-4i4e, tons of RAM, etc etc)

Disks are 10*1TB sas @7200rpm

TenTenths · 10-25-2011, 12:10 PM

Ok, so how are your disks physically and logically configured and partitioned? What does your hosting provider say about the transfer rate? I'm assuming you have some form of SLA with them.

cedivad · 10-25-2011, 12:28 PM

Quote:

Originally Posted by TenTenths

Ok, so how are your disks physically and logically configured and partitioned? What does your hosting provider say about the transfer rate? I'm assuming you have some form of SLA with them.

They only provide hardware support. It's 10 drives, on raid 10, splitter across 52 partitions, using ext4. Every disk hash 2000 subdirectory, every directory has around 1000 files.