LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 08-21-2014, 04:41 PM   #1
linuxbird
Member
 
Registered: Feb 2006
Distribution: Slackware
Posts: 543

Rep: Reputation: 36
drive, raid strategy


I have a rather large network (35 or so units) which I serve with several file servers, however /home is on one server. I am trying to enhance reliability, and am considering the following:

/home as a single drive on the server
a software RAID on that same server, rsyncing /home to the RAID once or twice a day

Why not /home on the RAID? I am trying to keep power consumption down, and intra day reliability is not as important as inter day reliability. Also, I have no problem firing up the raid discs when doing an rsync, or even accessing data kept ont he raid, but I am trying to reduce the raid drive hours, and the power consumption, hence the single drive on strategy.

Comments?

I am also thinking of using a small SSD as cache, but I haven't dug into that as of yet.

Also the type raid, (1, 5, 6) has not been determined yet, and may be the topic of another post.

Thanks for any comments.
 
Old 08-22-2014, 09:48 AM   #2
rupertwh
Member
 
Registered: Sep 2006
Location: Munich, Germany
Distribution: Debian / Ubuntu
Posts: 297

Rep: Reputation: 49
Quote:
Originally Posted by linuxbird View Post
... but I am trying to reduce the raid drive hours, and the power consumption, hence the single drive on strategy.
You are aware that you are talking about reduction of power consumption of around 1%?
Check out e.g. http://www.buildcomputers.net/power-...omponents.html
 
1 members found this post helpful.
Old 08-23-2014, 11:12 PM   #3
lleb
Senior Member
 
Registered: Dec 2005
Location: Florida
Distribution: CentOS/Fedora/Pop!_OS
Posts: 2,983

Rep: Reputation: 551Reputation: 551Reputation: 551Reputation: 551Reputation: 551Reputation: 551
see above. RAID10 with 4 disks will most likely be your best power/performance/reliability and have that rsynced to a RAID10 that is 7 times the size as the /home RAID10.

logic behind 7x is simple. this will give you 5 days of roll backs for the users and also allow for a little bit of expansion before you need to increase the size of the RAID.

depending on how important write speed is you might want to look into RAID6 over RAID10 to increase storage space on the drives.

ex: RAID10 with 6 drives at 3TB each will provide you with just under 9TB total storage
RAID6 with 6 drives at 3TB each will provide you with just under 12TB total storage

both will provide you with 2 disks of redundancy and fail over. RAID10 has better write performance, but the same read performance over RAID6. so that will depend on what your needs are for the network.

Also with the new RHEL v7 using xfs if you have the RAM then software RAID for your small LAN will be more then powerful enough.

keep in mind that xfs will eat up your RAM if you are less then 8G total on the server or even 16G for that matter. Its roughly 1G for each TB or storage you want to software RAID for good performance with xfs from what I've read.
 
1 members found this post helpful.
Old 08-24-2014, 08:25 AM   #4
linuxbird
Member
 
Registered: Feb 2006
Distribution: Slackware
Posts: 543

Original Poster
Rep: Reputation: 36
Quote:
Originally Posted by rupertwh View Post
You are aware that you are talking about reduction of power consumption of around 1%?
Check out e.g. http://www.buildcomputers.net/power-...omponents.html
Nice link, but I differ with some of their numbers. For example, I see about 7 to 8W for every hard drive that is spun up. My current server runs about 58W at idle, and if everything spins up, it can draw peaks over 400W. I know that I can watch the power draw (at 120V) and see it jump up 8W or so with each drive that comes online. Their idle, at least for the drives I have, range from about 0.5 to 2W.

Also when I monitor line voltage power usage, I am also factoring in any inefficiencies with the power supply. Not as bad as it used to be, but it is still there.

Temperature controlled fans save more like 1%, but they keep the boxes quieter.

So not running 4 drives 24/7 has real savings. And it is much more than a percent, in my case.
 
Old 08-24-2014, 08:42 AM   #5
linuxbird
Member
 
Registered: Feb 2006
Distribution: Slackware
Posts: 543

Original Poster
Rep: Reputation: 36
Quote:
Originally Posted by lleb View Post

keep in mind that xfs will eat up your RAM if you are less then 8G total on the server or even 16G for that matter. Its roughly 1G for each TB or storage you want to software RAID for good performance with xfs from what I've read.
That is a good data point. Several references suggested XFS.
High performance is not high on my list of objectives, rather it is reliability and power consumption.

I had also considered front-ending the hard drives with a SSD.

I am using Slackware, therefore sticking with Slackware would have some benefit, but I have yet to find someone who is using bm-cache. There would be a trade between using bm-cache and using xfs, it seems. How to spend your memory, and how much is needed.
 
Old 08-25-2014, 07:44 AM   #6
rupertwh
Member
 
Registered: Sep 2006
Location: Munich, Germany
Distribution: Debian / Ubuntu
Posts: 297

Rep: Reputation: 49
Quote:
Originally Posted by linuxbird View Post
Nice link, but I differ with some of their numbers. For example, I see about 7 to 8W for every hard drive that is spun up. My current server runs about 58W at idle, and if everything spins up, it can draw peaks over 400W. I know that I can watch the power draw (at 120V) and see it jump up 8W or so with each drive that comes online. Their idle, at least for the drives I have, range from about 0.5 to 2W.
I admit I was thinking 2.5" drives. (which might also be an option to reduce power consumption)

If you do want to work with just one drive active, I'd still consider a RAID-only solution:

Let's say you have three drives. Build e.g. a RAID 1 with those three drives. Make sure every drive is bootable. Then fail/remove two of them and put them to sleep. The remaing drive is your designated 'master' which is always running.

Once or trwice a day, readd one of the drives to the raid array. When the syncing is done, fail/remove/sleep. Alternate the two drives, so that you always have at least one consistent drive from which you could boot and rebuild the array when the master fails.
 
1 members found this post helpful.
Old 08-25-2014, 10:38 PM   #7
linuxbird
Member
 
Registered: Feb 2006
Distribution: Slackware
Posts: 543

Original Poster
Rep: Reputation: 36
Quote:
Originally Posted by rupertwh View Post

If you do want to work with just one drive active, I'd still consider a RAID-only solution:
That's a creative approach. My configuration would have a SSD as the system drive, so I would be booting from that.

I was figuring that the same SSD would be a cache as well. So I could take this a step further, and spin down the remaining RAID drive, until needed, with the idea that some things might be cached (or forced to be cached) in a dedicated partition on the SSD.

...slightly off topic, but I am learning that using various drive sizes in the RAID is not a good idea. I would have thought for RAID-6 or something similar, there would be a arbitrary size option.

Let's touch on filesystems...after reading, I am disinclined to use xfs or zfs, and rather use ext4. The former have nice features but support perhaps reliability due to support and implementation might be lacking. The later is more bulletproof, but lacks the checks which could enhance reliability.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] IDE drive on laptop died - new strategy? linuxbird Linux - Hardware 6 11-23-2012 08:38 PM
Strategy for keeping external hard drive synced with home with 2 distributions vharishankar Linux - General 8 11-04-2011 05:09 AM
How long does hardware Raid card (raid 1) take to mirror 1 TB drive (500gb used)? abefroman Linux - Server 1 03-23-2011 11:41 AM
[SOLVED] Partition Strategy -> SSD Drive jv2112 Linux - Hardware 10 10-20-2010 03:49 AM
Partition strategy for 120 Gb ext. drive oomfoofoo Linux - General 4 08-26-2005 01:09 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 10:20 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration