LinuxQuestions.org
Review your favorite Linux distribution.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 11-20-2017, 05:58 PM   #1
road hazard
Member
 
Registered: Nov 2015
Posts: 257

Rep: Reputation: Disabled
mdadm and parity checking and advice for RAID expansion


Getting ready to re-do my Plex server and will be taking my existing setup (8, 4TB drives RAID 6 on a PERC H700) to either:

8, 4TB drives hooked to a HBA (IBM 1015 in 'IT' mode)
4, 4TB drives hooked to my motherboard
using mdadm RAID 6 (eliminating the PERC) to combine them all
Linux Mint 18.2

or

12, 4TB drives hooked to an Intel SAS expander and using a SFF-8087 male-to-male cable and feeding them into an LSI 9361-8i and combining the drives into a hardware RAID 6
Linux Mint 18.2

Couple of questions. My CPU will be an i7 7700K. How fast would the rebuild times be with mdadm vs a dedicated RAID card? Or will the bottleneck be my hard drive write speed?

A few things bother me about mdadm though. I know that Neil stepped down maintaining it and somebody else took over but, what if the new guy gets tired of it and nobody else wants to step up to the plate? With file systems like ZFS and BTRFS, is mdadm a dead man walking?

Secondly, from reading around, it seems that when mdadm is doing a scrub (or resync?), it always assumes the data is correct and if it fails any sort of check, it doesn't 'vote' on who has the correct data. The data on the drive or the parity bits (RAID 6). It just re-writes the parity bits. (Hope I'm explaining that right.) I know that mdadm is used in a lot of boxes (Synology, QNAP, etc) and if they don't seem to be losing any sleep over it, neither should I, right?

Looking for thoughts/opinions. Thanks!
 
Old 11-21-2017, 11:57 AM   #2
MensaWater
LQ Guru
 
Registered: May 2005
Location: Atlanta Georgia USA
Distribution: Redhat (RHEL), CentOS, Fedora, CoreOS, Debian, FreeBSD, HP-UX, Solaris, SCO
Posts: 7,831
Blog Entries: 15

Rep: Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669
Have you thought about moving the H700 to the new server? Or if it is built into MB how about getting an Avago RAID controller? Avago bought LSI and LSI made the PERC OEM controllers. you might even be able to read the config off your existing drive on an Avago controller to recover your raid in the new system.

PERC despite "Power Edge" in its name works in other non-Dell servers because it is just an OEM from LSI (Avago). Similarly some other server brands also have OEMed cards that can be moved to different server brands - long ago I was running a Compaq RAID card in an old Dell PE.
 
Old 11-21-2017, 12:27 PM   #3
road hazard
Member
 
Registered: Nov 2015
Posts: 257

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by MensaWater View Post
Have you thought about moving the H700 to the new server? Or if it is built into MB how about getting an Avago RAID controller? Avago bought LSI and LSI made the PERC OEM controllers. you might even be able to read the config off your existing drive on an Avago controller to recover your raid in the new system.

PERC despite "Power Edge" in its name works in other non-Dell servers because it is just an OEM from LSI (Avago). Similarly some other server brands also have OEMed cards that can be moved to different server brands - long ago I was running a Compaq RAID card in an old Dell PE.
The PERC is just a PCI card and can be moved. I'm just trying to remove failure points and if MDADM is the same speed as using a dedicated raid 6 card, what am I buying myself by sticking with a card when I can just do it in software?

I find myself entertaining the idea of ZFS again because with de-dupe turned off and no compression or snapshots, maybe it won't be such a RAM pig? Is it worth using it due to bit-rot or is bit-rot just a boogeyman?
 
Old 11-21-2017, 03:05 PM   #4
MensaWater
LQ Guru
 
Registered: May 2005
Location: Atlanta Georgia USA
Distribution: Redhat (RHEL), CentOS, Fedora, CoreOS, Debian, FreeBSD, HP-UX, Solaris, SCO
Posts: 7,831
Blog Entries: 15

Rep: Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669
I've not used ZFS (even when I was on Solaris) and since Oracle owns it now I'd be wary of relying on it as they might do to it what they did to OpenOffice.

In fact there are hints of that in this article which also points out the it isn't GPL so you might run into other issues using it if Oracle asserts their rights:
https://www.theregister.co.uk/2017/1...fs_into_linux/
The title by the way is incorrect. If you read the article what it actually says is one guy wishes they would consider it - not that they are.
 
Old 11-21-2017, 03:08 PM   #5
MensaWater
LQ Guru
 
Registered: May 2005
Location: Atlanta Georgia USA
Distribution: Redhat (RHEL), CentOS, Fedora, CoreOS, Debian, FreeBSD, HP-UX, Solaris, SCO
Posts: 7,831
Blog Entries: 15

Rep: Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669
So far as PERC/LSI goes I've not seen many failures over the 13 years I've been using them. On the rare occasion one does fail replacing it with another and reading in the config from the drives restores the RAID set without data loss.
 
Old 11-21-2017, 05:30 PM   #6
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,142

Rep: Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123
If one were to be extremely concerned re the future of mdadm, LVM would be the obvious other contender (in software).
I find it much more flexible, and you might consider it less likely RH are going to vanish into thin air. BTW I use both at present, and see no reason to change. I also use btrfs specifically for RAID5/6 and have, successfully, for years.
Lots of options, lots of horror stories out there in the wild. Believe what you will.

I don't have any hardware RAID, so I'll sidestep that discussion.
 
Old 11-22-2017, 07:25 AM   #7
MensaWater
LQ Guru
 
Registered: May 2005
Location: Atlanta Georgia USA
Distribution: Redhat (RHEL), CentOS, Fedora, CoreOS, Debian, FreeBSD, HP-UX, Solaris, SCO
Posts: 7,831
Blog Entries: 15

Rep: Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669Reputation: 1669
Quote:
Originally Posted by syg00 View Post
If one were to be extremely concerned re the future of mdadm, LVM would be the obvious other contender (in software).I find it much more flexible
I definitely agree one should use LVM for the flexibility it brings. We use it both for our hardware RAID (PERC/AVAGO) internal LUNs and for LUNs presented from our SAN disk array. We've also used it for mirroring to migrate from one disk array to another to avoid downtime.

I haven't any other level of LVM RAID since I typically have at least hardware RAID for internal and for larger systems, the SAN LUNs which are created from RAID within the disk array.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Is this enough for us to have triple-parity RAID? creamyfish Linux - Server 1 05-02-2012 01:03 AM
parity checking without raid? bonfire89 Linux - General 5 02-22-2010 05:20 PM
What is the parity in RAID 5 bharatlalgupta Linux - Enterprise 1 01-14-2010 06:38 AM
boot hang by sym0 parity checking Slydder Linux - General 0 01-20-2006 03:18 AM
Use mdadm create raid-5 with parity error Friarchen Linux - Software 1 10-08-2004 02:12 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 02:54 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration