LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 12-25-2016, 02:44 PM   #1
trist007
Senior Member
 
Registered: May 2008
Distribution: Slackware
Posts: 1,052

Rep: Reputation: 70
Should I use LVM on a motherboard controller RAID 5...


I have a raid controller on the motherboard. I want to do a RAID 5( 3 x 4TB drives) for my media server. I don't do that many writes and it's great to have the mirroring in case 1 drive fails. I am going to mount this baby on /home. But I'm trying to decide if I should go LVM or not. The OS will be on the root partition another set of drives.

For now I will have Slackware 14.2 but say down the road if I need to install Slackware 15.2 from scratch using the same exact hardware, how easy would it be to move the LVM to the new OS using the same hardware. This my main concern. Is it simply when I install the new OS fresh the OS will recognize that the volumes are LVM (I am going to use the lvm label in fdisk) and I simply mount the /dev/sd(x)? I have never done it. It feels like it would be rather difficult if this is not the case. I'd have to almost install the OS on a separate computer and rsync the data over, which I don't want to do.

Although it would be nice with LVM in case I want to expand it or for LVM snapshots but I don't think I will need that. 8TB is more than enough for me, plus I don't have that many more free sata slots on my motherboard. Plus the mirroring ability will take the place of LVM snapshots.

So I don't know which to go.

-Tristan
 
Old 12-25-2016, 04:38 PM   #2
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,131

Rep: Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121
LVM has meta-data that identifies it - been a while since I looked at Slack, but the initrd should find it for you, else a simple "vgchange -ay" should do.

I'd be more worried about the m/board failing - will you be able to re-construct the RAID devices properly. I didn't see any mention of backups.

Last edited by syg00; 12-25-2016 at 05:06 PM. Reason: typo
 
Old 12-25-2016, 05:08 PM   #3
trist007
Senior Member
 
Registered: May 2008
Distribution: Slackware
Posts: 1,052

Original Poster
Rep: Reputation: 70
Yea if the motherboard fails. I'd have to get the same exact motherboard to reconstruct the RAID 5 or do I simply write down the size of the parity and stripes in which case any motherboard that support RAID 5 would do?

-Tristan
 
Old 12-25-2016, 09:45 PM   #4
wpeckham
LQ Guru
 
Registered: Apr 2010
Location: Continental USA
Distribution: Debian, Ubuntu, RedHat, DSL, Puppy, CentOS, Knoppix, Mint-DE, Sparky, VSIDO, tinycore, Q4OS,Manjaro
Posts: 5,662

Rep: Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710
Quote:
Originally Posted by trist007 View Post
Yea if the motherboard fails. I'd have to get the same exact motherboard to reconstruct the RAID 5 or do I simply write down the size of the parity and stripes in which case any motherboard that support RAID 5 would do?

-Tristan
First: RAID is not a backup, and does not secure your data. You need a backup system and schedule. Setting up a BURP server might be indicated.

Second: Odds are against being able to replicate the motherboard setup well enough to recover from a MB failure, even on an identical MB. Different vendors implement the low levels differently, at times even between minor model numbers.

Plan for catastrophic failure by keeping regular full backups. Disaster Recovery will consist of bringing up a replacement server on different hardware with adequate storage to allow a full restore from backup.

LVM is always a good option. It recovers from some issues better than a raw file system, and it allows you to make certain kinds of on-the-fly storage changes without downtime. It is not required for a situation like yours, but I would not advise against using it.
 
Old 12-26-2016, 10:04 AM   #5
trist007
Senior Member
 
Registered: May 2008
Distribution: Slackware
Posts: 1,052

Original Poster
Rep: Reputation: 70
Ok great ty.
 
Old 12-26-2016, 10:36 AM   #6
trist007
Senior Member
 
Registered: May 2008
Distribution: Slackware
Posts: 1,052

Original Poster
Rep: Reputation: 70
How for the sake of understanding, what if I simply had 3 disks each 4 TB and put them all in one volume group. This will allow for 8 TB of space in the volume group to be used for LVM snapshots. I only use 4 TB for the LVM. Then if the disk that the LVM is being used for fails, can I not simply mount the LVM snapshot to take its place?

If that disk fails, are the errors informative enough so that I can tell which drive in the VG failed?

This would thereby avoid RAID all togther. Turns out my motherboard does not have a raid controller and I don't want to use those PCI ones.

Or avoid RAID and LVM all together and simply use 1 of the 3 disks for the data and the other 2 as backups. Then simply rsync the diffs over nightly. Assuming I do not have an option for backups off site.

-Tristan

Last edited by trist007; 12-26-2016 at 10:40 AM.
 
Old 12-26-2016, 11:24 AM   #7
sundialsvcs
LQ Guru
 
Registered: Feb 2004
Location: SE Tennessee, USA
Distribution: Gentoo, LFS
Posts: 10,667
Blog Entries: 4

Rep: Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945
Essentially, the power of LVM is that it separates the physical picture from the logical one. You can allocate, and re-allocate, physical storage to support the logical view, without changing that view. This can handle running out of space, or volumes that are beginning to fail, and many other situations that happen in real life.

I very-flatly recommend that you should use it all the time.
 
Old 12-26-2016, 04:07 PM   #8
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,131

Rep: Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121
LVM is not a silver bullet - it still requires sane sysadmin practices. Especially where multi-volume lvs are involved.
And snaps are definitely not backups. They are great sources for backups, but are also susceptible to breakage when hardware dies - so both the original data and the snaps are likely to disappear at the same time if a disk breaks in a vg. And they burn up disk space if left unmanaged.
Having backups in the same machine (even on separate disk(s)) is not an acceptable backup IMHO. Better than nothing, but only just. I might be inclined to simply use RAID1 and have the third disk as a hot replacement - current LVM allows for failure policy where you can specify LVM to automatically replace and synch a failed disk.
You still have to watch the logs continually.

All of the above does not weaken the requirement for an external backup.
 
Old 12-26-2016, 08:11 PM   #9
trist007
Senior Member
 
Registered: May 2008
Distribution: Slackware
Posts: 1,052

Original Poster
Rep: Reputation: 70
Alright, I'll do a RAID 1. I'm going to need a PCI RAID controller. Can you guys recommend any that are compatible with kernel 4.4.14? Preferably one that works with the megaraid software suite.

-Tristan
 
Old 12-26-2016, 08:22 PM   #10
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,131

Rep: Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121
You don't need a hardware card, although they are a good (best ?) option.
Software raid (at the Linux level) is extremely robust - see the wiki here.
These days LVM can manage (and setup) RAID without the need for the user to manually set up RAID volumes beforehand. Works a treat.
 
1 members found this post helpful.
Old 12-27-2016, 06:18 AM   #11
wpeckham
LQ Guru
 
Registered: Apr 2010
Location: Continental USA
Distribution: Debian, Ubuntu, RedHat, DSL, Puppy, CentOS, Knoppix, Mint-DE, Sparky, VSIDO, tinycore, Q4OS,Manjaro
Posts: 5,662

Rep: Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710Reputation: 2710
Quote:
Originally Posted by syg00 View Post
You don't need a hardware card, although they are a good (best ?) option.
Software raid (at the Linux level) is extremely robust - see the wiki here.
These days LVM can manage (and setup) RAID without the need for the user to manually set up RAID volumes beforehand. Works a treat.
It may be dated (almost a year old now) but this article discusses LVM raid. http://unix.stackexchange.com/questi...-pros-and-cons

If that is still accurate, LVM raid is still less than mature in terms of failure recovery and tool maturity. LVM over MD is may still be the better option. MDRAID and LVM are both quite mature, but the RAID features of LVM may be less so.

Although it seems entirely counter-intuitive, I have found software raid on a fast controller and with adequate CPU power FASTER than hardware raid. That result may be representative only for the particular hardware I used for testing, but is something to keep in mind. It appears that the communication between MD and LVM is quite advanced and well developed to optimize performance.

I would experiment with RAID1 or RAID5 in software on your current controller, using LVM and EXT4. IF that will serve your needs, that may be all you need. Advantage: the configuration is well tested and documented. There must be dozens of good (and a few bad) how-to documents on the web for this configuration.

Another thought: BTRFS does RAID1 nicely and easily. The RAID5 and RAID6 recovery code has known behavior issues, and I would not recommend them, but RAID1 appears solid. It is much easier to set up BTRFS raid than any other kind. The performance is lightly less than EXT4, and the recovery tools are nto as mature as MDRAID tools. I consider BTRFS adequate for a laptop or workstation, but not for a critical server. BTRFS may not apply today, but is something we should keep our eyes on for future application.
 
Old 12-27-2016, 11:03 AM   #12
trist007
Senior Member
 
Registered: May 2008
Distribution: Slackware
Posts: 1,052

Original Poster
Rep: Reputation: 70
ok ty
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Raid + LVM add new raid device to LVM, problem request Linux - Server 3 08-15-2012 04:06 AM
Fake raid , software, hardware raid. Are any transportable to new motherboard OuldeFauder Linux - Hardware 6 11-06-2009 07:33 PM
Drivers for Promise PDC42819 RAID Controller on MSI K9A2 Platinum Motherboard viron Linux - Hardware 40 06-13-2009 06:53 AM
Driver for intel raid controller for D955XBK motherboard chipset kwhom Linux - Newbie 1 04-16-2009 03:17 PM
RAID controller card override onboard RAID controller? Dr. Psy Linux - Enterprise 1 05-30-2005 10:35 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 01:44 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration