LinuxQuestions.org
Help answer threads with 0 replies.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 02-09-2017, 03:19 PM   #1
thirdbird
LQ Newbie
 
Registered: Feb 2017
Distribution: Debian
Posts: 20

Rep: Reputation: Disabled
mdadm raid10 with 6 drives or more


I'm experimenting a lot with mdadm lately and finding that regardless of how many drives I use, e.g. if I create a --level=10 with 6 or even 8 drives, it will only create 2 mirrored sets like it does with 4 drives where that's the only possible option. Example follows.

Command used:
Code:
mdadm --create /dev/md1 --level=10 --raid-devices=8 /dev/{sdc,sdd,sde,sdf,sdg,sdh,sdi,sdj}
Result:
Code:
Number   Major    Minor   RaidDevice  State
       0       8       32        0      active sync set-A   /dev/sdc
       1       8       48        1      active sync set-B   /dev/sdd
       2       8       64        2      active sync set-A   /dev/sde
       3       8       80        3      active sync set-B   /dev/sdf
       4       8       96        4      active sync set-A   /dev/sdg
       5       8      112        5      active sync set-B   /dev/sdh
       6       8      128        6      active sync set-A   /dev/sdi
       7       8      144        7      active sync set-B   /dev/sdj
Do I need to use nesting to achieve a stripe of 2x mirrors? Am I reading the result wrong - are they separate sets? (which would be very confusing and unclear). I'm trying to figure out if I'm missing a parameter or if this is expected behavior unless going nested.

Thanks.

Last edited by thirdbird; 02-09-2017 at 03:23 PM.
 
Old 02-09-2017, 07:01 PM   #2
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 20,599

Rep: Reputation: 3923Reputation: 3923Reputation: 3923Reputation: 3923Reputation: 3923Reputation: 3923Reputation: 3923Reputation: 3923Reputation: 3923Reputation: 3923Reputation: 3923
That is what RAID10 is - RAID1 (a stripe set) + 0 (mirroring). Anything using/mirroring less than the full stripe set will not be (point-in-time) synching all the data.

I don't know what you mean by "nested" - alter the above printout to elucidate me pls.
 
Old 02-09-2017, 07:13 PM   #3
thirdbird
LQ Newbie
 
Registered: Feb 2017
Distribution: Debian
Posts: 20

Original Poster
Rep: Reputation: Disabled
This would be nested 1+0 where you can actually define how many drives are in each mirrored set that's being striped.

Quote:
# mdadm --create /dev/md0 --level=1 --raid-devices=2 /dev/{sda,sdb}
# mdadm --create /dev/md1 --level=1 --raid-devices=2 /dev/{sdc,sdd}
# mdadm --create /dev/md2 --level=1 --raid-devices=2 /dev/{sde,sdf}
# mdadm --create /dev/md3 --run --level=0 --raid-devices=3 /dev/{md0,md1,md2}
Which would look like this:
Code:
===========================================
M	M | S | M	M | S | M	M |
===========================================
Opposed to the previous command in my OP which gives 2 mirrored sets regardless of raid devices defined, which would look like this if there was 6 drives:
Code:
===========================================
M	M	M | S | M	M	M |
===========================================
So my question remains. Am I missing an obvious parameter or something to customize the amount of mirrored sets when using --level=10 or do you need to nest arrays to achieve the desired set ranges.
 
Old 05-24-2022, 02:06 PM   #4
compo
LQ Newbie
 
Registered: May 2022
Posts: 1

Rep: Reputation: 0
My answer comes a bit late. May be interesting for others:

I agree. The RAID10-Level of mdadm is not the same as nested RAID10 aka RAID1+0. Mdadm RAID10 is some kind of special RAID10 (called at SUSE also 'Complex RAID 10' (link)), described also at Arch-Wiki (link). If you use the default layout (=n2) and you have an even number of disks, it seems to be almost like nested 1+0. But not the same in every case (e.g. adding one more disk). So if you want to be safe which disks will be used by one mirror (as me), I would use the nested RAID, because you can fix, which disks are used in every single array.

The Suse-link is very helpful for understandig this.

Regards, compo

Last edited by compo; 05-24-2022 at 02:08 PM.
 
Old 05-24-2022, 04:27 PM   #5
computersavvy
Senior Member
 
Registered: Aug 2016
Posts: 2,923

Rep: Reputation: 1216Reputation: 1216Reputation: 1216Reputation: 1216Reputation: 1216Reputation: 1216Reputation: 1216Reputation: 1216Reputation: 1216
Raid level 10 is striped + mirrored.
One needs to have a minimum of 4 drives to create the smallest raid 10 array.
The striped array is created on 2 devices which is then mirrored on 2 additional devices. Expanding that to 6 drives gives 3 striped which is mirrored to 3 drives, etc.

Your post shows 2 sets A & B. Set A is the striped set, and set B is the mirror of set A.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Drives dropping out of mdadm RAID10 randomly on boot davediehose Linux - Software 6 04-12-2013 05:58 AM
mdadm RAID10 layout : near vs. far badkuk Linux - Software 1 07-14-2012 02:55 AM
mdadm reports RAID10 has layout near=2,far=1 badkuk Linux - Software 1 06-08-2012 03:36 AM
mdadm RAID10 failure(s) grimm26 Linux - Server 1 02-14-2011 03:32 PM
soft raid10 with mdadm with everything ONLY on raid Alkisx Ubuntu 3 03-01-2009 05:41 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 08:01 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration