LinuxQuestions.org
Visit Jeremy's Blog.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 04-09-2014, 11:08 PM   #1
Erk1209
LQ Newbie
 
Registered: Apr 2014
Posts: 4

Rep: Reputation: Disabled
After motherboard swap, mdadm RAID 6 fails to assemble


Hello all, first time poster here so be gentle with me. I recently upgraded my home server by installing a new Xeon e3-1270v3 and Supermicro X10SAT board. Installation was simple and I reconnected my controller card, a LSI 9211-8i. When I booted the array would not mount. I tried to stop and reassemble the array but was met with this:

root@PreciseServer:~# mdadm --assemble --scan --force -v /dev/md0
mdadm: looking for devices for /dev/md0
mdadm: Cannot assemble mbr metadata on /dev/sdl1
mdadm: Cannot assemble mbr metadata on /dev/sdl
mdadm: no recogniseable superblock on /dev/sdh1
mdadm: Cannot assemble mbr metadata on /dev/sdh
mdadm: no RAID superblock on /dev/sdd1
mdadm: no RAID superblock on /dev/sdd
mdadm: no RAID superblock on /dev/sdk1
mdadm: no RAID superblock on /dev/sdk
mdadm: no RAID superblock on /dev/sdf1
mdadm: no RAID superblock on /dev/sdf
mdadm: no RAID superblock on /dev/sdj1
mdadm: no RAID superblock on /dev/sdj
mdadm: no RAID superblock on /dev/sde1
mdadm: no RAID superblock on /dev/sde
mdadm: no RAID superblock on /dev/sdi1
mdadm: no RAID superblock on /dev/sdi
mdadm: no RAID superblock on /dev/sda5
mdadm: no RAID superblock on /dev/sda2
mdadm: no RAID superblock on /dev/sda1
mdadm: no RAID superblock on /dev/sda
mdadm: /dev/sdg is identified as a member of /dev/md0, slot 7.
mdadm: /dev/sdc is identified as a member of /dev/md0, slot 1.
mdadm: /dev/sdb is identified as a member of /dev/md0, slot 8.
mdadm: no uptodate device for slot 0 of /dev/md0
mdadm: no uptodate device for slot 2 of /dev/md0
mdadm: no uptodate device for slot 3 of /dev/md0
mdadm: no uptodate device for slot 4 of /dev/md0
mdadm: no uptodate device for slot 5 of /dev/md0
mdadm: no uptodate device for slot 6 of /dev/md0
mdadm: added /dev/sdg to /dev/md0 as 7
mdadm: added /dev/sdb to /dev/md0 as 8
mdadm: no uptodate device for slot 9 of /dev/md0
mdadm: added /dev/sdc to /dev/md0 as 1
mdadm: /dev/md0 assembled from 3 drives - not enough to start the array.

The array is supposed to be ten drives in a RAID 6. I did not partition the drives when I created the array and have been growing the array by adding whole disks as I've gone. Can someone help me understand what happened? Even better, could someone help me correct the problem so I can get my array running again?

Thanks so much for your time!
 
Old 04-10-2014, 04:16 PM   #2
smallpond
Senior Member
 
Registered: Feb 2011
Location: Massachusetts, USA
Distribution: Fedora
Posts: 4,140

Rep: Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263
First off, don't touch anything until you are sure you won't damage anything.
Check what the raid thinks it should have with:

Code:
mdadm --detail /dev/md0
and what's on one of the misbehaving disks with:
Code:
mdadm --examine /dev/sdd
mdadm --examine /dev/sdd1
Somehow sdd thinks it is partitioned now. Dump the partition table with:

Code:
parted /dev/sdd print
 
Old 04-10-2014, 05:18 PM   #3
Erk1209
LQ Newbie
 
Registered: Apr 2014
Posts: 4

Original Poster
Rep: Reputation: Disabled
Thanks for your reply. Here are the outputs you requested:

root@PreciseServer:~# mdadm --detail /dev/md0
mdadm: cannot open /dev/md0: No such file or directory
root@PreciseServer:~# mdadm --assemble /dev/md0
mdadm: /dev/md0 assembled from 3 drives - not enough to start the array.
root@PreciseServer:~# mdadm --detail /dev/md0
mdadm: md device /dev/md0 does not appear to be active.

______________________________________________________________

root@PreciseServer:~# mdadm --examine /dev/sdd
/dev/sdd:
MBR Magic : aa55
Partition[0] : 3907029167 sectors at 1 (type ee)
root@PreciseServer:~# mdadm --examine /dev/sdd1
mdadm: No md superblock detected on /dev/sdd1.
root@PreciseServer:~#

-----------------------------------------------------------------

root@PreciseServer:~# parted /dev/sdd print
Model: ATA ST2000DM001-9YN1 (scsi)
Disk /dev/sdd: 2000GB
Sector size (logical/physical): 512B/4096B
Partition Table: gpt

Number Start End Size File system Name Flags
1 1049kB 2000GB 2000GB raid

----------------------------------------------------------------

Please let me know what I should do next!
 
Old 04-10-2014, 06:34 PM   #4
Erk1209
LQ Newbie
 
Registered: Apr 2014
Posts: 4

Original Poster
Rep: Reputation: Disabled
Here is the output from a drive that's still a proper RAID component:

root@PreciseServer:~# mdadm --examine /dev/sdg
/dev/sdg:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x0
Array UUID : dff1c3d6:8528c4ba:5df0c08b:33a1a043
Name : PreciseServer:0
Creation Time : Sat Jul 7 15:34:42 2012
Raid Level : raid6
Raid Devices : 10

Avail Dev Size : 3907027120 (1863.02 GiB 2000.40 GB)
Array Size : 15628103680 (14904.12 GiB 16003.18 GB)
Used Dev Size : 3907025920 (1863.02 GiB 2000.40 GB)
Data Offset : 2048 sectors
Super Offset : 8 sectors
State : clean
Device UUID : d80a5ff5:5ec7aa85:422aaa1e:f6819dc2

Update Time : Tue Apr 8 19:07:45 2014
Checksum : 3dd924dd - correct
Events : 15986

Layout : left-symmetric
Chunk Size : 512K

Device Role : Active device 7
Array State : AAAAAAAAAA ('A' == active, '.' == missing)


Thanks for your help
 
Old 04-10-2014, 07:06 PM   #5
Erk1209
LQ Newbie
 
Registered: Apr 2014
Posts: 4

Original Poster
Rep: Reputation: Disabled
mdadm --examine /dev/sd* output:

root@PreciseServer:~# mdadm --examine /dev/sd*
/dev/sda:
MBR Magic : aa55
Partition[0] : 218228736 sectors at 2048 (type 83)
Partition[1] : 16210864 sectors at 218230784 (type 05)
mdadm: No md superblock detected on /dev/sda1.
/dev/sda2:
MBR Magic : aa55
Partition[0] : 16207872 sectors at 2048 (type 82)
mdadm: No md superblock detected on /dev/sda5.
/dev/sdb:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x0
Array UUID : dff1c3d6:8528c4ba:5df0c08b:33a1a043
Name : PreciseServer:0
Creation Time : Sat Jul 7 15:34:42 2012
Raid Level : raid6
Raid Devices : 10

Avail Dev Size : 3907027120 (1863.02 GiB 2000.40 GB)
Array Size : 15628103680 (14904.12 GiB 16003.18 GB)
Used Dev Size : 3907025920 (1863.02 GiB 2000.40 GB)
Data Offset : 2048 sectors
Super Offset : 8 sectors
State : clean
Device UUID : cff1ced2:6d154a19:4ded798d:b90ee7d2

Update Time : Tue Apr 8 19:07:45 2014
Checksum : 2e01a9b5 - correct
Events : 15986

Layout : left-symmetric
Chunk Size : 512K

Device Role : Active device 8
Array State : AAAAAAAAAA ('A' == active, '.' == missing)
/dev/sdc:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x0
Array UUID : dff1c3d6:8528c4ba:5df0c08b:33a1a043
Name : PreciseServer:0
Creation Time : Sat Jul 7 15:34:42 2012
Raid Level : raid6
Raid Devices : 10

Avail Dev Size : 3907027120 (1863.02 GiB 2000.40 GB)
Array Size : 15628103680 (14904.12 GiB 16003.18 GB)
Used Dev Size : 3907025920 (1863.02 GiB 2000.40 GB)
Data Offset : 2048 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 24238470:0407192c:7768dfcd:ed35abf6

Update Time : Tue Apr 8 19:07:45 2014
Checksum : 42af6f00 - correct
Events : 15986

Layout : left-symmetric
Chunk Size : 512K

Device Role : Active device 1
Array State : AAAAAAAAAA ('A' == active, '.' == missing)
/dev/sdd:
MBR Magic : aa55
Partition[0] : 3907029167 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdd1.
/dev/sde:
MBR Magic : aa55
Partition[0] : 3907029167 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sde1.
/dev/sdf:
MBR Magic : aa55
Partition[0] : 3907029167 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdf1.
/dev/sdg:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x0
Array UUID : dff1c3d6:8528c4ba:5df0c08b:33a1a043
Name : PreciseServer:0
Creation Time : Sat Jul 7 15:34:42 2012
Raid Level : raid6
Raid Devices : 10

Avail Dev Size : 3907027120 (1863.02 GiB 2000.40 GB)
Array Size : 15628103680 (14904.12 GiB 16003.18 GB)
Used Dev Size : 3907025920 (1863.02 GiB 2000.40 GB)
Data Offset : 2048 sectors
Super Offset : 8 sectors
State : clean
Device UUID : d80a5ff5:5ec7aa85:422aaa1e:f6819dc2

Update Time : Tue Apr 8 19:07:45 2014
Checksum : 3dd924dd - correct
Events : 15986

Layout : left-symmetric
Chunk Size : 512K

Device Role : Active device 7
Array State : AAAAAAAAAA ('A' == active, '.' == missing)
/dev/sdh:
MBR Magic : aa55
Partition[0] : 3907029167 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdh1.
/dev/sdi:
MBR Magic : aa55
Partition[0] : 3907029167 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdi1.
/dev/sdj:
MBR Magic : aa55
Partition[0] : 3907029167 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdj1.
/dev/sdk:
MBR Magic : aa55
Partition[0] : 3907029167 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdk1.
/dev/sdl:
MBR Magic : aa55
Partition[0] : 15636801 sectors at 63 (type 0c)
/dev/sdl1:
MBR Magic : aa55
Partition[0] : 1851859059 sectors at 1936028272 (type 68)
Partition[1] : 538976288 sectors at 1330184192 (type 79)
Partition[2] : 1398362912 sectors at 538989391 (type 53)
Partition[3] : 21337 sectors at 1394627663 (type 49)


I do not understand where that /dev/sdl came from as the disks in my machine only go up to /dev/sdk...
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] mdadm raid inactive, assemble fails with Device or resource busy blackman890 Linux - Server 7 12-14-2014 04:43 PM
[SOLVED] mdadm RAID 5 assemble sag47 Linux - Software 1 12-17-2011 06:13 PM
How do I get mdadm to assemble a raid using local and nbd devices adrian_stephens Linux - Server 3 05-29-2009 10:42 AM
mdadm fails to assemble reconnected drives (debian, raid0) SandRock Linux - Software 12 11-09-2008 12:06 PM
mdadm fails to assemble my RAID device tomhildebrand Fedora 6 06-28-2007 12:08 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 08:57 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration