[SOLVED] Building a Backblaze storage pod need help!

dfs019 · 03-10-2010, 08:23 AM

Hi, I am fairly new to linux but I'm building one of the backblaze storage pods:

blog.backblaze.com/2009/09/01/petabytes-on-a-budget-how-to-build-cheap-cloud-storage/

I have followed the specs they give exactly and i have almost completed it but I am stuck trying to mount the raids. There are 3 RAID6 and i recieve the same error for each one

Code:

mount /dev/md0 /mnt/raid0
mount: wrong fs type, bad option, bad superblock on /dev/md0,
       missing codepage or helper program, or other error
       In some cases useful info is found in syslog - try
       dmesg | tail  or so

This is what i have done(ill just show one since they are identical except for which drives make the raid of course)

Code:

    mdadm --detail /dev/md0
    /dev/md0:
            Version : 00.90
      Creation Time : Thu Mar  4 14:50:11 2010
         Raid Level : raid6
         Array Size : 19046800448 (18164.44 GiB 19503.92 GB)
      Used Dev Size : 1465138496 (1397.26 GiB 1500.30 GB)
       Raid Devices : 15
      Total Devices : 15
    Preferred Minor : 0
        Persistence : Superblock is persistent

        Update Time : Mon Mar  8 10:47:33 2010
              State : clean
    Active Devices : 15
    Working Devices : 15
    Failed Devices : 0
      Spare Devices : 0

         Chunk Size : 64K

               UUID : 138552f3:a4c26ab1:6083a234:87308e9b (local to host idnyrec-linux)
             Events : 0.10

        Number   Major   Minor   RaidDevice State
           0       8        0        0      active sync   /dev/sda
           1       8       16        1      active sync   /dev/sdb
           2       8       32        2      active sync   /dev/sdc
           3       8       48        3      active sync   /dev/sdd
           4       8       64        4      active sync   /dev/sde
           5       8       80        5      active sync   /dev/sdf
           6       8       96        6      active sync   /dev/sdg
           7       8      112        7      active sync   /dev/sdh
           8       8      128        8      active sync   /dev/sdi
           9       8      144        9      active sync   /dev/sdj
          10       8      160       10      active sync   /dev/sdk
          11       8      176       11      active sync   /dev/sdl
          12       8      192       12      active sync   /dev/sdm
          13       8      208       13      active sync   /dev/sdn
          14       8      224       14      active sync   /dev/sdo

    mkfs.jfs /dev/md0
    mkfs.jfs version 1.1.12, 24-Aug-2007
    Warning!  All data on device /dev/md0 will be lost!

    Continue? (Y/N) y
       \

    Format completed successfully.

    19046800448 kilobytes total disk space.

    cat /proc/mdstat
    Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10]   
    md0 : active raid6 sdo[14] sdn[13] sdm[12] sdl[11] sdk[10] sdj[9] sdi[8] sdh[7] sdg[6] sdf[5] sde[4] sdd[3] sdc[2] sdb[1] sda[0]
          19046800448 blocks level 6, 64k chunk, algorithm 2 [15/15] [UUUUUUUUUUUUUUU]
         
    unused devices: <none>
    mdadm --detail --scan --verbose > /etc/mdadm.config
    mkdir /mnt/raid0

i edited the fstab and added the line:
/dev/md0 /mnt/raid0 jfs defaults 0 2

then when i go to mount i get the message:

Code:

mount /dev/md0 /mnt/raid0
mount: wrong fs type, bad option, bad superblock on /dev/md0,
       missing codepage or helper program, or other error
       In some cases useful info is found in syslog - try
       dmesg | tail  or so

Please help if you have any suggestions

rweaver · 03-10-2010, 12:01 PM

What does your fstab entry look like for it? Also try specifying the file system.

Code:

mkdir -p /mnt/raid0
mount -t jfs /dev/md0 /mnt/raid0

Edit: Also is there anything in the logs or in the dmesg?

dfs019 · 03-10-2010, 01:25 PM

I've tried specifiying the file system and I still got the same error.
My fstab file looks like:

Code:

# /etc/fstab: static file system information.
#
# <file system> <mount point>   <type>  <options>       <dump>  <pass>
proc            /proc           proc    defaults        0       0
/dev/hda1       /               ext3    errors=remount-ro 0       1
/dev/hda9       /home           ext3    defaults        0       2
/dev/hda8       /tmp            ext3    defaults        0       2
/dev/hda5       /usr            ext3    defaults        0       2
/dev/hda6       /var            ext3    defaults        0       2
/dev/hda7       none            swap    sw              0       0
/dev/md0	/mnt/raid0	jfs	defaults	0	2
/dev/md1	/mnt/raid1	jfs	defaults	0	2
/dev/md2	/mnt/raid2	jfs	defaults	0	2

Since I am new to linux I'm not great at understanding the log file but I do notice a few errors:

Code:

Mar 10 14:11:35 idnyrec-linux kernel: [  151.881108] mtrr: type mismatch for c1fe0000,10000 old: write-back new: write-combining
Mar 10 14:11:35 idnyrec-linux kernel: [  151.881108] mtrr: type mismatch for c1fc0000,20000 old: write-back new: write-combining
Mar 10 14:11:35 idnyrec-linux kernel: [  151.881108] mtrr: type mismatch for c1f80000,40000 old: write-back new: write-combining
Mar 10 14:11:35 idnyrec-linux kernel: [  151.881108] mtrr: type mismatch for c1f00000,80000 old: write-back new: write-combining
Mar 10 14:11:35 idnyrec-linux kernel: [  151.881108] mtrr: type mismatch for c1e00000,100000 old: write-back new: write-combining
Mar 10 14:11:35 idnyrec-linux kernel: [  151.881108] mtrr: type mismatch for c1c00000,200000 old: write-back new: write-combining
Mar 10 14:11:35 idnyrec-linux kernel: [  151.881108] mtrr: type mismatch for c1800000,400000 old: write-back new: write-combining
Mar 10 14:11:35 idnyrec-linux kernel: [  151.881108] mtrr: type mismatch for c1000000,800000 old: write-back new: write-combining
Mar 10 14:11:35 idnyrec-linux kernel: [  151.881108] mtrr: type mismatch for c0000000,1000000 old: write-back new: write-combining

Code:

Mar  9 09:15:50 idnyrec-linux kernel: [64490.060700] ata3.15: qc timeout (cmd 0xe4)
Mar  9 09:15:50 idnyrec-linux kernel: [64490.060726] ata3.15: failed to read PMP GSCR[0] (Emask=0x5)
Mar  9 09:15:50 idnyrec-linux kernel: [64490.060728] ata3.15: PMP revalidation failed (errno=-5)
Mar  9 09:15:50 idnyrec-linux kernel: [64490.060730] ata3.15: retrying reset in 5 secs

Mar  9 09:15:50 idnyrec-linux kernel: [64499.297686] ata1.00: failed to IDENTIFY (I/O error, err_mask=0x11)
Mar  9 09:15:50 idnyrec-linux kernel: [64499.297688] ata1.00: revalidation failed (errno=-5)
Mar  9 09:15:50 idnyrec-linux kernel: [64499.297691] ata1.15: hard resetting link
Mar  9 09:15:50 idnyrec-linux kernel: [64499.297692] ata1: controller in dubious state, performing PORT_RST
Mar  9 09:15:50 idnyrec-linux kernel: [64499.297697] ata4.00: failed to IDENTIFY (I/O error, err_mask=0x11)

jlinkels · 03-10-2010, 01:30 PM

Did you format the md0 after you assembled the array?

If you formatted each separate disk before assembling, or did not format at all you would get there errors.

jlinkels

dfs019 · 03-11-2010, 09:53 AM

Yes I formatted md0 after I assembled the array to the jfs filesystem

jlinkels · 03-11-2010, 10:35 AM

I see that in your first post now, I did not scroll down far enough.

The next logical step in fault location would be to format a non-RAID-ed partition to jfs and see if you can mount it. Any partition, any disk would do.

As far as I know jfs is not used real often, I wonder if there is something wrong with the driver of this file system.

jlinkels

dfs019 · 03-12-2010, 12:46 PM

I sucessfully mounted a drive formatted with jfs with no problems. Any other ideas?

jlinkels · 03-12-2010, 03:36 PM

The only thing I can recommend is to implement this thing step by step. You have demonstrated that jfs is a mountable file system. Can you build a RAID1 with jfs? No? Can you do it with xfs? Yes? Can you build a RAID5 with jfs. Etc, etc.

And unfortunately I don't have any other helpful ideas, sorry.

jlinkels

dfs019 · 03-15-2010, 02:05 PM

Hi, I am new to Linux.I am trying to partition a raid array of 15 x 1.5 TB drives. I was trying to use Fdisk but it was not allowing me to use the full size and then I read that it can only handle 2TB partitions. I then tried to use gparted but it doesnt show my raid array as a device.

Please help!

troop · 03-15-2010, 02:08 PM

http://www.cyberciti.biz/tips/fdisk-...eater-2tb.html

dfs019 · 03-15-2010, 02:21 PM

thanks!

dfs019 · 03-16-2010, 09:08 AM

I used parted to make a partition and i quit and restarted the system but the partition does not show when i do

Code:

cat /proc/partitions

It shows the drives but not the partitions. Any ideas?

dfs019 · 03-19-2010, 09:53 AM

Hey im new to Linux. I'm running Debian 2.6.26-21lenny4 and I am trying to mount a 15 disk raid6 array made up of 1.5 TB hd's using jfs. After building and formatting the array I try to mount it and I recieve this error

Code:

mount: wrong fs type, bad option, bad superblock on /dev/md2,
       missing codepage or helper program, or other error
       In some cases useful info is found in syslog - try
       dmesg | tail  or so

I was successfully able to build and mount the raid6 array's following exactly the same steps using only 13 of the drives but when i try 14 or 15 of the drives I recieve that error message.

Please help I've been stuck on this for a while.

brucehinrichs · 03-20-2010, 07:08 PM

What is the output of dmesg | tail ? That's where I would start, since it is suggested

.

backblaze.pl · 04-05-2010, 09:29 PM

Please post ENTIRE output of dmesg and contents of /var/log/dmesg file (if present in your distribution). If it is not there, reboot your machine, log in as root and capture output of dmesg.

Kernel has a buffer for it's messages. As they appear, older get pushed out. I think it is a controller / multiplexer problem and to solve it, 'early' initialization messages might be helpful.

Or try to read and understand them yourself. It's the fastest way to solve problems. Linux speaks and is meaningful.

--
Good luck
backblaze.pl