Software NVRAID + Grub

jakertberry · 09-22-2005, 08:23 PM

Update: I have Wiki'd this: http://gentoo-wiki.com/HOWTO_Install...D_using_dmraid
it seems as though just about everyone has problems trying to get grub to play nicely with nvraid. I myself have had no success with it so far, but trust me: there will be great celebration once I do get this figured out.
Here's the setup:

Right now I have 2 Hitachi 160GB (HDS722516VLSA80) SATA drives in a RAID-0 (stripe). I set it up with the NVRAID BIOS. The first partition is NTFS for Windows. This partition is absolutely huge (basically it's the entire hard drive minus 50 GB). Partition 2 is a 32M /boot partition. Partition 3 is a 2G /swap partition, and the last partition is a reiserfs / partition.

I did a Stage 1/3 Gentoo install. I reached the point where I was to install GRUB and realized that I was in some trouble.

Grub will not install correctly on my hard drive. It detects the first partition (NTFS), but not any other partitions.

Here's some random info, in case it might help:

Code:

cat /boot/grub/device.map

(fd0) /dev/fd0
(hd0) /dev/mapper/nvidia_bicccbge

Code:

cat /boot/grub/grub.conf

timeout 30
default 1
fallback 0
splashimage=(hd0,1)/grub/splash.xpm.gz

title Gentoo 2.6.12-r10
root (hd0,1)
kernel (hd0,1)/vmlinuz-2.6.12-gentoo-r10 ro root=/dev/mapper/nvidia_bicccbge4 video=vesafb:ywrap,pmipal,1280x1024-16@60
splash=verbose,theme:emergence
initrd (hd0,1)/fbsplash-emergence-1280x1024

title Windows XP Professional
rootnoverify (hd0,0)
makeactive
chainloader +1

When I attempt to install grub manually, this is what happens:

(First I do grub --device-map=/dev/null)

Code:

grub> device (hd0,0) /dev/mapper/nvidia_bicccbge1
grub> device (hd0,1) /dev/mapper/nvidia_bicccbge2
grub> device (hd0,2) /dev/mapper/nvidia_bicccbge3
grub> device (hd0,3) /dev/mapper/nvidia_bicccbge4
grub> device (hd0) /dev/mapper/nvidia_bicccbge
grub> root (hd0,1)
Error 18: Selected cylinder exceeds maximum supported by BIOS

grub> setup (hd0,1)
Error 12: INvalid device requested.

And if I attempt to install on the first partition...

Code:

grub> root (hd0,0)
Filesystem type unknown, partition type 0x7
grub> setup (hd0)
Error 17: Cannot mount selected partition

If that is my NTFS partition, I don't want to overwrite that. How do I go about getting grub to see the second partition? And when I get that, will this thing still boot up OK after it's first restart?

Thanks,
~Jaker

aus9 · 09-23-2005, 09:18 AM

I don't use grub on a raided drive/partition but offer the following advice? root (hd0,0) is telling grub that is where it is find the grub booting files....so it should be pointed to the boot partition (hd0,1)....see my signature for grub speak/count from zero

BUT I notice you have a bios error, thanks for posting it.....hdo,1 gives error 18......not good.

2) Can you amend your bios to LBA?
or can you flash it to most recent if LBA no good?

3) if and ONLY if you succeed with your bios....... grub should go into mbr and not into a partition so its
root (hd0,1)
setup (hd0)

4)I highly recommend you read my raid research post here and my signature for tips and troubleshooting
http://www.linuxquestions.org/questi...=grub+and+raid

and feel free to post back any wisdom we can find and I will amend my main post etc

jakertberry · 09-23-2005, 08:58 PM

Quote:

Originally posted by aus9
2) Can you amend your bios to LBA?
or can you flash it to most recent if LBA no good?

I'm not sure I know what you mean by that. I do know for certain that my motherboard (MSI K7N2 Delta2 Platinum) does have the latest System BIOS on it (don't think you can flash the nvraid bios, but that should be up to date as well)...

aus9 · 09-24-2005, 01:44 AM

error 18 from the grub error list states
selected cylinder exceeds max supported by bios....normally refers to the 8G limit of old bios.

I note you have flashed yours so I am a bit stumped however, error 18 also mentions at it is attempting to read a (linear block) address or register or value......its this I would like you to see if you can change.

I am on dial up.....so I will let you find your bios motherboard book.....my gigabyte mobo manual mentions at a glance.....LBA for extended interupt drive translations...hope that you can find a similar bit in mobo?

2) are you saying you have a separate bios for raid? I am a dinosaur heh heh

here is a similar post alth error number is different
http://www.linuxquestions.org/questi...a+bios+setting

jakertberry · 09-24-2005, 07:30 PM

I'm guessing that if my /boot was the first partition on the hard drive, I wouldn't have any problems.

I'm going to see if I can switch my NTFS and /boot partitions around so /boot is first. Perhaps then I'll be able to boot from it...

jakertberry · 09-26-2005, 06:25 AM

I recreated the array and redid my partition layout, putting a /boot partition first, followed by the NTFS parition, then a swap partition, then a reiserfs partition.

I started up grub and here's what happened:

Code:

grub> root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
grub> setup (hd0,0)
Checking if "/boot/grub/stage1" exists... no
Checking if "/grub/stage1" exists... no

Error 15: File not found

When I do a directory listing of /boot/grub, I do see a "stage1" file. Why doesn't grub see the files?

aus9 · 09-26-2005, 09:42 AM

What I think is happening is altho grub is reporting hd0,0 is a ext2......that the raid is somehow changing the count.

Could you do me a favour and redo the command but just run thru the hd and then press the tab key to see if I am correct as per the trouble shooter?

2) if the count is not the issue we may be able to use grub-install with a force option or a setup with a force option......subject to your approval of course, you can see examples in the grub manual which is linked in my signature

aus9 · 09-26-2005, 09:57 AM

I have just realised you are on Gentoo and you may want to browse Gentoo LQ and the other forum....this for example may be of help
http://forums.gentoo.org/viewtopic-t...+error+15.html

the next one uses a force
http://forums.gentoo.org/viewtopic-t...+error+15.html which turned into this
http://www.gerald-online.de/bits-byt...linux-install/

hope they help

aus9 · 09-26-2005, 10:01 AM

LQ threads
http://www.linuxquestions.org/questi...entoo+and+raid

http://www.linuxquestions.org/questi...entoo+and+raid

jakertberry · 09-26-2005, 12:18 PM

Update:

I have not rebooted yet to test grub, but the installation appears to have finally worked!

Code:

grub> device (hd0,0) /dev/mapper/nvidia_abiccada1
grub> device (hd0) /dev/mapper/nvidia_abiccada
grub> root (hd0,0)
Filesystem is ext2fs, partition type 0x83
grub> setup (hd0)
Checking if "/boot/grub/stage1" exists... yes
Checking if "/boot/grub/stage2" exists... yes
Checking if "/boot/grub/e2fs_stage1_5" exists... yes
Running "embed /boot/grub/e2fs_stage1_5 (hd0)"... 16 sectors are embedded.
succeeded
Running "install /boot/grub/stage1 (hd0) (hd0)1+16 p (hd0,0)/boot/grub/stage2 /boot/grub/menu.lst"...succeeded
Done.

I suppose we'll know for sure if this works once I reboot, but I'm putting my money on it working.

The moral of the story: Make your boot partition the first partition on the disk!

I'll post an update once I finish the gentoo install and I'm able to reboot...

jakertberry · 09-26-2005, 12:45 PM

Update: Grub will load Windows and Linux. Windows loads fine, but Linux has some problems...

Code:

md: autorun...
md: autio run DONE.
VFS: Cannot open root device "mapper/nvidia_abiccada4" or unknown-block(0,0)
Please append a correct "root=" boot option
Kernel panic - not syncing: VFS: Unable to mount root fs on unknown-block(0,0)

Time to check back into the kernel config and see what's (not?) there...

jakertberry · 09-26-2005, 02:21 PM

I did some research and found that I had some possible stuff missing, but it still hasn't fixed my system from not booting yet. Here's what I have done so far..

Under SCI low-level drivers, I have added:

Code:

[*]Serial ATA (SATA) Support
<*> NVIDIA SATA Support

Nothing else in that page is selected.

Under Multi-device support (RAID and LVM), I have added:

Code:

[*] Multiple devices driver support (RAID and LVM)
<*> RAID Support
<*> RAID-0 (striping) mode
<*> Device mapper support
<*> Crypt target support
<*> Snapshot target (EXPERIMENTAL)
<*> Mirror target (EXPERIMENTAL)
<*> Zero target (EXPERIMENTAL)
<*> Multipath target (EXPERIMENTAL)
<*> EMC CX/AX multipath support (EXPERIMENTAL)
<*> Bad block Relocation Device Target (EXPERIMENTAL)

Code:

grep SATA /usr/src/linux/.config
# CONFIG_BLK_DEV_IDE_SATA is not set
CONFIG_SCSI_SATA=y
# CONFIG_SCSI_SATA_AHCI is not set
# CONFIG_SCSI_SATA_SVW is not set
CONFIG_SCSI_SATA_NV=y
# CONFIG_SCSI_SATA_PROMISE is not set
# CONFIG_SCSI_SATA_QSTOR is not set
# CONFIG_SCSI_SATA_SX4 is not set
# CONFIG_SCSI_SATA_SIL is not set
# CONFIG_SCSI_SATA_SIS is not set
# CONFIG_SCSI_SATA_ULI is not set
# CONFIG_SCSI_SATA_VIA is not set
# CONFIG_SCSI_SATA_VITESSE is not set

Code:

cat /boot/grub/grub.conf

timeout 15
default 0
fallback 1
splashimage=(hd0,0)/grub/gentoo.xpm.gz

title Gentoo Linux 2.6.12-r10
root (hd0,0)
kernel (hd0,0)/vmlinuz-2.6.12-gentoo-r10 ro root=/dev/mapper/nvidia_abiccada4 dodmraid video=vesafb:ywrap,pmipal,1280x1024-16@60
splash=verbose,theme:emergence
initrd (hd0,0)/fbsplash-emergence-1280x1024

title Windows XP Professional
rootnoverify (hd0,1)
makeactive
chainloader +1

The kernel was created manually, version 2.6.12 (basically what emerge gentoo-sources pulled).
The root partition has the reiserfs filesystem (3.6) and support for it is compiled into the kernel.

I'm pretty much stumped now. The only way I can get back in to rebuild the kernel is pop in my Gentoo cd and start it with the "gentoo dodmraid" parameter.

Any possible suggestions?

Thanks

~Jaker

aus9 · 09-27-2005, 07:25 AM

I don't know but if you can spare the time can you explain why these are different in your posts

grub> device (hd0,0) /dev/mapper/nvidia_abiccada1
grub> device (hd0) /dev/mapper/nvidia_abiccada

and
kernel (hd0,0)/vmlinuz-2.6.12-gentoo-r10 ro root=/dev/mapper/nvidia_abiccada4

if they are meant to be diff ok otherwise does that explain your error???
VFS: Cannot open root device "mapper/nvidia_abiccada4" or unknown-block(0,0)
Please append a correct "root=" boot option

jakertberry · 09-28-2005, 12:43 PM

I think that's how it's supposed to be...

I updated the kernel line in my grub.conf so it doesn't include the (hd0,0) line anymore, but it still errors out.

My boot partition is /dev/mapper/nvidia_abiccada1
My root partition is /dev/mapper/nvidia_abiccada4

The setup was different at the beginning of this post, but I have since backed up everything and repartitioned my raid so it had the /boot as the first partition, followed by my NTFS partition, followed by my /swap, then my root partition.

Now I think the problem is for some reason the kernel isn't detecting the raid.

Code:

md: autorun...
md: auto run DONE.
VFS: Cannot open root device "mapper/nvidia_abiccada4" or unknown-block(0,0)
Please append a correct "root=" boot option
Kernel panic - not syncing: VFS: Unable to mount root fs on unknown-block(0,0)

:S
~Jaker

jakertberry · 09-28-2005, 09:41 PM

After much toying around, I finally figured it out.

I wrote a wiki entry at the Gentoo Wiki which outlined the steps needed to get it all working.

http://gentoo-wiki.com/HOWTO_Install...D_using_dmraid

Special thanks to aus9 for all your help!!!!