LinuxQuestions.org
Review your favorite Linux distribution.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Virtualization and Cloud
User Name
Password
Linux - Virtualization and Cloud This forum is for the discussion of all topics relating to Linux Virtualization and Linux Cloud platforms. Xen, KVM, OpenVZ, VirtualBox, VMware, Linux-VServer and all other Linux Virtualization platforms are welcome. OpenStack, CloudStack, ownCloud, Cloud Foundry, Eucalyptus, Nimbus, OpenNebula and all other Linux Cloud platforms are welcome. Note that questions relating solely to non-Linux OS's should be asked in the General forum.

Notices


Reply
  Search this Thread
Old 02-21-2011, 10:37 PM   #1
mainlinex
LQ Newbie
 
Registered: Feb 2011
Location: Melbourne
Distribution: Centos, RedHat
Posts: 9

Rep: Reputation: 0
Kernel panic: VFS: Unable to mount root fs on 09:01


Hi Guys

Our production datawarehouse (running on Redhat 3.8) was converted to virtual environment using vmware 4.1 physical to virtual cloning method (Cold cloning). It all went OK. However we can't boot the new virtual server. Here is what we are getting,

Quote:
.
.
md: Autodetecting RAID arrays.
md: autorun ...
md: ... autorun DONE
Creating block devices
EXT2-fs: unable to read superblock
isofs_read_super: bread failed, dev=09:01, iso_blknum=16, block=32
EXT3-fs: unable to read superblock
Kernel panic: VFS: Unable to mount root fs on 09:01
However I can successfully mount to linux rescue /mnt/sysimage and all file system seems ok.

Quote:
[root@server root]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/md1 5.6G 3.7G 1.7G 70% /
/dev/md0 99M 30M 64M 32% /boot
/dev/md3 3.7G 2.7G 1.1G 72% /opt
/dev/md2 200G 188G 12G 95% /dw
/dev/md4 130G 124G 5.3G 96% /dw2
/dev/sdh1 202G 170G 33G 85% /dw3
none 1.9G 0 1.9G 0% /dev/shm
Quote:
2. /etc/grub.conf
default=0
timeout=10
splashimage=(hd0,0)/grub/splash.xpm.gz

title Red Hat Enterprise Linux ES (2.4.21-47.0.1.ELsmp)
root (hd0,0)
kernel /vmlinuz-2.4.21-47.0.1.ELsmp ro root=/dev/md1
initrd /initrd-2.4.21-47.0.1.ELsmp.img
Quote:
3. /etc/modules.conf
alias eth0 e100
alias eth1 e100
alias scsi_hostadapter aic7xxx
alias scsi_hostadapter1 ips
alias usb-controller usb-ohci
We have contacted the vmware and they said nothing wrong with the conversion and does seem like a problem with the cdrom mount in the boot time. So they have suggested to contact RedHat. However redhat doesn't support version 3 anymore. So we are out of options.

Could anyone please try to give us some directions how to rectify this issue?

Last edited by mainlinex; 02-28-2011 at 10:57 PM.
 
Old 02-23-2011, 05:17 PM   #2
xeleema
Member
 
Registered: Aug 2005
Location: D.i.t.h.o, Texas
Distribution: Slackware 13.x, rhel3/5, Solaris 8-10(sparc), HP-UX 11.x (pa-risc)
Posts: 988
Blog Entries: 4

Rep: Reputation: 254Reputation: 254Reputation: 254
Greetingz and Welcome to LQ!

Odds are good that you either need to

a) Check/Update your GRUB configuration, or
b) Might need to rebuild your initrd.


GRUB Troubleshooting
1) First, boot off the rescue disk and hit up your /boot/grub/grub.conf and see what device it's trying to boot;
Example:
Code:
default=1
timeout=5
hiddenmenu
title your_linux_distro (your_kernel_version)
        root (hd0,0)
        kernel /vmlinuz-your_kernel_version ro root=/dev/you/call/root rhgb quiet
        initrd /initrd-your_kernel_version.img
2) Now reboot off the hard drive and once GRUB pops up, hit "e" "c", then get into the GRUB prompt and run "find /boot/grub/stage1" (or "find /grub/stage1" if you have a separate /boot filesystem).
Example: (Note that I have /boot on a filesystem separate from / and everything else)
Code:
grub> find /boot/grub/stage1
find /boot/grub/stage1

Error 15: File not found
grub> find /grub/stage1
find /grub/stage1
 (hd6,0)
 (hd7,0)
grub>
3) Now replace the "root (hd0,0)" in your grub.conf with what that command tells you and you *might* be good to go.

WARNING: Make a backup of your grub.conf first.

ReBuilding an initrd
The RHEL 3.8 documentation on Red Hat's website (Official Documents) covers how to cut a new initrd.

Good Luck! And maybe it's time to either pay for RHEL support or switch to CentOS?


If this post (or any other) helps you out, hit "Yes" in the bottom right-hand corner of that post.
Also, if your issue is solved, mark this thread as [SOLVED] using "Thread Tools" at the top of this page.

Last edited by xeleema; 02-24-2011 at 12:57 AM. Reason: corrected
 
1 members found this post helpful.
Old 02-23-2011, 11:49 PM   #3
mainlinex
LQ Newbie
 
Registered: Feb 2011
Location: Melbourne
Distribution: Centos, RedHat
Posts: 9

Original Poster
Rep: Reputation: 0
Hi there xeleema,

Thank you heaps for replying to this .

Tried both the options you've mentioned but it didn't work .

GRUB Troubleshooting (Small typo, In order to get the grub command line you have to press "c" not "e" )
Here is the output,
grub> find /boot/grub/stage1
Error 15: File not found

grub> find /boot/statge1
Error 15: File not found

grub> find /grub/stage1
(hd0,0)
(hd1,0)
(hd2,0)
(hd3,0)

Tried both (hd0,0) and (hd1,0) without luck.

ReBuilding an initrd
Following this https://access.redhat.com/kb/docs/DOC-1959 to build initrd but that didn't work either.
This is what it says (People who don't have access to redhat)

Start
#####
When adding hardware like SCSI, SATA, or FibreChannel controllers to the system, it may be necessary to rebuild the initial ramdisk (initrd) to contain the proper kernel modules to access these devices. After adding the proper line to the modules.conf (Red Hat Enterprise Linux 2.1 or 3) or modprobe.conf (Red Hat Enterprise Linux 4 or 5) file, execute these commands to rebuild the initial ramdisk:

# cp /boot/initrd-(kernel-version).img /boot/initrd-(kernel-version).img.bak
# mkinitrd -f initrd-$(uname -r).img $(uname -r)

For example:

# cp /boot/initrd-2.4.21-27.0.2.ELsmp.img /boot/initrd-2.4.21-27.0.2.ELsmp.img.bak
# mkinitrd -v -f /boot/initrd-2.4.21-27.0.2.ELsmp.img 2.4.21-27.0.2.ELsmp

This example rebuilds the ramdisk for a system running the 2.4.21-27.0.2 SMP kernel. Adjust the mkinitrd command as necessary to match the kernel version running on your machine or use uname -r as shown above.

* The -v verbose flag causes mkinitrd to display the names of all the modules it is including in the initial ramdisk.
* The -f option will force an overwrite of any existing initial ramdisk image for this kernel.
Note: This method has been known to fail with the ICH7 SATA chipset. Check for Linux supported drivers prior to rebuilding it.
Note: We recommend making a backup of the existing initrd img file in /boot for the current kernel if unsure of the stability or configuration of the new module before issuing the mkinitrd command:

# cp /boot/initrd-(kernel-version).img /boot/initrd-(kernel-version).img.bak

Optional: It is possible to create a separate entry in /boot/grub/grub.conf for the backup initial ramdisk image, to conveniently choose the old version at boot time without needing to restore the backup. This example configuration allows selection of either the new or old initial ramdisk image from the grub menu:

title Red Hat Enterprise Linux AS (2.4.21-27.0.2.ELsmp)
root (hd0,0)
kernel /vmlinuz-2.4.21-27.0.2.EL ro root=LABEL=/
initrd /initrd-2.4.21-27.0.2.EL.img
title Backup initrd (2.4.21-27.0.2.ELsmp)
root (hd0,0)
kernel /vmlinuz-2.4.21-27.0.2.EL ro root=LABEL=/
initrd /initrd-2.4.21-27.0.2.EL.img.bak

End
###

Regarding the RedHat licence we have paid over 2200USD but once we asked to help them they said following,
"The Red Hat Enterprise Linux (RHEL) Extended Life Cycle Support (ELS) offering provides an extension to the Production III Life Cycle Phase, allowing to continue to use a specific version of Red Hat Enterprise Linux beyond the end of its regular 7-year life cycle".

The thing is our management won't agree paying additional fee to get this thing work .

But they asked to provide a report called "sysreport". Will put it here if someone interested,
Here is the link - https://access.redhat.com/kb/docs/DOC-2873 (You need to log in to RedHat.com in order to access)

Here is how you do it,

Start
#####
Issue
If your system is not bootable, it may be possible to collect useful system troubleshooting information through sysreport. In this event, a Red Hat Technician may request a user to provide the results of sysreport.

Environment
Red Hat Enterprise Linux 2.1 and higher.

Resolution
To generate the sysreport / sosreport output from the rescue environment, boot the system with the installation disc of the corresponding version of Red Hat Enterprise Linux and follow this procedure:

1. Enter linux rescue into the boot prompt.
2. Once the rescue environment finishes booting, choose a language to use.
3. Choose a keyboard layout to use.
4. Wait for network interfaces to be located, and activate them, so that requested data can be transferred to another host.
5. The rescue environment will try to find the current Red Hat Enterprise Linux installation on the system. You will be prompted with the following options:
* "Continue": continue mounting all of its partitions under /mnt/sysimage/ in Read & Write mode
* "Read-Only": continue mounting all of its partitions under /mnt/sysimage/ in Read Only mode
* "Skip" : skip the mounting of the discovered Red Hat Enterprise Linux installation and proceed with manual mounting to generate a sysreport, choose "Continue". You will be presented with a shell prompt.
6. Run the following commands to continue generating sysreport / sosreport:
# chroot /mnt/sysimage

Then, if your system is running RHEL 4.5 or lower:
# sysreport

If your system is running RHEL 4.6 or higher:
# sosreport

If you are running RHEL 4.6 or higher, and the sosreport command fails, you can try the sysreport command, as it should still be available. Note that this command will not be available on RHEL 5 systems.

The sysreport / sosreport command can take some time to generate a report. It collects a significant amount of information that may help Red Hat technicians resolve your issue.

7. Once sysreport / sosreport generation completes, it will provide the output in the /tmp directory while the user is in the chroot environment. Exit the chroot environment and locate the sysreport / sosreport generated in the /mnt/sysimage/tmp directory.

Warning: During the running of the command sysreport / sosreport you will be prompted for your name and case number. Use only letters and/or numbers when filling out this field. Adding other characters could damage the system or render the report unusable.


End
###

Last edited by mainlinex; 02-23-2011 at 11:57 PM.
 
Old 02-24-2011, 01:03 AM   #4
xeleema
Member
 
Registered: Aug 2005
Location: D.i.t.h.o, Texas
Distribution: Slackware 13.x, rhel3/5, Solaris 8-10(sparc), HP-UX 11.x (pa-risc)
Posts: 988
Blog Entries: 4

Rep: Reputation: 254Reputation: 254Reputation: 254
Quote:
Tried both (hd0,0) and (hd1,0) without luck.
Well, give (hd2,0) and (hd3,0) a shot. If grub can't see all the disks, and the initrd can (and said new disks show up before the first two), then the disks might be getting re-ordered.

As for your management not agreeing to pony-up the additional $$$...well, was it their idea to never update the server?
I would immediatly have told them this project's delayed by six months, and started looking for a way to port whatever was on that system to CentOS 5.

Current+Patched is better than Old+UnSupported.

On a side note, rebuild that initrd. Their doc looks good, and it can't put you in a worse spot if it goes south.
NOTE: I would make sure you could boot off a CentOS ISO first.
 
1 members found this post helpful.
Old 02-24-2011, 11:38 PM   #5
mainlinex
LQ Newbie
 
Registered: Feb 2011
Location: Melbourne
Distribution: Centos, RedHat
Posts: 9

Original Poster
Rep: Reputation: 0
Thanks for the quick reply.

However I have tried all (hx,0) options but none worked.

Also I have installed fresh RedHat 3.8 (Same version installed in the cracked server) as a test environment in vmware with software RAID5 and copied over /boot contents including initrd. Even that didn't work. Do you think file system is beyond repairable?

I have fully explained the complexity to the management and they are ok to pay the ELS fees, but now RedHat is saying that even ELS won't support RedHat 3.8, since they have discontine 3.8 ELS support end of January 2011. Only option available to us is upgrade to RedHat 4 or above in order to get their support including ELS.

Then I have tried with RedHat ES 4 using upgrade option, even it can't recognize the file system . What do you reckon?
 
Old 02-25-2011, 07:18 AM   #6
xeleema
Member
 
Registered: Aug 2005
Location: D.i.t.h.o, Texas
Distribution: Slackware 13.x, rhel3/5, Solaris 8-10(sparc), HP-UX 11.x (pa-risc)
Posts: 988
Blog Entries: 4

Rep: Reputation: 254Reputation: 254Reputation: 254
Sometimes it's just a good idea to open the server's case, chuck a grenade in it, and walk away.
I suspect that time came long ago for this particular server.

You may want to re-evaluate what is holding you to RHEL3.8, if you have the time and resources you might want to consider standing up a new system with RHEL5 (or RHEL6) and implement/port whatever app/service/code is on the RHEL3.8 server over to RHEL5 or RHEL6.

In the future, you will need to keep track of the EOL dates each vendor has for their Operating System's and hardware. Just leaving things like software and hardware to rot can come back and bite your company in the collective ass.

I don't think this is a filesystem-issue. I think it's an initrd/module/kernel problem on your old RHEL3.8 system.
If you can boot the RHEL3.8 system off a LiveCD and mount/see the contents of the root filesystem, then it's *definitely* not a problem with that filesystem (at least nothing a good fsck'ing wouldn't fix).
 
Old 02-27-2011, 04:20 PM   #7
mainlinex
LQ Newbie
 
Registered: Feb 2011
Location: Melbourne
Distribution: Centos, RedHat
Posts: 9

Original Poster
Rep: Reputation: 0
Sorry for the delay getting back to you my friend .

We already are considering the move to RedHat 5 including Oracle database 10g. Only thing is our Oracle environment handled by third party consulting company so need to go through some drama .

Already contacted the RedHat and threw few grenades , will see how it goes in that regard.

Thanks for all the help and advices and really appreciate them. Will keep posted any news on this regard.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] Kernel panic: VFS: Unable to mount root fs on lordofdarkness Linux - General 2 05-05-2010 07:10 AM
Kernel panic: VFS: unable to mount root fs on 03:02 fucardieri Slackware - Installation 1 05-02-2006 05:01 PM
Kernel Panic VFS Unable to mount root fs on 08:03 treach Slackware 1 03-07-2006 01:31 PM
Kernel Panic: VFS: Unable to Mount root fs om 00:00 teclipse Linux - Newbie 6 10-03-2003 10:15 PM
kernel panic: VFS: Unable to mount root fs on 09:02 nada Linux - Distributions 1 05-31-2003 05:24 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Virtualization and Cloud

All times are GMT -5. The time now is 06:39 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration