LinuxQuestions.org

LinuxQuestions.org (/questions/)
-   Linux - Software (https://www.linuxquestions.org/questions/linux-software-2/)
-   -   FC 15 will not boot after upgrade kernel panic? (https://www.linuxquestions.org/questions/linux-software-2/fc-15-will-not-boot-after-upgrade-kernel-panic-883329/)

gkasica 05-29-2011 05:50 PM

The grub.conf is from /media/_boot/grub

FC 15 will not boot to single user at all.

FC 14 2.6.35.13-91.fc14.i686 will boot:

Running the mkinitrd from that mode with this command line:

mkinitrd vmlinuz-2.6.38.6-27.fc15.i686.img vmlinuz-2.6.38.6-27.fc15.i686

builds the file vmlinuz-2.6.38.6-27.fc15.i686.img but there are about 5 lines of

find modules /lib/modules/2.6.38.6-27.fc15.i686

and when I try to boot from it I get the FATAL error of

could not load /lib/modules/2.6.38.6-27.fc15.i686/modules.dep and I get dropped into the debug shell

Looking at that location with ll shows that it does exist but there is a symlink to build that points to
../../../usr/src/kernels/2.6.38.6-27.fc15.i686
which does NOT exist.

looking at an rpm -qa | grep kernel | grep 15

I see 4 RPMs
the kernel itself, headers, doc and the kerneloops as being installed




What now and how do I fix this?

T3RM1NVT0R 05-29-2011 06:04 PM

@ Reply
 
That is because F14 does not have the lib files to build up the image file for F15 I guess.

You can download the lib files from here:

http://rpm.pbone.net/index.php3/stat....i686.rpm.html

You have to use a CD or a floppy to get it on the server.

Also install the rpm using rpm -ivh package_name, do not use rpm -Uvh package_name

It might be possible that it will ask you to install dependent files. Install them as well.

Also try creating image file once done installing the libraries.

gkasica 05-29-2011 06:08 PM

Already thought that was it....downloading and loading it now from USB stick. Will retry and send results shortly.

gkasica 05-29-2011 06:41 PM

Loaded the rpm with no errors.

Rebuilding with

mkinitrd --force vmlinuz-2.6.38.6-27.fc15.i686.img vmlinuz-2.6.38.6-27.fc15.i686
(to force overwrite of the exisiting file)

give me still 7 lines of modules not found like before and rebooting to that gets me the same results as well.

I looked in the /usr/src directory and the RPM has apparently installed as there is now a

usr/src/kernels/2.6.38.6-27.fc15.i686

directory there with symlinks that point someplace inside it.

T3RM1NVT0R 05-29-2011 06:52 PM

@ Reply
 
Did you reboot the system after installation (rpm -ivh ) ?

I know you mentioned that you are not able to boot in any of the kernel in the first post but can you give it a try once again?

Also refer this documentation which I think might help: http://docs.fedoraproject.org/en-US/...isk_Image.html

gkasica 05-29-2011 07:18 PM

OK. Rebooted into the FC14 kernel and ran the

dracut --force

and it rebuilt with out any errors just warnings about possibly missing firmware for several items.

On reboot into the FC15 kernel with single user mode I still fail with the

modprobe FATAL: Could not load /lib/modules/2.6.38.6-27.fc15.i686/modules.dep no such file or directory

and I get dropped into the debug dracut shell.

T3RM1NVT0R 05-29-2011 07:33 PM

@ Reply
 
Try installing this: http://rpm.pbone.net/index.php3/stat....i686.rpm.html

At a point I was thinking of suggesting you to install Fedora15 on a virtual machine and copy over the image file and whatever missing modules to this machine. As I thought that will be easier.

But after seeing the message you mentioned I thought it worth giving a try installing the above mentioned package and see if that works.

gkasica 05-29-2011 08:30 PM

OK I installed that and reran the dracut --force. Still warned about missing modules but when I rebooted I CAN get into multi user mode in FC15 using the .debug entry it created, but some of my services are apparently not running. Bootlog below/errors below - if I can get httpd running then I think we're back in business not sure what the others are for but I'm not familiar with them:

Starting SYSV: restorecond uses inotify to look for creation of new files listed in the /etc/selinux/restorecond.conf file, and restores the correct security context. [1;31mfailed[0m, see 'systemctl status restorecond.service' for details.
restorecond.service - SYSV: restorecond uses inotify to look for creation of new files listed in the /etc/selinux/restorecond.conf file, and restores the correct security context.
Loaded: loaded (/etc/rc.d/init.d/restorecond)
Active: failed since Sun, 29 May 2011 20:12:54 -0500; 14min ago
Process: 979 ExecStart=/etc/rc.d/init.d/restorecond start (code=exited, status=7/NOTRUNNING)
CGroup: name=systemd:/system/restorecond.service

Starting LSB: start and stop apmd [1;31mfailed[0m, see 'systemctl status apmd.service' for details.
apmd.service - LSB: start and stop apmd
Loaded: loaded (/etc/rc.d/init.d/apmd)
Active: failed since Sun, 29 May 2011 20:12:55 -0500; 13min ago
Process: 1047 ExecStart=/etc/rc.d/init.d/apmd start (code=exited, status=1/FAILURE)
CGroup: name=systemd:/system/apmd.service

Starting LSB: Automounts filesystems on demand [1;31mfailed[0m, see 'systemctl status autofs.service' for details.
autofs.service - LSB: Automounts filesystems on demand
Loaded: loaded (/etc/rc.d/init.d/autofs)
Active: failed since Sun, 29 May 2011 20:12:58 -0500; 15min ago
Process: 1057 ExecStart=/etc/rc.d/init.d/autofs start (code=exited, status=1/FAILURE)
CGroup: name=systemd:/system/autofs.service

Starting LSB: start and stop Apache HTTP Server [1;31mfailed[0m, see 'systemctl status httpd.service' for details.
httpd.service - LSB: start and stop Apache HTTP Server
Loaded: loaded (/etc/rc.d/init.d/httpd)
Active: failed since Sun, 29 May 2011 20:17:06 -0500; 11min ago
Process: 2842 ExecStart=/etc/rc.d/init.d/httpd start (code=exited, status=1/FAILURE)
CGroup: name=systemd:/system/httpd.service

bootlog
=======
Failed to load SELinux policy.

Welcome to [0;34mFedora release 15 (Lovelock)[0m!

Starting Load legacy module configuration...
Starting Bootup hack...
Starting Apply Kernel Variables...
Started Load Kernel Modules.
Starting Syslog Kernel Log Buffer Bridge...
Started Syslog Kernel Log Buffer Bridge.
Started Set Up Additional Binary Formats.
Starting udev Kernel Device Manager...
Starting Setup Virtual Console...
Starting Runtime Directory...
Starting Media Directory...
Starting Lock Directory...
Started File System Check on Root Device.
Starting Remount Root FS...
Starting Remount API VFS...
Started Apply Kernel Variables.
Starting Stdio Syslog Bridge...
Started Stdio Syslog Bridge.
Starting Huge Pages File System...
Started Bootup hack.
Started Runtime Directory.
Started Lock Directory.
Started Huge Pages File System.
Started Remount Root FS.
Starting Configure read-only root support...
Started Remount API VFS.
Started Load legacy module configuration.
Started Setup Virtual Console.
Started Media Directory.
Started Configure read-only root support.
Started udev Kernel Device Manager.
Starting udev Coldplug all Devices...
Started udev Coldplug all Devices.
Starting udev Wait for Complete Device Initialization...
Started udev Kernel Device Manager.
Starting File System Check on /dev/disk/by-label/\x2fhome...
Starting File System Check on /dev/disk/by-label/\x2fhome2...
Starting /dev/disk/by-label/\x2fSWAP-hda2...
Starting File System Check on /dev/disk/by-label/\x2fboot...
Started /dev/disk/by-label/\x2fSWAP-hda2.
systemd-fsck[608]: /boot: clean, 61/126504 files, 141315/514048 blocks
Started File System Check on /dev/disk/by-label/\x2fboot.
Starting /boot...
systemd-fsck[603]: /home2: clean, 152946/34193408 files, 4992288/68374648 blocks
Started File System Check on /dev/disk/by-label/\x2fhome2.
Starting /home2...
systemd-fsck[595]: /home: clean, 7958/39075840 files, 1660076/78142160 blocks
Started File System Check on /dev/disk/by-label/\x2fhome.
Starting /home...
Started /home2.
Starting /var/www/html/DAWS...
Started /var/www/html/DAWS.
Started /home.
Started /boot.
Started udev Wait for Complete Device Initialization.
Started Show Plymouth Boot Screen.
Starting Wait for storage scan...
Started Wait for storage scan.
Starting Initialize storage subsystems (RAID, LVM, etc.)...
Starting POSIX Message Queue File System...
Started POSIX Message Queue File System.
Started Initialize storage subsystems (RAID, LVM, etc.).
Starting Initialize storage subsystems (RAID, LVM, etc.)...
Started Initialize storage subsystems (RAID, LVM, etc.).
Starting Load Random Seed...
Starting Tell Plymouth To Write Out Runtime Data...
Starting Enable all detected swap partitions...
Started Reconfigure the system on administrator request.
Started Mark the need to relabel after reboot.
Starting Recreate Volatile Files and Directories...
Started Relabel all filesystems, if necessary.
Started Enable all detected swap partitions.
Started Load Random Seed.
Started Tell Plymouth To Write Out Runtime Data.
Started Recreate Volatile Files and Directories.
Starting Console System Startup Logging...
Starting Bootup unhack...
Starting Restore Sound Card State...
Starting ABRT Automated Bug Reporting Tool...
Starting Network Time Service...
Started Network Time Service.
Starting LSB: start and stop ip6tables firewall...
Starting Console Mouse manager...
Starting LSB: Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling...
Starting Job spooling tools...
Started Job spooling tools.
Starting LSB: start and stop iptables firewall...
Starting LSB: reset the system activity logs...
Starting LSB: Starts and stops login iSCSI daemon....
Starting irqbalance daemon...
Starting lm_sensors for monitoring motherboard sensor values...
Starting D-Bus System Message Bus...
Started Console System Startup Logging.
Started Bootup unhack.
Started Restore Sound Card State.
Started Console Mouse manager.
Started irqbalance daemon.
Started D-Bus System Message Bus.
Started LSB: start and stop ip6tables firewall.
Started LSB: Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling.
Started LSB: start and stop iptables firewall.
Started LSB: reset the system activity logs.
Started LSB: Starts and stops login iSCSI daemon..
Started lm_sensors for monitoring motherboard sensor values.
Starting SYSV: This starts the SELinux Context Translation System Daemon...
Started ABRT Automated Bug Reporting Tool.
Started SYSV: This starts the SELinux Context Translation System Daemon.
Starting SYSV: start and stop ISDN services...
Started SYSV: start and stop ISDN services.
Starting LSB: Port reservation utility...
Starting LSB: Bring up/down networking...
Started LSB: Port reservation utility.
Started D-Bus System Message Bus.
Started LSB: Bring up/down networking.
Starting SYSV: This starts the Linux Auditing System Daemon, which collects security related events in a dedicated audit log. If this daemon is turned off, audit events will be sent to syslog....
Started SYSV: This starts the Linux Auditing System Daemon, which collects security related events in a dedicated audit log. If this daemon is turned off, audit events will be sent to syslog..
Starting SYSV: restorecond uses inotify to look for creation of new files listed in the /etc/selinux/restorecond.conf file, and restores the correct security context....
Starting SYSV: restorecond uses inotify to look for creation of new files listed in the /etc/selinux/restorecond.conf file, and restores the correct security context. [1;31mfailed[0m, see 'systemctl status restorecond.service' for details.
Starting LSB: start|stop|status|restart|try-restart|reload|force-reload DNS server...
Starting SYSV: The rpcbind utility is a server that converts RPC program numbers into universal addresses. It must be running on the host to be able to make RPC calls on a server on that machine....
Starting LSB: processor frequency scaling support...
Starting LSB: Starts and stops login and scanning of iSCSI devices....
Started LSB: Starts and stops login and scanning of iSCSI devices..
Started SYSV: The rpcbind utility is a server that converts RPC program numbers into universal addresses. It must be running on the host to be able to make RPC calls on a server on that machine..
Starting LSB: Starts the NFSv4 id mapping daemon...
Starting LSB: Start and stop the MD software RAID monitor...
Starting LSB: Start up the NFS file locking sevice...
Starting LSB: Starts the RPCSEC GSS client daemon...
Starting LSB: Moves the generated persistent udev rules to /etc/udev/rules.d...
Starting LSB: start and stop apmd...
Starting LSB: A Quagga watchdog...
Starting LSB: Mount and unmount network filesystems....
Starting LSB: Automounts filesystems on demand...
Starting LSB: The CUPS scheduler...
Started LSB: processor frequency scaling support.
Started LSB: Start and stop the MD software RAID monitor.
Started LSB: Moves the generated persistent udev rules to /etc/udev/rules.d.
Starting LSB: start and stop apmd [1;31mfailed[0m, see 'systemctl status apmd.service' for details.
Started LSB: Starts the RPCSEC GSS client daemon.
Started LSB: Start up the NFS file locking sevice.
Started LSB: Starts the NFSv4 id mapping daemon.
Started LSB: A Quagga watchdog.
Started LSB: Mount and unmount network filesystems..
Starting LSB: Automounts filesystems on demand [1;31mfailed[0m, see 'systemctl status autofs.service' for details.
Starting LSB: Daemon to access a smart card using PC/SC...
Starting Permit User Sessions...
Started Permit User Sessions.
Started LSB: Daemon to access a smart card using PC/SC.
Started LSB: start|stop|status|restart|try-restart|reload|force-reload DNS server.
Started LSB: The CUPS scheduler.
Starting SYSV: Allow users to run non-native Linux programs by just clicking on them (or typing ./file.exe)...
Started SYSV: Allow users to run non-native Linux programs by just clicking on them (or typing ./file.exe).
Starting SYSV: Initialize SCSI tape drives...
Started SYSV: Initialize SCSI tape drives.
Starting SYSV: Enable daily run of yum, a program updater....
Started SYSV: Enable daily run of yum, a program updater..
Starting LSB: Start up the OpenSSH server daemon...
Starting LSB: start and stop xinetd...
Started LSB: start and stop xinetd.
Started LSB: Start up the OpenSSH server daemon.
Starting SYSV: shm_splc2 is the shared memory PPS driver for NTP...
Started SYSV: shm_splc2 is the shared memory PPS driver for NTP.
Starting LSB: start and stop postfix...
Starting LSB: start and stop MySQL server...
Started LSB: start and stop postfix.
Started LSB: start and stop MySQL server.
Starting SYSV: nrpe is a daemon for a remote nagios server, running nagios plugins on this host....
Started SYSV: nrpe is a daemon for a remote nagios server, running nagios plugins on this host..
Starting LSB: start and stop ksm...
Starting LSB: Canna Japanese Conversion Engine...
Starting LSB: tune the speed of ksm...
Starting LSB: start and stop Apache HTTP Server...
Starting LSB: Installs coredump handler which saves segfault data...
Starting LSB: start the NAS daemon...
Started LSB: start and stop ksm.
Started LSB: tune the speed of ksm.
Started LSB: Installs coredump handler which saves segfault data.
Started LSB: start the NAS daemon.
Starting LSB: start and stop Apache HTTP Server [1;31mfailed[0m, see 'systemctl status httpd.service' for details.
Starting SYSV: Starts and stops the X Font Server at boot time and shutdown. It also takes care of (re-)generating font lists....
Started LSB: Canna Japanese Conversion Engine.
Started SYSV: Starts and stops the X Font Server at boot time and shutdown. It also takes care of (re-)generating font lists..
Starting SYSV: Starts and stops the Samba smbd and nmbd daemons used to provide SMB network services....
Starting SYSV: Starts and stops the Samba smbd daemon used to provide SMB network services....
Started SYSV: Starts and stops the Samba smbd and nmbd daemons used to provide SMB network services..
Started SYSV: Starts and stops the Samba smbd daemon used to provide SMB network services..
Starting LSB: Start/stop xend...
Starting LSB: Start/stop blktapctrl...
Starting LSB: Start/stop xenstored...
Starting LSB: Start/stop xenconsoled...
Starting /etc/rc.local Compatibility...
Started LSB: Start/stop xend.
Starting LSB: Start/stop secondary xen domains...
Starting LSB: daemon for libvirt virtualization API...
Started LSB: Start/stop xenstored.
Started LSB: Start/stop blktapctrl.
Started LSB: Start/stop xenconsoled.
Started LSB: daemon for libvirt virtualization API.
Starting SYSV: Starts and stops the Nagios monitor...
Starting LSB: suspend/resume libvirt guests on shutdown/boot...
Started LSB: suspend/resume libvirt guests on shutdown/boot.
Started SYSV: Starts and stops the Nagios monitor.
Started LSB: Start/stop secondary xen domains.
Stopping the Bacula File daemon
Starting the Bacula File daemon

gkasica 05-29-2011 09:09 PM

OK. Reinstalled the non-debug kernel rpm with

yum reinstall kernel-2.6.38.6-27.fc15.i686.rpm

and I can now boot into multi-user mode with that kernel not jst the debug one.

I still have the above 4 items that are not starting however

and syslog doesn't appear to be running either as /var/log/messages is not getting written to and there is no syslog in the ps -efw list

Any thoughts?

T3RM1NVT0R 05-29-2011 09:15 PM

@ Reply
 
As I can understand you are not able to boot normally. However, the 4 services that you mentioned are not starting.

First of all I would like to see the selinux status. You can check that by using the following command:

sestatus

Also if possible (just for troubleshooting purpose) you can disable the selinux for one single time by booting your system with selinux=0 option. For that you have to do the following:

At the grub boot options screen. Select F15 kernel and hit e to edit. Now where you mention the option for single user mode, mentione selinux=0, hit enter and hit b to boot the system. It will look as follows:

Code:

kernel /vmlinuz-2.6.38.6-27.fc15.i686 ro root=LABEL=/root rhgb quiet resume=/dev/sda2 SYSFONT=latarcyrheb-sun16 LANG=en_US.UTF-8 KEYTABLE=us rootfstype=ext4 selinux=0
Try this and let me know if that helps otherwise paste the output of /var/log/dmesg, /var/log/messages and /var/log/failed.

gkasica 05-29-2011 09:20 PM

It's appaently already disabled

[root@saturn ~]# sestatus
SELinux status: disabled

both
/var/log/dmesg
/var/log/messages
/var/log/failed doesn't exist

are not being writteb to - I don't think syslog is starting and the dates are from 5/27 when I started the upgrade

[root@saturn ~]# ll /var/log/dmesg
-rw-r--r--. 1 root root 41232 May 27 16:34 /var/log/dmesg

[root@saturn ~]# ll /var/log/messages
-rw-------. 1 root root 396324 May 27 17:46 /var/log/messages

[root@saturn ~]# ll /var/log/failed
ls: cannot access /var/log/failed: No such file or directory

T3RM1NVT0R 05-29-2011 09:25 PM

@ Reply
 
First check the status of all four items which I think are:

syslogd, autofs, apmd and httpd.

Check them using chkconfig:

chkconfig --list service_name, it it shows as off then enable them using the following command:

chkconfig service_name on

Also, I would be interested to see the messages that you get when you try to start them manually:

service service_name start

gkasica 05-29-2011 09:41 PM

1 Attachment(s)
See attached service.txt can't post output too many image tages...it doesn't like the brackets etc.

T3RM1NVT0R 05-29-2011 09:54 PM

@ Reply
 
Check if you have kernel-devel package installed for this kernel.

Else download and install it from the following link and then give it a try: http://rpm.pbone.net/index.php3/stat....i686.rpm.html

gkasica 05-29-2011 10:06 PM

We installed it earlier I believe around 6pm or so, its here

rpm -qa | grep kernel

kernel-2.6.38.6-27.fc15.i686
kernel-devel-2.6.38.6-27.fc15.i686
abrt-addon-kerneloops-2.0.2-5.fc15.i686
kernel-debug-2.6.38.6-27.fc15.i686
kernel-headers-2.6.38.6-27.fc15.i686
kernel-doc-2.6.38.6-27.fc15.noarch


All times are GMT -5. The time now is 11:38 PM.