LinuxQuestions.org
Register a domain and help support LQ
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices

Reply
 
Search this Thread
Old 10-07-2009, 09:09 AM   #16
onebuck
Moderator
 
Registered: Jan 2005
Location: Midwest USA, Central Illinois
Distribution: Slackware®
Posts: 11,378
Blog Entries: 3

Rep: Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478

Hi,

Quote:
Originally Posted by rjo98 View Post
I am planning on e2fsck'ing the entire server next time I restart it, since I'm sure that hasn't been done in forever, I just need to figure out how to make that happen. Unless I'm still missing something, I don't see anything in the log that says why it did that.
You can boot into a 'single' user mode so there is no problem with fsck on the system. You can either pass the 'single' parameter to the kernel or use the install cd/dvd. A LiveCD can be used to insure that the disk is not mounted then perform the fsck.

As others have pointed out, you may not get all the information relative to a problem if the disk or filesystem is not available to the kernel at boot time. Your observations at boot will most likely be the only way to find the error.
 
Old 10-07-2009, 09:11 AM   #17
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
I rebooted it again, no e2fsck'ing, and all I could see on the screen that made sense directly above the kernel panic line was a message about modprobe, then what looked like a memory dump or something after it.

No idea what modprobe is even.
 
Old 10-07-2009, 10:00 AM   #18
onebuck
Moderator
 
Registered: Jan 2005
Location: Midwest USA, Central Illinois
Distribution: Slackware®
Posts: 11,378
Blog Entries: 3

Rep: Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478
Hi,

Quote:
excerpt 'man modprobe';

NAME
modprobe - program to add and remove modules from the Linux Kernel
'man' is your friend!

A few links to aid you;

Linux Documentation Project
Rute Tutorial & Exposition
Linux Command Guide
Linux Newbie Admin Guide
LinuxSelfHelp
Getting Started with Linux
Advanced Bash-Scripting Guide

These links and others can be found at 'Slackware-Links'. More than just Slackware® links!
 
Old 10-07-2009, 10:11 AM   #19
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
Yeah, I saw the man that says it adds and removes modules from the kernel, but I think I need a Linux to English translation haha. Why would you add or remove things from the kernel unless you're working on the open source yourself. Guess I don't under what it does at bootup.
 
Old 10-07-2009, 10:29 AM   #20
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
Also, when I look at updates i'm missing on here still, there is a mod_ssl and module-init-tools, not sure if those are related to this perhaps.
 
Old 10-07-2009, 10:39 AM   #21
markush
Senior Member
 
Registered: Apr 2007
Location: Germany
Distribution: Slackware
Posts: 3,971

Rep: Reputation: 849Reputation: 849Reputation: 849Reputation: 849Reputation: 849Reputation: 849Reputation: 849
Who did compile the kernel for your system???

In fact kernelmodules are parts of the kernel which can be added at runtime if they are necessary. modprobe is the programm which add kernelmodules. One can choose during kernelconfiguration if a part is compiled into the kernel or as a module.

In your case I think there is a hardwaredriver which is used early at boottime build as a module.

I'd recommend, learn to build your own kernels. Reading the kerneldocumentations will teach you alot about kernelmodules.

Markus
 
Old 10-07-2009, 10:55 AM   #22
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
My guess is that this system was installed off a ISO and nobody did any special custom kernel compiling, although I can't prove it.

The server is also missing a kernel update as well. Maybe once I up2date everything the problem will go away?
 
Old 10-07-2009, 11:33 AM   #23
Wim Sturkenboom
Senior Member
 
Registered: Jan 2005
Location: Roodepoort, South Africa
Distribution: Slackware 10.1/10.2/12, Ubuntu 12.04, Crunchbang Statler
Posts: 3,786

Rep: Reputation: 282Reputation: 282Reputation: 282
Updates can break a server ! Just as it can break a desktop. It was my first thought when you mentioned that it happened to all your servers (under the assumption that they are running the same OS).

In an production environment updates should never be done automatically. They should be applied to the secondary (redundant) server to make sure nothing breaks and next to the primary server.

We have the luxury of a separate test environment in which we can patch and test before we apply the patches to the secondary and primary servers in the production environment.

It's by-the-way not my responsibility, but I know how my colleagues work. One mistake can result in an overloaded call center.
 
Old 10-07-2009, 11:33 AM   #24
Wim Sturkenboom
Senior Member
 
Registered: Jan 2005
Location: Roodepoort, South Africa
Distribution: Slackware 10.1/10.2/12, Ubuntu 12.04, Crunchbang Statler
Posts: 3,786

Rep: Reputation: 282Reputation: 282Reputation: 282
Duplicate, sorry. I'm sure I only clicked once.

Let's add that part of the procedure is to reboot the server after the system is updated to make sure it can reboot.

Last edited by Wim Sturkenboom; 10-07-2009 at 11:38 AM.
 
Old 10-07-2009, 11:35 AM   #25
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
Unfortunately I dont have the luxury of backup servers or a test environment. I was more along the lines thinking that up2date might replace whatever files are possibly corrupt causing that error?
 
Old 10-07-2009, 12:36 PM   #26
i92guboj
Gentoo support team
 
Registered: May 2008
Location: Lucena, Córdoba (Spain)
Distribution: Gentoo
Posts: 4,043

Rep: Reputation: 375Reputation: 375Reputation: 375Reputation: 375
If the problem is a bogus kernel module, yes, an update could fix it. But if it's bogus hardware, no update is going to magically fix it.

You will lose nothing installing an up-to-date kernel and trying to boot it. You don't need to replace your current one, you can have as many kernels as you wish in your boot menu. However, the complexity of the operation will depend in a number of things. In first place we would need to know wether you are using a 2.4 or a 2.6 kernel, the two branches are maintained and servers sometimes use 2.4 kernels. If that's the case, updating to 2.6 would probably not be advisable, and you should instead update to the latest 2.4.x available.

But such kind of bug on an stable kernel release is really not frequent, it's unlikely, what makes me think that it's probably a hardware problem or a problem with a 3rd party driver. We really have no info so we can only guess. It would be useful to know if the segfault happens before init (so the problem is definitely in the kernel or your hardware) or after init has come into scene. Even a photo of the screen at that moment could help if there's no other way.
 
Old 10-07-2009, 12:39 PM   #27
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
thanks i92. I think what I'm going to try next is to run the up2date and have it update everything that is not current. The server hadn't been restarted in almost a year, so I'm guessing the updates are that far behind. If after the updating it panics again, I'll try to get more detail of whats up on the screen.
 
Old 10-12-2009, 09:19 AM   #28
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
Hi everybody. Well I ran the up2date -u and got everything updated, but then on reboot it panic'd again as it was shutting down. I didn't have a camera to take a picture of all the stuff on the screen, but looking at the memory dump more it looked like it was trying to unload and clean up something, and had ip_conntrack in parenthesis on the top line of the detailed dump. Not sure if that helps at all.

But, since the panic appears to be happening before it shuts down, does that mean it might be logging this stuff somewhere?
 
Old 10-12-2009, 10:08 AM   #29
onebuck
Moderator
 
Registered: Jan 2005
Location: Midwest USA, Central Illinois
Distribution: Slackware®
Posts: 11,378
Blog Entries: 3

Rep: Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478Reputation: 1478
Hi,

You can check out the '/var/log/messages'.
 
Old 10-12-2009, 10:20 AM   #30
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
I don't see anything in there though. when I do a
grep -i panic *
I don't get anything. When I do a
grep -i ip_conntrack *
I only get the following message from today
messages:Oct 12 07:28:54 ServerName kernel: ip_conntrack version 2.1 (8192 buckets, 65536 max) - 348 bytes per conntrack

Am I not looking for the right stuff?
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
running any appli tooks a very long time abd_bela Debian 1 09-30-2009 11:53 PM
Can kernel kill long-running process? registering Linux - Kernel 5 07-20-2007 09:45 AM
System time goes twice as fast as normal on FC4 SMP kernel H_TeXMeX_H Linux - Hardware 6 05-20-2006 10:03 PM
rpmbuild rebuild running for long time littauer99 Linux - Newbie 1 11-28-2004 05:37 PM
Kernel Decompress Taking a long time v2-ncl Linux - Laptop and Netbook 0 11-10-2003 09:47 AM


All times are GMT -5. The time now is 02:22 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration