LinuxQuestions.org
Help answer threads with 0 replies.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 04-03-2008, 09:10 AM   #1
anebi
LQ Newbie
 
Registered: Aug 2007
Posts: 7

Rep: Reputation: 0
Lightbulb Ideas about event logging on overloaded servers


Hi,

i have some questions about event logging on servers, because we have some problems with this when server is going overload.

Sometimes is happen server to be overloaded (frozen) and it doesn't log anything in the logs. When this happen we can't understand what's happen at this time. Is the some way to tell server to continue to log what is going on there?

The point it server to conitnue to log when it is overloaded and almost frozen.

I know that i can use monit or munin, some of these tools to control the processes, i already implemented monit to one of the servers, but in any case if there some different way i will be happy to read your ideas and discus them here.

I think that this kind of discussing will be usuful for many people.

Thanks in advanced!

Regards, Ali Nebi!
 
Old 04-03-2008, 10:14 AM   #2
redgoblin
Member
 
Registered: Jun 2005
Location: UK
Distribution: Debian
Posts: 189

Rep: Reputation: 41
The answer to your problem is very dependent on why the server is locking up.

However, one thought that comes to mind is sending all your logs off to another machine. That will at least reduce the drive writes and possibly the general load.

Look at syslog-ng and consider setting up a dedicated log server.
 
Old 04-03-2008, 10:17 AM   #3
rayfordj
Member
 
Registered: Feb 2008
Location: Texas
Distribution: Fedora, RHEL, CentOS
Posts: 488

Rep: Reputation: 78
I guess it really depends on the load and where the "slowdown" is (cpu, ram, disk, ...).

You may want to look into logging to a remote syslog server. If it is a disk bottleneck then syslog should still be able to send to your remote central syslog server.
 
Old 04-03-2008, 10:44 AM   #4
unSpawn
Moderator
 
Registered: May 2001
Posts: 29,415
Blog Entries: 55

Rep: Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590
I'd suggest logging to serial port. BTW his other thread (http://www.linuxquestions.org/questi...oblems-577477/) shows the OOM invoked, in the "normal" state MySQL hogging CPU over 50%, all services heaped onto one box (eggs, basket) , no HW specs nor running SAR to collect stats...
 
Old 04-03-2008, 11:16 AM   #5
anebi
LQ Newbie
 
Registered: Aug 2007
Posts: 7

Original Poster
Rep: Reputation: 0
Thanks for the reply.

Yes, there was a tread related with mysql and we solved this problem with better configuration for mysql and increasing little bit swap space to be big like the RAM size (this is for any case swap to be big, it is not good to swap of course).

Usually what i have seen is that load avarage is going too high in this situation and cpu is used in 100%. Then machine hangs (freeze) and it is not accessible.

Also this happen i suppose if the swap is using and it is getting full. But this is only sugestion. We had a similar problem with a server and there OOM was called, because the swap was full and there was not free memory for a moment i suppose.

I don't know if when server is frozen it will able to send packages thru the network, because server is not accessible in this situation.

EDIT: unSpawn: can you give me more info about serial port logging?

Last edited by anebi; 04-03-2008 at 11:22 AM.
 
Old 04-03-2008, 12:41 PM   #6
unSpawn
Moderator
 
Registered: May 2001
Posts: 29,415
Blog Entries: 55

Rep: Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590Reputation: 3590
Like http://tldp.org/HOWTO/Remote-Serial-Console-HOWTO/?
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Ideas for Linux event at my College gurpreet_bassan Linux - General 7 01-02-2008 11:35 PM
Firewall being overloaded by linux box - any ideas? wdawson Linux - Networking 2 12-22-2005 08:14 PM
Monitoring Windows Servers from Linux (CPU, Perfmon, Event log) big_linux_geek Linux - Enterprise 5 02-16-2005 01:20 PM
Event logging RajaRC Linux - Networking 2 10-28-2004 12:59 AM
Need ideas to block traffic from advertisement servers LionKing Linux - Security 13 07-02-2001 10:47 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 12:28 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration