LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 02-10-2010, 04:51 AM   #1
wmasry
LQ Newbie
 
Registered: Nov 2009
Posts: 26

Rep: Reputation: 15
Question High load average investigation


Dears,

I have High load on my server and my investigation shows nothing (so i believe that my investigations is wrong ), the load average in this moment is 10.13, 9.47, 8.24. , mentioning the below.

- The disk utilization (all the disks) is near 0, as the result of the IOSTAT
- There is no blocked processes (as a result of VMSTAT).
- I have two processors (dual core) , the maximum load average should be something around 4.
- The server always have above 8 load average in all times interval.

btw , my OS is RHEL AS release 4 (Nahant Update 7)
Kernel :Linux 2.6.9-78.ELhugemem #1 SMP i686 i686 i386 GNU/Linux

So can you please help in this

Regards,

Last edited by wmasry; 02-10-2010 at 05:15 AM.
 
Old 02-10-2010, 04:55 AM   #2
sohail0399
Member
 
Registered: Oct 2008
Location: Pakistan, Islamabad
Distribution: CentOS, Fedora, Solaris
Posts: 154

Rep: Reputation: 23
which distro do you have?

2nd is, did you also verify it through top/ps -aux command regarding the process?
 
Old 02-10-2010, 05:21 AM   #3
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,103

Rep: Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117
First - is it affecting your ability to service our users ?.
If not, why do you care ?.

Quote:
Originally Posted by wmasry View Post
- I have two processors (dual core) , the maximum load average should be something around 4.
How did you come to that conclusion ?.
Try this, and post the output
Code:
top -b -n 1 | awk '{if (NR <=7) print; else if ($8 == "D") {print; count++} } END {print "Total status D: "count}'
 
Old 02-10-2010, 06:07 AM   #4
wmasry
LQ Newbie
 
Registered: Nov 2009
Posts: 26

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by syg00 View Post
First - is it affecting your ability to service our users ?.
If not, why do you care ?.

How did you come to that conclusion ?.
Try this, and post the output
Code:
top -b -n 1 | awk '{if (NR <=7) print; else if ($8 == "D") {print; count++} } END {print "Total status D: "count}'
Here is the output

top - 15:05:15 up 6 days, 5:42, 5 users, load average: 8.40, 7.81, 7.42
Tasks: 276 total, 1 running, 275 sleeping, 0 stopped, 0 zombie
Cpu0 : 19.7% us, 30.2% sy, 0.0% ni, 49.5% id, 0.6% wa, 0.0% hi, 0.0% si
Cpu1 : 19.0% us, 34.9% sy, 0.0% ni, 45.5% id, 0.6% wa, 0.0% hi, 0.0% si
Cpu2 : 16.6% us, 36.2% sy, 0.0% ni, 46.6% id, 0.5% wa, 0.0% hi, 0.0% si
Cpu3 : 18.3% us, 38.7% sy, 0.0% ni, 42.2% id, 0.7% wa, 0.0% hi, 0.0% si
Mem: 12468176k total, 11329780k used, 1138396k free, 344988k buffers
Total status D:

For the distibution its
OS is RHEL AS release 4 (Nahant Update 7)
Kernel :Linux 2.6.9-78.ELhugemem #1 SMP i686 i686 i386 GNU/Linux

I believe its not effecting my ability to the serve the users , but at least i need to know the reason behind this , and to justify if its application issue or OS issue

Last edited by wmasry; 02-10-2010 at 06:09 AM.
 
Old 02-10-2010, 06:10 AM   #5
wmasry
LQ Newbie
 
Registered: Nov 2009
Posts: 26

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by sohail0399 View Post
which distro do you have?

2nd is, did you also verify it through top/ps -aux command regarding the process?
Ditribution is

For the distibution its
OS is RHEL AS release 4 (Nahant Update 7)
Kernel :Linux 2.6.9-78.ELhugemem #1 SMP i686 i686 i386 GNU/Linux

I got the load average from the top and i can see that there is no processes blocked from the ps aux
 
Old 02-10-2010, 06:21 AM   #6
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,103

Rep: Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117Reputation: 4117
Hmmm - bad assumption on my part. I don't have a RHEL available - can you run this
Code:
top -b -n 1 | head -n 15
 
Old 02-10-2010, 07:11 AM   #7
eyemole80
Member
 
Registered: Jun 2004
Distribution: Fedora Core 1
Posts: 47
Blog Entries: 1

Rep: Reputation: 16
Tasks: 276 total, 1 running, 275 sleeping, 0 stopped, 0 zombie

276 proceses are not so huge in number. thats fine for a server.

check what process is eating memory and cpu the most. Try running following command.

ps -A -o pid,ppid,rss,pcpu,pmem,args --sort=rss

ps -A -o pid,ppid,rss,pcpu,pmem,args --sort=pcpu
 
Old 02-10-2010, 12:27 PM   #8
wmasry
LQ Newbie
 
Registered: Nov 2009
Posts: 26

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by syg00 View Post
Hmmm - bad assumption on my part. I don't have a RHEL available - can you run this
Code:
top -b -n 1 | head -n 15
Here is the result

top - 21:26:43 up 6 days, 12:03, 5 users, load average: 10.06, 10.94, 10.41
Tasks: 291 total, 2 running, 289 sleeping, 0 stopped, 0 zombie
Cpu0 : 19.6% us, 30.0% sy, 0.0% ni, 49.7% id, 0.6% wa, 0.0% hi, 0.0% si
Cpu1 : 18.8% us, 34.9% sy, 0.0% ni, 45.6% id, 0.6% wa, 0.0% hi, 0.0% si
Cpu2 : 16.5% us, 36.1% sy, 0.0% ni, 46.9% id, 0.5% wa, 0.0% hi, 0.0% si
Cpu3 : 18.2% us, 38.7% sy, 0.0% ni, 42.4% id, 0.7% wa, 0.0% hi, 0.0% si
Mem: 12468176k total, 11981652k used, 486524k free, 366524k buffers
Swap: 9004536k total, 224k used, 9004312k free, 3173636k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
17107 oracle 17 0 3892m 3.4g 22m S 75.3 28.2 448:15.10 java
17108 oracle 17 0 3882m 3.3g 22m S 63.7 28.0 378:02.92 java
31495 root 17 0 96256 93m 308 S 3.9 0.8 10:23.35 adlagent
2 root RT 0 0 0 0 S 1.9 0.0 0:21.10 migration/0
16493 root 15 0 3884 1040 696 R 1.9 0.0 0:00.01 top
 
Old 02-10-2010, 12:29 PM   #9
wmasry
LQ Newbie
 
Registered: Nov 2009
Posts: 26

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by eyemole80 View Post
Tasks: 276 total, 1 running, 275 sleeping, 0 stopped, 0 zombie

276 proceses are not so huge in number. thats fine for a server.

check what process is eating memory and cpu the most. Try running following command.

ps -A -o pid,ppid,rss,pcpu,pmem,args --sort=rss

ps -A -o pid,ppid,rss,pcpu,pmem,args --sort=pcpu
I believe that memory have nothing to do with this

here is the memory statistics


total used free shared buffers cached
Mem: 11 11 0 0 0 3
-/+ buffers/cache: 8 3
Swap: 8 0 8

I believe that the memory is fine and even i have 3 Giga for caching , tell me what do you think
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
High load average with no reason wmasry Linux - Server 2 01-13-2010 03:21 PM
load average high sang_froid Linux - Server 3 12-14-2009 10:18 AM
load average and cpu usage too high, why could i do? v_fone Linux - Newbie 5 07-02-2009 03:17 AM
High load average for no apparent reason permalac Linux - Server 12 03-09-2009 11:13 AM
Load average stay as high as around 1.00 lawrence_lee_lee Linux - Software 2 09-10-2008 01:22 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 01:50 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration