LinuxQuestions.org
Visit the LQ Articles and Editorials section
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Red Hat
User Name
Password
Red Hat This forum is for the discussion of Red Hat Linux.

Notices

Reply
 
Search this Thread
Old 07-16-2009, 09:08 AM   #1
cjosephson
LQ Newbie
 
Registered: Mar 2009
Posts: 6

Rep: Reputation: 0
Horribly high pageout rate on RHEL


I have 2 machines running an Apache/Subversion/Python/Trac setup.

One runs SLES, the other RHEL. Both are virtual machines. We are having performance issue with the RHEL machine, though.

Both VMs are allocated 1G of memory. Both machines are utilizing an average of 200MB, so a lot of room to go.

However, the RHEL page-out rate is very high, in the neighborhood of 180 pages/second, while SLES is at about 10 pages/sec.

SLES is clearly not maxing out the RAM, since it has, on average, about 90% free. So why this high paging rate?
 
Old 07-16-2009, 09:28 AM   #2
stress_junkie
Senior Member
 
Registered: Dec 2005
Location: Massachusetts, USA
Distribution: Ubuntu 10.04 and CentOS 5.5
Posts: 3,873

Rep: Reputation: 331Reputation: 331Reputation: 331Reputation: 331
The other reasons for paging are that the operating system is retrieving new data or software from the disk or writing data to a data file (not the swap partition).

You could use the top utility for a quick look at what the operating system is doing.

I recommend that you run sar. It is in the sysstats package. You can run sar against the running system. If you do this it is like running vmstats and iostats at the same time, more or less. Sar is more useful if you run its data collector in the background and then use sar to create reports based on that data.

You have to configure sar. In my distributions it is installed in completely useless mode. You have to edit the configuration file and the cron jobs to get the data collector to start. Once the data collector is running automatically it will record system activity and resource usage. Let it run for a few minutes or an hour when the system is paging heavily. Then get a few reports from sar. You pass parameters to it to tell it what parts of the system you are interesting in investigating.

Once sar is installed you can find more specific information by using the man pages.
Code:
man sar
The sar utility can make more in depth reports than top but it takes a little bit of time to collect the data.

Last edited by stress_junkie; 07-16-2009 at 09:41 AM.
 
Old 07-22-2009, 07:25 AM   #3
cjosephson
LQ Newbie
 
Registered: Mar 2009
Posts: 6

Original Poster
Rep: Reputation: 0
Well, I did some work with sar and pidstat.

Unfortunately, it didn't tell me anything new. Pidstat doesn't list the page-out rate for processes, and while sar lists the pageout rate, its for the entire system. So it doesn't help me pinpoint the source paging (all I know is that it peaks around 4AM when the cron jobs run)

Is there any way to find the page out rate for an individual process?
 
Old 07-23-2009, 01:38 AM   #4
chrism01
Guru
 
Registered: Aug 2004
Location: Sydney
Distribution: Centos 6.5, Centos 5.10
Posts: 16,225

Rep: Reputation: 2021Reputation: 2021Reputation: 2021Reputation: 2021Reputation: 2021Reputation: 2021Reputation: 2021Reputation: 2021Reputation: 2021Reputation: 2021Reputation: 2021
Start by looking at what the cron jobs are doing.
Setup some logging and spreadout the cron jobs (timewise).
 
Old 07-24-2009, 07:50 AM   #5
cjosephson
LQ Newbie
 
Registered: Mar 2009
Posts: 6

Original Poster
Rep: Reputation: 0
I found the culprit--'avahi-daemon'.


When I turned it off the memory usage and paging rate got muuuuch better
 
  


Reply

Tags
machine, memory, page, rhel, sles, virtual


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
High TCP connect timeout rate! shan_nathan Solaris / OpenSolaris 2 10-24-2008 04:07 PM
high recv-q and send-q and collision rate sarah_haff Linux - Networking 2 08-19-2008 06:49 AM
Linux - rate of change too high? paulsiu Linux - General 4 07-02-2007 03:07 PM
How can I set high monitor refresh rate in Mandrake? Dimm0 Linux - Hardware 0 11-03-2004 02:08 PM
refresh rate is to high ethanlindsey Linux - Hardware 1 09-23-2004 06:15 AM


All times are GMT -5. The time now is 12:24 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration