LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 04-17-2014, 11:05 PM   #1
ZAMO
Member
 
Registered: Mar 2007
Distribution: Redhat &CentOS
Posts: 598

Rep: Reputation: 30
high i/o utilization on file systems


Hi ,

Am using "fuser -cu /myfs" to identify the process accessing the filesystem /myfs . But i want to list the process which are consuming high i/o on this disk . Is there a way to use "iostat" and "ps" to find out the process consuming high io on this particular Filesystem?
 
Old 04-18-2014, 04:15 PM   #2
Habitual
LQ Veteran
 
Registered: Jan 2011
Location: Abingdon, VA
Distribution: Catalina
Posts: 9,374
Blog Entries: 37

Rep: Reputation: Disabled
Collectl can help.

https://www.google.com/#q=markseger+...xquestions.org

any post by Mark Seger is a "keeper" on this subject.

Hi Mark!
 
Old 04-18-2014, 05:34 PM   #3
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,359

Rep: Reputation: 4180Reputation: 4180Reputation: 4180Reputation: 4180Reputation: 4180Reputation: 4180Reputation: 4180Reputation: 4180Reputation: 4180Reputation: 4180Reputation: 4180
That'll make his (Mark) Easter break better

In his case maybe not - I don't believe the taskstats as maintained by the kernel are device/partition specific. The OP can get this sort of data from blktrace, but needs some setup, and post-processing. Initially was at the block device level only, but can now be specified for partitions.
 
Old 04-21-2014, 02:24 PM   #4
markseger
Member
 
Registered: Jul 2003
Posts: 244

Rep: Reputation: 26


Trying to pin a specific process to a disk can be a problem as collectl doesn't track that sort of thing, however sometimes you can infer a lot by correlating various things. So assuming you have a bunch of raw collectl data. It's pretty easy to see how busy a particular disk is with 'collectl -p filename -sD --dskfilt xxx -oT' noting the oT will stick a timestamp on each line. If you can identify some spikes you think might be attributed to the problem process, this is a good thing. Be sure to note the timeframe.

Now if you play back the same data and report process I/O usage with 'collectl -p filename -sZ --from hh:mm-hh:mm --procanalyze', this will report a summary of the processes that were running between those two times in space-separated format, which you can then load into a spreadsheet and from there you can identify which processes were doing a lot of disk i/o. Keep be mind this will not tell you who was talking to what disk, only that they were doing I/O. This may give you the answer you're looking for and maybe it won't.

The other thing is if the spikes are relatively short, the 1 minute default process monitoring interval may be too long to see anything and running collectl with the a 10 second interval like the disk processing interval, may be more helpful.

No promises this will work for you but it's he best I can come up with at the moment.

good luck

-mark
 
Old 04-21-2014, 11:42 PM   #5
ZAMO
Member
 
Registered: Mar 2007
Distribution: Redhat &CentOS
Posts: 598

Original Poster
Rep: Reputation: 30
Thanks for your replies .

vmstat shows very high IO utilization on this mount /myfs. am looking for those processes which is causing the high IO to this mount and what are the files being accessed(both on read and write). Yes, post-processing is must here to analyze.

I cannot go with collectl on this particular environment . Any suggestion to collect the ps consuming more i/o on this live system?
 
Old 04-22-2014, 02:45 PM   #6
markseger
Member
 
Registered: Jul 2003
Posts: 244

Rep: Reputation: 26
Could you say more about why you can't go with collectl? if you don't have privileges and so can't install it as root, you can always grab the tarball and just extract collectl into you home directory tree and run it from there.
-mark
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
High Run queue utilization although CPU utilization is low.. rajeprag Linux - Server 0 08-18-2013 09:44 AM
High Memory Utilization devUnix Linux - Server 3 09-19-2011 10:21 AM
High Disk Utilization help masenko703 Linux - Newbie 1 06-23-2009 11:40 PM
LXer: Cluster File Systems Attains World Leadership Position In High Performance File System LXer Syndicated Linux News 0 07-14-2006 06:21 AM
High memory utilization dav7500 Linux - General 7 03-05-2004 05:07 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 10:43 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration