LinuxQuestions.org
Latest LQ Deal: Latest LQ Deals
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 04-23-2008, 01:27 AM   #1
Enyo
LQ Newbie
 
Registered: Nov 2007
Posts: 7

Rep: Reputation: 0
extremly high io waits on lvm + ubuntu-server while running rtorrent


im using a pair of 750gb sata disks in lvm to make a 1.5tb partion and while running rtorrent which runs at about 700Kb down my IOwait spikes so high that sshing into the machine becomes impossible.

this is on ubuntu server 7.10 and the only other thing running is ushare and samba. the machine itself is a 1.5ghz via with 512mb ram (56% of which is in use by rtorrent)

anyone got any ideas for what i can do about this?
 
Old 04-24-2008, 05:35 PM   #2
unSpawn
Moderator
 
Registered: May 2001
Posts: 29,415
Blog Entries: 55

Rep: Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600
Quote:
Originally Posted by Enyo View Post
im using a pair of 750gb sata disks in lvm to make a 1.5tb partion and while running rtorrent which runs at about 700Kb down my IOwait spikes so high that sshing into the machine becomes impossible. this is on ubuntu server 7.10 and the only other thing running is ushare and samba. the machine itself is a 1.5ghz via with 512mb ram (56% of which is in use by rtorrent)
A high amount of iowait, generally speaking, means there's more outstanding disk requests waiting than can be handled by your current setup. If this high iowait occurs only running this app, then my first hunch would be to check the amount of torrents (and clients) you're serving, because while the application itself may be small in terms of on-disk size, the amount of memory used will increase with the amount of torrents and clients served: maintaining and threads sockets require memory, swapping out parts of an application, reading and writing torrents and logging requires disk I/O, so if you temporarily suspend half of your torrents and see an improvement that's quick confirmation.


Broadening scope there's much that can influence a systems performance. The Linux kernel does pretty much take care of all things on its own, it's matured well, it's performant, reasonably fault tolerant, and out-of-the-box usable for generic, all-purpose usage. Sometimes human decisions can help make it perform better. Level one: how it recognises and drives hardware. Some controllers are more equal than others. It wouldn't be the first time some controller card seems flakey because the kernel developers can't wrap their head around another vendors partial implementation of standards. This may or may not be the case. Looking up chipset support in the kernels Changelog or on the LKML can reveal things (also see: driver options, boot commandline args). Performance can also be influenced by tuning hardware latency (setpci?) and sysctls like those for VM (for instance caching, how you schedule flushouts in relation to the amount of memory available, how writes are queued), network (IPv4 settings and timings, amount of ports that can be opened, the amount of memory allowed to be consumed by sockets, etc, etc), and the choice of scheduler (for instance if it's CFQ you have access to ionice). (But to be able to tweak w/o losing touch with reality you want to first set up baseline data (dstat, atop, SAR) preferably on an idle system.) One level up there's the choice of filesystem. FS type (extn, XFS, Reiser) does matter, because not all are equally fast (or rugged) under pressure. FS options, like for instance how it updates timestamps (or not) or does journalling (tune2fs: ordered vs writeback) can matter as well. (Something that strikes me as odd is having a 1.5 TB LVM. Unless you really need that kind of storage: hardware access beats any emulation. You're looking at a filesystem layer on top of LVM on top of hardware. I've got no numbers but ditching LVM and careful partitioning *will* improve performance because then you have two devices for parallel read/writing.) Then there's the kernels process handling. While it obviously is a trade-off you could reschedule (prio/nice/ionice) the application so other processes get faster access to CPU cycles. Finally to address rtorrent vs SSH: you could shape traffic so combat bandwidth saturation, so there's always a portion free. However this doesn't alleviate performance problems on a lower level. I'm sorry if this is too terse or not easy to grasp. Each system is unique and has unique requirements. While a lot of tweaks make sense in a lot of situations it depends on you to get things right.
I hope the approach of setting up a baseline (so you know what you start out with), read docs (so you know what least-invasive improvements boost performance the most), tweak and compare data makes sense.

Last edited by unSpawn; 04-26-2008 at 07:51 AM.
 
Old 05-02-2008, 04:56 AM   #3
Enyo
LQ Newbie
 
Registered: Nov 2007
Posts: 7

Original Poster
Rep: Reputation: 0
hi,

thanks for your detailed reply!

i have discovered that i was actualy writing to the system disk on this system which isn't lvm but since this is a ITX nas box, its a 80gb 2.5" disk which is fairly slow, and after poking the rtorrent devs it turns out is probably just too slow to cope with rtorrents writes at that speed.

and yes i probably should drop lvm ( i was only being lazy so i could mount all the disks as one samba share, there are probably better ways of doing this)
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Running rtorrent at boot chungaroo Linux - Desktop 1 10-17-2007 08:58 PM
LXer: How To Compile rTorrent From SVN In Ubuntu Feisty Fawn / Gutsy LXer Syndicated Linux News 0 09-19-2007 09:20 PM
SOLVED -- NFS server waits very long time to start jlinkels Linux - Networking 1 08-14-2007 08:04 AM
Server aburptly stops running High CPU usage PERL script after about 5 hours bpmee Linux - Server 3 05-18-2007 11:24 AM
Intel i810 on-board graphics card bug, with Ubuntu server 7.04 running Ubuntu-Desktop calebf Linux - Server 2 05-14-2007 11:53 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 07:51 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration