LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 09-07-2008, 02:29 PM   #1
Oxagast
Member
 
Registered: Aug 2003
Location: Mocksville, NC, USA
Distribution: Gentoo, Slackware.
Posts: 410

Rep: Reputation: 30
File useage statistics/defragmentation


Does anybody know of a good deamon that will monitor all the files on my system, and then try to arrange the most used near the front of the drive (defragmented)? I noticed that if I have a large file, and I say, cat filename > /dev/null, and the file is fragmented, I'll only get like 1 or 2mb/s transfer, whereas if the file is defragmented, I get upwards of 40mb/s. I only noticed because I had downloaded files at ~175kb/s, and they were written to the drive, then I had moved them to a different drive (where I store my media), and since they were being written all at once, and nothing else was being written to the drive at the same time, they were all in the same place. So it seems that the fragmentation I'm getting on atleast some files are substantially impacting performance. Anybody know how to fix this? I'm using a combination of reiserfs and ext3 partitions.

oxagast@fluxnet:~$ mount
/dev/hda6 on / type reiserfs (rw)
tmpfs on /lib/init/rw type tmpfs (rw,nosuid,mode=0755)
proc on /proc type proc (rw,noexec,nosuid,nodev)
sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
procbususb on /proc/bus/usb type usbfs (rw)
udev on /dev type tmpfs (rw,mode=0755)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=620)
/dev/hda1 on /boot type reiserfs (rw,notail)
/dev/hda8 on /home type reiserfs (rw)
/dev/hdb6 on /media type ext3 (rw)
/dev/hda7 on /usr type reiserfs (rw)

(I know I probably shouldn't have different filesystems all over the drives, I didn't necessarily mean for it to be that way, when I was installing the installer was being screwy and I couldn't figure out how to get it to do what I wanted so just said screw it. I normally just create the partitions and format them by hand, but debian's installer always screws with them and I couldn't figure out how to get it not to.)

Last edited by Oxagast; 09-07-2008 at 02:34 PM.
 
Old 09-07-2008, 02:37 PM   #2
i92guboj
Gentoo support team
 
Registered: May 2008
Location: Lucena, Córdoba (Spain)
Distribution: Gentoo
Posts: 4,083

Rep: Reputation: 404Reputation: 404Reputation: 404Reputation: 404Reputation: 404
If by reiserfs you mean 3.x, I advise you to migrate to another filesystem. Reiserfs (not reiser4) has serious issues with fragmentation, overall if you use tail packing (your home partition seems not to be using "notail").

You might also want to check this thread in the Gentoo forum:

http://forums.gentoo.org/viewtopic-p-3081971.html
 
Old 09-07-2008, 07:30 PM   #3
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 19,244

Rep: Reputation: 3383Reputation: 3383Reputation: 3383Reputation: 3383Reputation: 3383Reputation: 3383Reputation: 3383Reputation: 3383Reputation: 3383Reputation: 3383Reputation: 3383
I hope you took caching into consideration. If you copied the files a second time without flushing the cache, your numbers will be suspect.
 
Old 09-08-2008, 04:11 AM   #4
salasi
Senior Member
 
Registered: Jul 2007
Location: Directly above centre of the earth, UK
Distribution: SuSE, plus some hopping
Posts: 4,070

Rep: Reputation: 897Reputation: 897Reputation: 897Reputation: 897Reputation: 897Reputation: 897Reputation: 897
Because Reiser deals with small and large files differently, your numbers may not mean what you think they mean. The tail packing optimisation for small files boosts performance, but only for small files.

i92guboj wrote:
Quote:
(your home partition seems not to be using "notail").
It looks to be the /boot parttiton that uses 'notail', and I assume (bad!) that your boot partition isn't either the source or target for this copy test.
 
Old 09-09-2008, 12:44 AM   #5
i92guboj
Gentoo support team
 
Registered: May 2008
Location: Lucena, Córdoba (Spain)
Distribution: Gentoo
Posts: 4,083

Rep: Reputation: 404Reputation: 404Reputation: 404Reputation: 404Reputation: 404
Quote:
Originally Posted by salasi View Post
Because Reiser deals with small and large files differently, your numbers may not mean what you think they mean. The tail packing optimisation for small files boosts performance, but only for small files.

i92guboj wrote:


It looks to be the /boot parttiton that uses 'notail', and I assume (bad!) that your boot partition isn't either the source or target for this copy test.
That's what I said. /home is not using "notail", which means it uses tail packing (by default), which is the number one performance hog on a reiserfs filesystem. It doesn't really matter if he enables it or not in /boot, cause /boot is usually small, and it's rarely used, even to read (just at boot time usually).
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
useage of the file /var/lock/subsys/local banajah Linux - Newbie 1 03-14-2008 06:44 AM
A file-system defragmentation tool on Linux tmcco Linux - Software 148 05-07-2007 11:29 AM
Collecting file modification statistics f97mp Linux - Newbie 4 02-06-2007 01:18 PM
Statistics on file accesses (Samba) ? intens Linux - Software 5 01-19-2004 11:57 AM
Defragmentation of File System mikeshn Linux - General 2 04-19-2002 10:46 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 09:07 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration