LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 09-15-2004, 09:35 AM   #1
eqxro
Member
 
Registered: Apr 2004
Location: Outer space :D
Distribution: Gentoo 2005.0 amd64 2.6.14-dfx3
Posts: 203

Rep: Reputation: 30
Recommended filesystem


I'm at the end of my patience here... It takes me more than 10 minutes to do a ls on a directory that contains a lot of files (actually, I have a local mirror of the Mandrake Cooker). Right now it's on a FAT32 filesystem, and a simple example... The main directory contains around 3473 files summing up 3.291 gigs of data. The size of the directory (non-recursive, as in the size of the directory entries) are well over half a meg. The contrib contains even more files.

In the situation that I have that folder shared in DC++ and I recreate my cache every 8 hours, it takes 15 minutes just to read the Cooker. Can anyone point me to a good filesystem (preferably a linux one like ext2/3,reiser,XFS) that I can use w/o loosing too much data due to cluster waste (4K) on a 15/20 Gig partition?
 
Old 09-15-2004, 11:33 AM   #2
rjlee
Senior Member
 
Registered: Jul 2004
Distribution: Ubuntu 7.04
Posts: 1,994

Rep: Reputation: 76
I have some experience of vfat, ext2 and reiserfs, and I've read about ext3. Here's my tuppenny's worth:

If you choose ext2 (or ext3, which is ext2 with an added hidden journel file) then you can choose the cluster (inode) size when you do the format. The lower the size, the less waste per file (but the bigger the inode tables; these should still be smaller than the FAT tables you've got now).

It will certainly perform a lot better than FAT32 if space is tight, because it doesn't suffer from so many problems with fragmentation.

ext2, ext3 and Reiserfs will all list files relatively quickly, owing to the fact that they store the filename (along with the file's meta-information) with the directory rather than the file itself. As I recall, so will nearly anything other than a FAT partition.

I would definitely tend to avoid FAT32, FAT16 and NTFS here (and tmpfs/romfs which store everything in memory!).

Go for ext2 in preference to ext3 or ReiserFS unless you want journelling support (i.e. must faster filesystem checks in the event of a crash or other forced unmount).

There may also be a specialist filesystem better suited to your needs. I'd be looking for something that stores files in segments rather than clusters if wasted space is really a problem.
 
Old 09-15-2004, 01:00 PM   #3
eqxro
Member
 
Registered: Apr 2004
Location: Outer space :D
Distribution: Gentoo 2005.0 amd64 2.6.14-dfx3
Posts: 203

Original Poster
Rep: Reputation: 30
I'd go for reiser myself, but i don't know if there won't be some down sides to the fact that is a 20 gigs partition.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
DISCUSSION: Virtual Filesystem: Building a Linux Filesystem from an Ordinary File mchirico LinuxAnswers Discussion 0 10-28-2004 10:35 PM
Encrypted Root Filesystem HOWTO and /dev filesystem tmillard Linux From Scratch 0 10-18-2004 03:58 PM
Recommended filesystem-setup (using kernel 2.6) Cyrus XIII Linux - General 4 03-13-2004 05:18 PM
Recommended cd-rw HeReigns Red Hat 2 10-30-2003 01:11 PM
Recommended partition size for each filesystem? vector Linux - Software 6 01-06-2002 02:50 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 07:02 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration