LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 10-06-2007, 03:49 AM   #1
amitabhm
LQ Newbie
 
Registered: Mar 2006
Posts: 6

Rep: Reputation: 0
Smile ext3 tuning for big files


Hi,
Can anyone help me in this?
I have got several 250GB partitions , where i need to create ext3 filesystem.
The files that would be written in these partitions are very large files each of 16GB.
How can I fine tune this? If I take all the default values of mke2fs , it takes long to create the filesystem and to store the large files also(actually these large files are database files.)
For doing this I have put some parameters.

mke2fs -j -T largefile4 -m 2 -L /label_name /device_name
Is it ok?
Also after doing some googling I reduced the space reserved for super user to 2%. What does this space reserved for super user meant for?
Can I do some more performance tuning?

Thanks in Advance,
Amitabh.
 
Old 10-06-2007, 12:46 PM   #2
osor
HCL Maintainer
 
Registered: Jan 2006
Distribution: (H)LFS, Gentoo
Posts: 2,450

Rep: Reputation: 76
As for the tuning, that looks good (-T largefile4 should automatically do tunings such as large block sizes, inode counts, etc.).
Quote:
Originally Posted by amitabhm View Post
Also after doing some googling I reduced the space reserved for super user to 2%. What does this space reserved for super user meant for?
Can I do some more performance tuning?
It means that when the disk is full for normal users, the superuser may write to some reserved space. This is good for instances where you have a single root filesystem, which has run out of space because of user X’s actions. But you don’t want user X’s actions to stop the daemons (e.g., syslogd and friends) from doing their jobs. This is a very old solution to the problem. More modern-day solutions include separate home partitions and user quotas.
 
Old 10-07-2007, 07:50 AM   #3
amitabhm
LQ Newbie
 
Registered: Mar 2006
Posts: 6

Original Poster
Rep: Reputation: 0
Thanks for your help osor.
 
Old 10-07-2007, 03:17 PM   #4
jay73
LQ Guru
 
Registered: Nov 2006
Location: Belgium
Distribution: Ubuntu 11.04, Debian testing
Posts: 5,019

Rep: Reputation: 130Reputation: 130
Why don't you use xfs instead? It's vastly superior precisely when dealing with huge files.
 
Old 10-07-2007, 06:05 PM   #5
btmiller
Senior Member
 
Registered: May 2004
Location: In the DC 'burbs
Distribution: Arch, Scientific Linux, Debian, Ubuntu
Posts: 4,284

Rep: Reputation: 371Reputation: 371Reputation: 371Reputation: 371
However, based on what I've seen heard, XFS is also a lot more prone to become corrupted in the event of an unclean shutdown. If your power is good and/or you're on a decent UPS that's no problem (and any filesystem has some risk of corruption in an unclean shutdown) but you may want to be aware of that.

I've found that even on large (4+ TB) RAID volumes ext3 with nothing more than the SPARSE_SUPER and LARGE_FILE options enabled at mkfs time gives acceptable file serving performance. I've tinkered with other file systems and not found a huge difference although Reiser is known to perform better in cases where you have lots of small files.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Understanding fsck.ext3 errors - Inode X is too big. Truncate? DigitalMagnets Linux - Hardware 3 10-03-2007 11:07 AM
Remove big files Hep Linux - Newbie 6 03-14-2007 12:13 PM
Find big files markvc Linux - General 4 12-05-2006 08:14 AM
undelete files on ext3 santner Linux - General 0 04-27-2004 09:06 AM
recover files in ext3 hana_abe Linux - Newbie 3 11-16-2003 10:46 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 02:43 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration