RedHat EL 5.1

I'm looking for options for the 'best' file system for large
files only. I will be starting with a logical disk created
using multipath and LVM that will be 3 TB and could grow to
over 10 TB.

The files will be from 10 GB to 30 GB in size and will most
of the time be sequentially read or written. The number of
files being simultaneously accesss will be from 1 to a
maximum of about 15 (not yet known just a guess). Hence not
that many files.

If it helps the application is Tivoli TSM and this file systems
will be for one of the disk pools.

The disk is a on a Hitachi SAN, SATA, 3 RAID 5 groups of 14 500GB
SATA disks each, pathing is 2 x 2 GB Fibre channels and the LUNS
are 200 GB each. I will be using LVM to join and stripe the LUNS.

TIA ...

-pete

absolutely XFS. I could go on a long diatribe about it, or you can research XFS for streaming large files. We've done lots of testing on this issue. XFS is the way when you're dealing with large files & scubbing through them. Granted, I've not compared XFS to the new-ish ZFS, but I'd still put my money on XFS.

edited to add: our testing is with film/video editing, so we deal with lots of moving large files around. XFS performs noticeably (and benchmarks) faster than the ext's or reiser.

XFS was originally build for large video data, so it's indeed superior here (large files).

ZFS isn't really an option yet, the only Linux port is with fuse(user space), you really can't compare that.

I agree with BrianK, XFS is by far your best bet for large files.

Isn't the file system that Google uses available to end users?

They have a minimum file size of 3GB or something.