LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 05-03-2012, 12:59 PM   #16
Jonus
LQ Newbie
 
Registered: May 2012
Posts: 15

Original Poster
Rep: Reputation: Disabled

Could it also be because "No Implementation: Support for creating ext4 file systems is not implemented yet."?

OR, if it can only handle file systems <14Tb can I create two 12Tb partitions and then mount them as some sort of LVM pool? (Excuse my terminology, another virgin territory for me)
 
Old 05-03-2012, 01:19 PM   #17
suicidaleggroll
LQ Guru
 
Registered: Nov 2010
Location: Colorado
Distribution: OpenSUSE, CentOS
Posts: 5,433

Rep: Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044
What program is generating that message? I don't see it in your previous posts.

I'm not sure how LVM works, so I don't know if that would be able to work around this problem. From what I understand, LVM allows you to spread a single file system across multiple discs/partitions. If that's the case, you'd still have this problem when attempting to create the filesystem on it.

From what I've been reading, you can't increase the block size over 4k, and e2fsprogs is limited to 32-bit addressing with ext4, which means the limit is a hard 16TB, I don't see any way around it. From what I see, the only two mature linux filesystems that support >16TB are XFS and JFS. XFS only works on 64-bit, and JFS isn't supported on CentOS (at least not well).

I'm not sure what the best move here is. Would running two separate partitions/filesystems be possible given your usage?

Last edited by suicidaleggroll; 05-03-2012 at 01:24 PM.
 
Old 05-03-2012, 01:26 PM   #18
Jonus
LQ Newbie
 
Registered: May 2012
Posts: 15

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by suicidaleggroll View Post
Unfortunately it looks like XFS only works in 64 for some reason on CentOS. You could try the ext4 filesystem instead (still need the GPT partition table, but you should be able to use mkfs.ext4 /dev/sdb1 to switch from XFS to ext4).

Otherwise you'd have to switch to 64-bit, which means reinstalling the OS from scratch. If you post the output of "cat /proc/cpuinfo" we'll be able to see if the hardware supports it, but unless this is a brand new machine that was just set up, it will probably be more worthwhile to just use a different filesystem type.
I just discovered that my cpus can run 64-bit... probably should have confirmed that before installing the os. As I said before, this is a new server, so I haven't configured a lot, surely nothing I can't easily do again.

So it looks like I'm reinstalling the os. xfs better work after that...
 
Old 05-03-2012, 01:29 PM   #19
suicidaleggroll
LQ Guru
 
Registered: Nov 2010
Location: Colorado
Distribution: OpenSUSE, CentOS
Posts: 5,433

Rep: Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044
If it's a new server, I would almost definitely just go back and re-install the 64-bit version. From what I see that should fix the XFS problem, the 32-bit kernel simply doesn't include an xfs module which is why it can't mount it.
 
Old 05-04-2012, 01:52 PM   #20
Jonus
LQ Newbie
 
Registered: May 2012
Posts: 15

Original Poster
Rep: Reputation: Disabled
So today I installed the CentOS 6.2 x86_64 version, and it was ridiculously simple to format the raid. Made changes to /etc/fstab and gave it a reboot to see if it still worked and just like that I have a 26TB xfs at my finger tips.

Thanks for all your help, suicidaleggroll.

--

Now does anyone have any insight into the dual fiber connection? It would be best to figure that out now before the file system starts being used.
 
Old 05-04-2012, 02:41 PM   #21
suicidaleggroll
LQ Guru
 
Registered: Nov 2010
Location: Colorado
Distribution: OpenSUSE, CentOS
Posts: 5,433

Rep: Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044Reputation: 2044
Great! I'm glad you got it worked out.

Unfortunately I have zero insight into the dual fiber problem...
 
Old 05-07-2012, 07:31 AM   #22
masterclassic
Member
 
Registered: Jun 2007
Distribution: Knoppix
Posts: 140

Rep: Reputation: 23
Perhaps it is better to make a new topic on the fiber issue, with a proper title.
" 16x2TB RAID. What Large File System Format to Use? " has nothing to do with that second question.
 
Old 05-07-2012, 06:56 PM   #23
chrism01
LQ Guru
 
Registered: Aug 2004
Location: Sydney
Distribution: Centos 6.9, Centos 7.3
Posts: 17,347

Rep: Reputation: 2365Reputation: 2365Reputation: 2365Reputation: 2365Reputation: 2365Reputation: 2365Reputation: 2365Reputation: 2365Reputation: 2365Reputation: 2365Reputation: 2365
Yeah, start a new thread and mention HW make/model of the fibre switch etc
 
Old 04-17-2014, 12:06 AM   #24
WildBohemian
LQ Newbie
 
Registered: Apr 2014
Posts: 1

Rep: Reputation: Disabled
OpenSolaris, Hardware Controller & RAIDZ3 for RAID spans

Each RAID array has benefits and drawbacks with what filesystem you are using. The questions you need to ask are follows... Is this system using software RAID or Hardware RAID. With Linux even if it is a small RAID such as 0, 1, 10, 5 I still would suggest a basic $50-$100 RAID card. Hardware RAID controllers work much better with any type of Linux. The other question is what is the size of the volume span and how many disks you are going to be using. For 2-5 disks a basic array ext3 and ext4 are okay solutions, I personally would never use them because of journaling. I would only use ext4 on no more than RAID 0 with 2 disks ever. XFS is a good option for anything 6+ disks. But you want to make sure you have a UPS for your array and a line conditioner is a good idea as well for such a large array. If you can afford such a large volume of fiber drives then these should not be a problem. My own home personal use I use OpenSolaris with RAIDZ3 and the LSI LSI00417 controller with an 8 drive RAID 50 span. So I only loose 25% parity. This card costs just under $600 but offers a dual core processor, 1GB 1866 ddr3, 8x PCI-E 3.0 (8 lanes are crucial to any array with more than 4 disks) and support for Linux, Solaris, FreeBSD, VMware and others. I have the HUS724040ALS640 drives. Hitachi has the lowest 3 year failure rate even lower than Western Digital and Seagate has an awful failure rate compared to the others. This is a SAS drive not fibre and is rated at 2.0M hour MTBF and has a 5 year warranty. I recently built this replacing an old system that had a whopping 3TB in RAID 50. It's nice to have 24TB now. It should last a good 5-6 years. FYI a good rule of thumb for any server is to have 1GB of RAM for every 1TB include parity in your calculation as well. I have 24TB and 8TB in parity, so I have 32GB of RAM 4x8GB in quad channel rather than 2x16GB in dual channel. I hope this helps.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Which file system for a large lvm Carpo Slackware 15 04-03-2008 03:29 PM
large data transfer to raid results in system reboot captainkrypto Linux - Hardware 1 04-15-2006 07:47 PM
how large can a file system be? Wolf_Assassin Linux - Software 2 08-21-2004 02:31 PM
Large tar file taking huge disk space in ext3 file system pcwulf Linux - General 2 10-20-2003 07:45 AM
Large file system on redhat 7.3 stefanof Linux - Distributions 1 08-28-2002 08:25 AM


All times are GMT -5. The time now is 04:09 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration