LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 09-27-2010, 01:05 PM   #1
rog_ski
LQ Newbie
 
Registered: Sep 2010
Posts: 13

Rep: Reputation: 0
Upgrading Redhat to support ext4 for files over 2TB in size


G-day

Newbie here.

We are currently running Redhat 5.4 64Bit (Build 2.6.18-164.e15) however having issues with tar files that are greater than 2TB in size.

We have been told that upgrading the kernel to support the ext4 file system (supported in version 5.5?) and mounting the current 10TB nas share as an ext 4 file system may solve our over 2TB file size issues. (please correct me if I am wrong)
  • Are their limitations within the ext3 file system that cause issues to files greater than 2TB and if this is the case
  • Do we have to update the kernel (complete rebuild), or can we load a package on the redhat box to support the ext 4 file system
  • Where do we get the upgrade/package. I have logged onto the redhat site and can not find kernel updates but can find the full installation packages.
  • We are not connected directly to the internet and do not have access to the update repository

Thanks in advance for your assistance in this matter.

Cheers

Rog_ski
 
Old 09-27-2010, 02:25 PM   #2
valen_tino
Member
 
Registered: Jan 2008
Posts: 105

Rep: Reputation: 28
To get you started:

Quote:
We have been told that upgrading the kernel to support the ext4 file system (supported in version 5.5?) and mounting the current 10TB nas share as an ext 4 file system may solve our over 2TB file size issues. (please correct me if I am wrong)

* Are their limitations within the ext3 file system that cause issues to files greater than 2TB and if this is the case
"Currently, Ext3 support 16 TB of maximum file system size and 2 TB of maximum file size. Ext4 adds 48-bit block addressing, so it will have 1 EB of maximum file system size and 16 TB of maximum file size." - Source
 
Old 09-27-2010, 03:34 PM   #3
rog_ski
LQ Newbie
 
Registered: Sep 2010
Posts: 13

Original Poster
Rep: Reputation: 0
Thanks Valen tino

This does answer one question for us and "could" be the cause of the error when we attempt to extract a 2.2TB tar file

# tar -xf filname.tar.gz
Gzip: Stdin: Unexpected end of file
Tar: Unexpected EOF in archive
Tar: Unexpected EOF in archive
Tar: Error is not recoverable: exiting now
Will Redhat 5.5 give us access to ext4 and will I have to do the full upgrade or can I load a patch - package to get that functionality

Thanks again
 
Old 09-27-2010, 04:00 PM   #4
valen_tino
Member
 
Registered: Jan 2008
Posts: 105

Rep: Reputation: 28
Well, according to the release notes of RHEL 5.5, ext4 is a Technology Preview. "Technology Preview features are currently not supported under Red Hat Enterprise Linux subscription services, may not be functionally complete, and are generally not suitable for production use. However, these features are included as a customer convenience and to provide the feature with wider exposure." Source.

Also this link has all the features of RHEL 5.5 listed.

Going by this, it is not recommended to implement ext4 in a production area. Instead you could try this in a sandbox server to see if ext4 resolves your issue. If it does then you may want to consider moving to RHEL 6 which is due to release shortly and includes ext4 by default. Source.

Last edited by valen_tino; 09-27-2010 at 04:03 PM.
 
Old 09-28-2010, 04:56 AM   #5
rog_ski
LQ Newbie
 
Registered: Sep 2010
Posts: 13

Original Poster
Rep: Reputation: 0
Thanks, while I appreciate the detail in your response I am not sure you completely answered my questions from the posts 1 or 2.

We are looking for a fix of extracting that 2.2 TB tarfile and while we will look into RHEL 6 for the future it doesn't fix our our current issue.

Question: Are we able to mount an ext4 file system (single share) on our current RHEL 4 box or do we need to upgrade the whole box to RHEL 5.

Question: Where do i get the source files

Up until yesterday I had been able to find all my answers through Google but had hit a dead end so thought I could find a quick answer here.

Regards

Last edited by rog_ski; 09-28-2010 at 06:16 AM.
 
Old 09-28-2010, 08:58 AM   #6
valen_tino
Member
 
Registered: Jan 2008
Posts: 105

Rep: Reputation: 28
Quote:
Question: Are we able to mount an ext4 file system (single share) on our current RHEL 4 box or do we need to upgrade the whole box to RHEL 5.
EXT4 is supported on RHEL 5.3 (I think) and above. I would recommend going to 5.5. In short you will have to upgrade to RHEL 5.

Quote:
Question: Where do i get the source files
You will have to install e4fsprogs to create EXT4 file systems. This rpm is in the RHEL media itself. If you don't have the DVD/CDs then you can download it from RHN since yum is not an option for you.

Again, you are trying to do something that Red Hat doesn't support in a production environment. I highly recommend that you do this in your test area first to validate the integrity of your data.

Last edited by valen_tino; 09-28-2010 at 09:09 AM.
 
1 members found this post helpful.
Old 09-28-2010, 09:18 AM   #7
i92guboj
Gentoo support team
 
Registered: May 2008
Location: Lucena, Córdoba (Spain)
Distribution: Gentoo
Posts: 4,083

Rep: Reputation: 405Reputation: 405Reputation: 405Reputation: 405Reputation: 405
Regardless the RHEL stuff, ext4 is not available for your kernel at all. It's just too old.

Secondly, your current fs (ext3) CAN NEVER hold a file that's bigger than 2TB, this means that if you tried to store a bigger file then it's been truncated. Extracting file from the 2TB archive IS NOT the problem (as long as the files inside are not bigger than 2TB themselves). The problem is that maybe your tar file is not correct because it couldn't be stored in first place.

Third, if you don't want to bother just use XFS, it can host files up to 8 Exabytes. I wouldn't use it if you don't have a good UPS, though.
 
1 members found this post helpful.
Old 09-28-2010, 09:27 AM   #8
rog_ski
LQ Newbie
 
Registered: Sep 2010
Posts: 13

Original Poster
Rep: Reputation: 0
Now were cooking with gas. Thank you for your help guys

I would like to see if the file issue we are experiencing is related to a corrupt tar file or to the restrictive ext3 file system.

We are in the process of installing 5 in our lab and give it a run through.

Cheers

Last edited by rog_ski; 09-28-2010 at 09:36 AM.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
2TB on Redhat EL 4 codenjanod Linux - Hardware 8 08-24-2010 12:24 AM
Confused about the 2TB limit--will it affect my RAID size? busydoingnothing Linux - Server 1 03-27-2010 05:08 PM
LXer: Linux Storage: Creating a Partition Size Larger than 2TB LXer Syndicated Linux News 0 11-06-2007 07:00 PM
install redhat 9 on a 1.2tb raid system david@aber Red Hat 0 07-16-2004 09:28 AM
ext3 filesystem support files over 4 gb in size? versaulis Linux - Software 4 06-25-2004 05:54 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 05:51 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration