Download your favorite Linux distribution at LQ ISO.
Go Back > Forums > Linux Forums > Linux - Virtualization and Cloud
User Name
Linux - Virtualization and Cloud This forum is for the discussion of all topics relating to Linux Virtualization and Linux Cloud platforms. Xen, KVM, OpenVZ, VirtualBox, VMware, Linux-VServer and all other Linux Virtualization platforms are welcome. OpenStack, CloudStack, ownCloud, Cloud Foundry, Eucalyptus, Nimbus, OpenNebula and all other Linux Cloud platforms are welcome. Note that questions relating solely to non-Linux OS's should be asked in the General forum.


  Search this Thread
Old 01-17-2012, 09:27 AM   #1
LQ Newbie
Registered: Sep 2010
Posts: 13

Rep: Reputation: 0
Issues Creating 16 TB Storage on CENTOS 6.2 with Ext4

Good Day,

I have searched your forums however I have been unable to find an answer close to what I am looking for. My hope is that I have posted it in the correct forum and that I have included enough information for the smart folks to help out.

We are attempting to build a Linux server on an ESX virtual machine with 16+ TB of storage that will be deployed as a Google Earth (GE) server. We are creating a raid 0 as the SAN is preconfigured with raid 6 (for redundancy) and for GE we must have contiguous space. We have been unable to concatenate the 8 x 2TB drives as raid0 and actually failed at 5 drives.

Our configurations are as follows:

- CENTOS 6.2 configured as desktop
- 2GB ram
- 1 CPU
- Disk 1: 100GB / OS drive
- Disk 2 -> 9: qty 8 x 2TB / to be created combined for raid 0

We have attempted a number of settings even going down a version of the OS and have had limited success but are unable to come close to our 16TB of storage. We have taken the defaults as follows

- Block Size = 4096
- Fragment Size = 4096
- Stride = 128 Blocks, Stripe width=640 blocks

We have had success with the following format:

- Format qty 1 x 2TB drives and format as ext4
- Format qty 3 x 2TB drives configured as raid 0 (total 6.4TB) formatted as ext4

We have attempted 5 x 2TB drives (11TB) and the format failed at approx 70% of the format. Errors in the logs are listed on each drive

Any assistance with this issue would be greatly appreciated

Old 01-17-2012, 10:02 AM   #2
Registered: Jan 2012
Location: Czech
Distribution: Fedora, RHEL, Ubuntu, Mint
Posts: 110

Rep: Reputation: 13
Did you try to use LVM?

The easy idea of using LVM is to make raid 1 (mirroring) if you require data redundancy. Then make LVM and add all raids. LVM is useful instead of raid/stripping.
Make a partition on the LVM.

md0 ... sda mirros sdb (2 TB of 2x2TB)
md1 ... sdc mirros sdc (2 TB of 2x2TB)
md2 ... sdd mirros sde (2 TB of 2x2TB)
md3 ... sdf mirros sdg (2 TB of 2x2TB)

LVM = md0 + md1 + md2 + md3 (8 TB)

LVM = sda + sdb + sdc + sdd + sde + sdf + sdg (16 TB) if you needn't redundant data, even thought there is a really high risk of data losing without any recovery possibilities.

I guess CentOS supports LVM.
Old 01-17-2012, 10:13 AM   #3
Registered: Jan 2012
Location: Czech
Distribution: Fedora, RHEL, Ubuntu, Mint
Posts: 110

Rep: Reputation: 13
Hi, few minutes after I sent the message I accidentally read that Fedora 17 is going to break the limitation of 16 TB filesystem size of ext4, exatly 2^32 fs blocks. Probably it should be the same case in CentOS and increasing the block size could help.

the source
Old 01-19-2012, 10:32 AM   #4
LQ Newbie
Registered: Sep 2010
Posts: 13

Original Poster
Rep: Reputation: 0

Thanks for the response your tip on LVM. The LVM application enabled us to add the 8 x 2TB drives and create our 16TB drive.



centos, ext4, format, san

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
Disk Quotas not giving warning in ext4 filesystem of CentOS 6.0 32 Bit vikas027 Linux - Server 2 01-01-2012 01:05 AM
LXer: Distributed Storage Across Four Storage Nodes With GlusterFS On CentOS 5.4 LXer Syndicated Linux News 0 04-01-2010 09:00 PM
LXer: Creating An NFS-Like Standalone Storage Server With GlusterFS On CentOS 5.4 LXer Syndicated Linux News 0 03-18-2010 02:40 PM
Compiling Kernel issues; ext4 is read as ext3? affinity Slackware 11 01-27-2010 02:36 PM
Where to begin creating a kernel module for a networked storage device dahweeds Linux - Newbie 1 05-15-2009 03:57 AM > Forums > Linux Forums > Linux - Virtualization and Cloud

All times are GMT -5. The time now is 08:34 PM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration