LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Go Back   LinuxQuestions.org > Forums > Enterprise Linux Forums > Linux - Enterprise
User Name
Password
Linux - Enterprise This forum is for all items relating to using Linux in the Enterprise.

Notices


Reply
  Search this Thread
Old 01-31-2014, 09:51 PM   #1
zaoka
Member
 
Registered: Jan 2005
Distribution: I learn Ubuntu :)
Posts: 64

Rep: Reputation: 15
Need help building file server with large capacity


Please answer each question

- I need 20TB file server that will be running Samba. This company have about 30 workstations that will be using it.

- My question is what CPU and how much memory should be enough for this?

- If I use 5x 4TB hard drives what RAID system should I use so that Linux sees 20TB space?

- Is it better to do it this way or to mount and share each drive separately?
 
Old 02-01-2014, 07:17 PM   #2
Emerson
LQ Guru
 
Registered: Nov 2004
Location: Saint Amant, Acadiana
Distribution: Gentoo ~arch
Posts: 6,311

Rep: Reputation: Disabled
Any CPU will do, 30 users is not much.
Any amount of RAM will do, although more RAM will give you more cache.
To sum it up, an Atom with 1 GB of RAM will do the job.
As for 20 TB volume I'd use Btrfs. Although ZFS is an option, too (may need more RAM for that). In conservative side is mdraid.
You will not get redundancy with five 4 TB drives for 20 TB volume, so make sure there is a reliable backup solution.
 
1 members found this post helpful.
Old 02-02-2014, 05:31 AM   #3
voleg
Member
 
Registered: Oct 2013
Distribution: RedHat CentOS Fedora SuSE
Posts: 328

Rep: Reputation: 50
Had a problems with btrfs + samba.
My vote is for ZFS. It will replace mdraid layer also. And it will help you with backup too.
 
Old 02-28-2014, 12:15 PM   #4
byau
Member
 
Registered: Sep 2009
Location: Los Angeles, CA
Posts: 33

Rep: Reputation: 5
Agreed with Emerson re: CPU/RAM


" - If I use 5x 4TB hard drives what RAID system should I use so that Linux sees 20TB space?"

You would be using RAID 0 (stripe) to see 20 TB of space. Which also means no redundancy.

If you want the best redundancy you would want a RAID 6 which gives you 3 drives usable space (12 TB).

You really don't need anything special on the technical side since you really don't have many users, just a lot of space. Once you present your storage to your system, I would partition them down to smaller filesystems (500g to 1tb) for better manageability

I've still always liked ext3
 
Old 02-28-2014, 04:10 PM   #5
John VV
LQ Muse
 
Registered: Aug 2005
Location: A2 area Mi.
Posts: 17,388

Rep: Reputation: 2573Reputation: 2573Reputation: 2573Reputation: 2573Reputation: 2573Reputation: 2573Reputation: 2573Reputation: 2573Reputation: 2573Reputation: 2573Reputation: 2573
from what i have read ZFS will NEED a lot of ram

something like 8 gig for a 4 TB drive install
so for a 20 TB server ... a lot of ram
 
Old 03-01-2014, 01:28 PM   #6
gotfw
Member
 
Registered: Jan 2007
Posts: 416

Rep: Reputation: 70
Go with zfs. btrfs is not yet ready for prime time. Conversely, zfs is well tested and seen large enterprise use for some years now. ZFS will USE a lot of ram, if you have it, to increase efficiency. A few hundred dollars worth of extra ram is nothing for a company with 30 employees. If you're worried about maxing performance, budget a couple extra ssd's for zil and cache. Here's some benchmarks for various configs:

https://docs.google.com/a/apps.every...rive_web#gid=1

Peace
 
Old 03-01-2014, 02:19 PM   #7
gotfw
Member
 
Registered: Jan 2007
Posts: 416

Rep: Reputation: 70
You may also want to consider an Illumos base distribution for this project such as OmniOS or Nexenta Community Edition:

http://omnios.omniti.com/


http://nexenta.org/corp/downloads/do...munity-edition

I'd lean towards OmniOS.

Peace

P.S.; But perhaps best option may well be FreeNAS

http://www.freenas.org/

Last edited by gotfw; 03-01-2014 at 03:56 PM.
 
Old 03-08-2014, 07:59 PM   #8
chrism01
LQ Guru
 
Registered: Aug 2004
Location: Sydney
Distribution: Centos 6.10, Centos 7.3
Posts: 17,548

Rep: Reputation: 2423Reputation: 2423Reputation: 2423Reputation: 2423Reputation: 2423Reputation: 2423Reputation: 2423Reputation: 2423Reputation: 2423Reputation: 2423Reputation: 2423
All of the above advice ie any kind of meaningful RAID means losing usable disk space & (also) have a look at zfs.
NB: repeat after me 'RAID is NOT a backup ...'
(as above, RAID0 is just striping; one dead disk = ALL data lost)

@byau: ext3 was good, but we're all on ext4 now

Generally more RAM is better, but if its mostly just a file server and most processing etc is done on the wkstns, then the server won't need as much grunt/RAM ....

HTH

PS:
https://en.wikipedia.org/wiki/Standard_RAID_levels
https://en.wikipedia.org/wiki/RAID
http://zfsonlinux.org/
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Building a single high performancee NAS / NFS server with large capacity ikmalf Linux - Server 3 07-18-2012 05:34 AM
Building my first home server - atom based router/file server build need advice mothergoose729 Linux - Networking 5 03-23-2010 03:19 AM
Large Capacity HOWTO, errors with setmax: HDIO_DRIVE_CMD_AED failed newtovanilla Linux - Newbie 4 05-18-2008 06:28 PM
Slack for a large file server and domain controller ?? mike160 Slackware 8 06-14-2006 06:03 PM
My X server took a large file dump. FC2 ight8 Linux - Software 5 05-28-2004 09:32 PM

LinuxQuestions.org > Forums > Enterprise Linux Forums > Linux - Enterprise

All times are GMT -5. The time now is 11:02 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration