LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 02-19-2017, 05:50 AM   #1
circus78
Member
 
Registered: Dec 2011
Posts: 273

Rep: Reputation: Disabled
Large file server


Hi, I have a physical server with 15 sata HDD (750 GB each one).
I need to deploy a large file server (with Owncloud, Nextcloud, Seafile, or so).
I wondering what kind of raid software and/or file system could be better in my case.
Thank you
 
Old 02-19-2017, 06:09 AM   #2
Turbocapitalist
LQ Guru
 
Registered: Apr 2005
Distribution: Linux Mint, Devuan, OpenBSD
Posts: 7,332
Blog Entries: 3

Rep: Reputation: 3727Reputation: 3727Reputation: 3727Reputation: 3727Reputation: 3727Reputation: 3727Reputation: 3727Reputation: 3727Reputation: 3727Reputation: 3727Reputation: 3727
These days I would give consideration to ZFS. It's available on some distros. Though if you go that route, it might be better to base the server on FreeBSD or TrueOS (a FreeBSD distro)
 
Old 02-19-2017, 10:29 AM   #3
TB0ne
LQ Guru
 
Registered: Jul 2003
Location: Birmingham, Alabama
Distribution: SuSE, RedHat, Slack,CentOS
Posts: 26,689

Rep: Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972
Quote:
Originally Posted by circus78 View Post
Hi, I have a physical server with 15 sata HDD (750 GB each one).
I need to deploy a large file server (with Owncloud, Nextcloud, Seafile, or so).
I wondering what kind of raid software and/or file system could be better in my case.
Not really sure how to answer...too many variables you haven't told us to make an educated guess. We'd need to know:
  • What kind of hardware/controller(s) these drives are plugged in to
  • Do the controllers support hardware RAID, or are they 'fake RAID' controllers?
  • How many users may be accessing this concurrently?
  • How will they access it? For example, streaming live audio/video has different demands than a generic file server would, or that a database would require.
  • What is the underlying NEED that you're meeting? If it's just storage without having to worry about a failed hard drive, that will push things differently than if you want to give 500 people 24/7 access where they're all pounding on it on a LAN.
  • What kind of PC/system is going to drive this?
  • Budget?
For example, if you have controllers that are 'real' RAID, you could do 5 RAID5 aray's, each one with an online hot spare, then join those into an LVM of one 'big disk', with a good amount of failover and capacity to grow. But again...too many unknowns to really say.
 
Old 02-19-2017, 03:31 PM   #4
circus78
Member
 
Registered: Dec 2011
Posts: 273

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by TB0ne View Post
Not really sure how to answer...too many variables you haven't told us to make an educated guess. We'd need to know:
  • What kind of hardware/controller(s) these drives are plugged in to
  • Do the controllers support hardware RAID, or are they 'fake RAID' controllers?
  • How many users may be accessing this concurrently?
  • How will they access it? For example, streaming live audio/video has different demands than a generic file server would, or that a database would require.
  • What is the underlying NEED that you're meeting? If it's just storage without having to worry about a failed hard drive, that will push things differently than if you want to give 500 people 24/7 access where they're all pounding on it on a LAN.
  • What kind of PC/system is going to drive this?
  • Budget?
For example, if you have controllers that are 'real' RAID, you could do 5 RAID5 aray's, each one with an online hot spare, then join those into an LVM of one 'big disk', with a good amount of failover and capacity to grow. But again...too many unknowns to really say.
Hi TB0ne, at this moment I don't remeber the exact hardware/controller. I'll check tomorrow.
I don't know "how" people will access to this file server: I just know that the idea is to provide an easy "cloud" service (as I said, probably with Owncloud).
I think there will be max 100-200 people at time (I mean: on peak hours).
This serivce is meant for end customers, so I'd need a "reliable" solution.
Actually, the idea is to provide this without any further budget: I already have this hardware (with HDDs inside), anyway if it's worth it, I think I can afford about $1000.
Thank you
 
Old 02-19-2017, 03:52 PM   #5
TB0ne
LQ Guru
 
Registered: Jul 2003
Location: Birmingham, Alabama
Distribution: SuSE, RedHat, Slack,CentOS
Posts: 26,689

Rep: Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972Reputation: 7972
Quote:
Originally Posted by circus78 View Post
Hi TB0ne, at this moment I don't remeber the exact hardware/controller. I'll check tomorrow.
I don't know "how" people will access to this file server: I just know that the idea is to provide an easy "cloud" service (as I said, probably with Owncloud).
Fair enough, but the specs of the hardware may limit your speed, regardless of the file system. Also note, that if you set this up with RAID, you take a performance hit right there, albeit not one that's huge. If you're using Owncloud, that means they'll probably be accessing it via web interface, so your incoming WAN bandwidth will be a limiting factor, as will your web server and its configuration...
Quote:
I think there will be max 100-200 people at time (I mean: on peak hours).
This serivce is meant for end customers, so I'd need a "reliable" solution. Actually, the idea is to provide this without any further budget: I already have this hardware (with HDDs inside), anyway if it's worth it, I think I can afford about $1000.
..and for 100-200 concurrent users, with no idea of how large the files will be they're shoveling up/down and with what frequency, especially over an Internet connection...I don't think that the file system is going to make much difference in this scenario. MANY layers between the user(s) and the data at that point, each with a bottleneck you can't overcome with faster IO on a bus.

If you were running a large database, then going with a native Oracle filesystem with tables on their own spindles makes a HUGE difference...but this probably won't see any benefits of that. Go for failover/robustness over speed.
 
Old 02-19-2017, 07:46 PM   #6
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,140

Rep: Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123
ZFS and BSD might have a bit of a learning curve.
If you want something that "just works", have a look at LVM. Current version has support for RAID baked into LVM - no need to define dmadm RAID at all. Very flexible - it recognises pv's on separate devices, and will spread data and metadata appropriately. You can convert between RAID levels on the fly and it allows for failure policies so it can automatically rebuild if spares are present.
What more could you want ?.
I used to be a bit ambivalent re LVM, but this RAID support has convinced me it really is useful.

As for what RAID level, that is your decision - depends on what redundancy you need, and how much of that 10T you can afford to lose at setup.

Last edited by syg00; 02-19-2017 at 08:43 PM.
 
Old 02-20-2017, 02:57 PM   #7
jefro
Moderator
 
Registered: Mar 2008
Posts: 22,001

Rep: Reputation: 3629Reputation: 3629Reputation: 3629Reputation: 3629Reputation: 3629Reputation: 3629Reputation: 3629Reputation: 3629Reputation: 3629Reputation: 3629Reputation: 3629
I'll agree with most of the above, not enough metrics or data here to make a great reply.

I am making a huge assumption that this is a real server box.

Most true servers have dedicated hardware raid cards I'd think if this is a good enough system. Even older users servers have good hardware raid cards. I might be tempted to look at using it first over a software solution. I would not consider using any sort of FAKE raid cards.

ZFS, Btrfs and LVM are all common ways to manage JBOD's into either mass storage or raid configurations even if you have a hardware raid already. Some very advanced features in those filesystem/managers.

I'd also that that this server might have enterprise level nic and that could help lower cpu use.


No substitute for ram but making raid swap may assist.


There may be some advantages to running this or some processes in a VM also.

https://www.turnkeylinux.org/owncloud

Last edited by jefro; 02-20-2017 at 03:02 PM.
 
1 members found this post helpful.
Old 02-23-2017, 05:31 PM   #8
sundialsvcs
LQ Guru
 
Registered: Feb 2004
Location: SE Tennessee, USA
Distribution: Gentoo, LFS
Posts: 10,672
Blog Entries: 4

Rep: Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945Reputation: 3945
I simply don't have enough information, yet, upon which to base any sort of recommendation.

It is "uninteresting" that you will have 15 hard-drives attached. Is the data on these drives meant to be read/write, or is this some kind of passive store? What are the availability and reliability requirements? What, exactly, is this server supposed to be doing, and for whom? How will its intended users access it? What sort of things will they do?
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Server Locks Up When Extracting Large File 7Finger Linux - Server 2 12-04-2014 03:38 PM
Linux Server goes down when copying large *.Tar file adnanadezai81 Linux - Server 4 07-17-2014 05:44 AM
Need help building file server with large capacity zaoka Linux - Enterprise 7 03-08-2014 07:59 PM
Slack for a large file server and domain controller ?? mike160 Slackware 8 06-14-2006 06:03 PM
My X server took a large file dump. FC2 ight8 Linux - Software 5 05-28-2004 09:32 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 06:23 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration