LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 09-10-2010, 12:44 AM   #1
karnac01
LQ Newbie
 
Registered: Dec 2006
Location: Florida
Distribution: Ubuntu and CentOS
Posts: 23

Rep: Reputation: Disabled
Massive File Server with multiple servers


Hello all.

I have many home movies that I converted from VHS tapes to AVI files. I have it setup where I can watch it on my TV, but my hard drive is getting full because of size and quantity of AVI files.

What I would like to do is make a file server to house all of these movies, but I have a couple of P4 2.0GHZ processor and couple 160GB Hard Drives.

I would like to know if I can combine multiple computers and create a cluster or private cloud, combine the hard drive and processor power and set it up that way...in a sense a massive powerful file server. I am thinking of expanding this to include my word documents and pictures as well.

Any suggestions, ideas, or reccomendations would greatly be appreciated. Thanks all.
 
Old 09-10-2010, 02:44 AM   #2
Guttorm
Senior Member
 
Registered: Dec 2003
Location: Trondheim, Norway
Distribution: Debian and Ubuntu
Posts: 1,453

Rep: Reputation: 447Reputation: 447Reputation: 447Reputation: 447Reputation: 447
I don't think it's such a good idea. Having many small file servers use a lot of electricity and the chances of failure increases with the number of servers. Terrabyte disks have become quite cheap, so why not sell them and buy some big disks instead? Then set up one server with lots of disks and Raid.
 
Old 09-10-2010, 02:46 AM   #3
karnac01
LQ Newbie
 
Registered: Dec 2006
Location: Florida
Distribution: Ubuntu and CentOS
Posts: 23

Original Poster
Rep: Reputation: Disabled
OK. I might do that. Would you reccomend Raid 1(mirror) or RAID 5 (parity)?
 
Old 09-10-2010, 02:51 AM   #4
Guttorm
Senior Member
 
Registered: Dec 2003
Location: Trondheim, Norway
Distribution: Debian and Ubuntu
Posts: 1,453

Rep: Reputation: 447Reputation: 447Reputation: 447Reputation: 447Reputation: 447
Depends on the number of disks you have. If you have many disks, you lose a lot of space with Raid 1. But Raid 1 is simpler and harder to mess up. Raid 5 can be a bit slow unless you have many disks.
 
Old 09-10-2010, 02:58 AM   #5
EricTRA
LQ Guru
 
Registered: May 2009
Location: Gibraltar, Gibraltar
Distribution: Fedora 20 with Awesome WM
Posts: 6,805
Blog Entries: 1

Rep: Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297
Hello,

Of course the technology exists and is widely used. Have a look at Hadoop. However, I don't think it would be applicable to your environment since it'll take you some time and headaches to get it up and running. Just like Guttorm said, you'r better of with an array of some disks and set up one fileserver.

The choice of RAID depends on what you want, mirroring limits your space but gives you an exact copy, instantly usable in case of failure. RAID 5 is a good option in your case. Rebuilding in case of failure might take some time, depending on the disk size and if two disks fail then your data is lost.

Kind regards,

Eric
 
Old 09-10-2010, 03:01 AM   #6
xeleema
Member
 
Registered: Aug 2005
Location: D.i.t.h.o, Texas
Distribution: Slackware 13.x, rhel3/5, Solaris 8-10(sparc), HP-UX 11.x (pa-risc)
Posts: 988
Blog Entries: 4

Rep: Reputation: 254Reputation: 254Reputation: 254
If you plan on keeping this fileserver for a long, long, time, I would recommend the following;

1) Two Dual-port SATA controllers.
2) Four Hard Drives of the same model and size.

For starters, *don't* use RAID5, use RAID 10.

Physically, here's what you want;

Code:
[Drive_0]----+
             +[SATA_Controller_0]
[Drive_1]----+

[Drive_2]----+
             +[SATA_Controller_1]
[Drive_3]----+
You'll create a software-based mirror (RAID1) between Drive_0 and Drive_2 (Example name: md10).
Another RAID1 between Drive_1 and Drive_3 (Example name: md11).


Then you'll "stripe" (RAID0) the two "mirrors", creating a RAID1+0 (aka RAID10).
So logically, you'll have this;

Code:
                   +---Drive_0 @ SATA_Controller_0
          +--md10--+   (RAID1)
          |        +---Drive_2 @ SATA_Controller_1
     md0--+(RAID0)
          |        +---Drive_0 @ SATA_Controller_0
          +--md11--+   (RAID1)
                   +---Drive_2 @ SATA_Controller_1
Now, as for filesystems, you may (at some point) realize you don't need "one big filesystem". So I would suggest setting up "md0" as a volume group in LVM2. From there you can create any size of logical volumes you want.

Note that my example above doesn't cover the Operating System.
You might want a separate pair of disks in a RAID1 for that (using the OnBoard SATA controller).

I can speak to this method being both fast and durable, as you can survive two drive failures (one on each controller), and one controller failure.

I spent about $100 USD per hard drive, and about $80 per SATA controller (at that price, I bought an extra hard drive and an extra SATA controller so I'd be prepared for a failure).


EDIT: Word to the wise, make sure you use UUID numbers to identify the drives in your mdadm.conf file. If you ever start changing the order of the drives, that will save your bacon.

Last edited by xeleema; 09-10-2010 at 03:06 AM.
 
Old 09-10-2010, 03:30 AM   #7
karnac01
LQ Newbie
 
Registered: Dec 2006
Location: Florida
Distribution: Ubuntu and CentOS
Posts: 23

Original Poster
Rep: Reputation: Disabled
I want to thank all of you for great advice and reccomendations. It is great that there is a forum that an IT guy can share thoughts and knowledge and not be criticzed or insulted because of his lack of knoweldge in certain areas, and no matter how dumb the question is, it is all in gaining knowledge. OK enough of my babbling.

What I will probably do is get two 2TB drives (SATA 3.0Gb/s 7200RPM for $130 at newegg.com) and do RAID 1 ($20 SATA Raid 0/1 Card). This way if I lose one HDD the other still works.

A RAID 5 sounds like a better choice but EricTRA brought a good point that if 2 hard drives die then I lost everything. But then looking at this view, hard drives seldomly fail but they do. I do plan on keeping this setup for quite a while. BUT, if I do decide on RAID 5, I may install a Tape Backup Drive (LTO 2 or 3) and back it up that way. Since the only thing that changes are new files.

Of course, I will most likely use CentOS and Gigabit Internet card.

Thoughts and opinions about the following setup.
 
Old 09-10-2010, 04:12 AM   #8
xeleema
Member
 
Registered: Aug 2005
Location: D.i.t.h.o, Texas
Distribution: Slackware 13.x, rhel3/5, Solaris 8-10(sparc), HP-UX 11.x (pa-risc)
Posts: 988
Blog Entries: 4

Rep: Reputation: 254Reputation: 254Reputation: 254
Thanks!
As for your proposed setup (emphasis added);
Quote:
Originally Posted by karnac01 View Post
What I will probably do is get two 2TB drives (SATA 3.0Gb/s 7200RPM for $130 at newegg.com) and do RAID 1 ($20 SATA Raid 0/1 Card). This way if I lose one HDD the other still works.
I would advise against trusting your data to a single $20 RAID controller. That's going to be your "single point of failure". There's no guarantee that you're going to be able to recover the RAID if you have to replace that RAID card with different one a few years down the road (even if you buy two of those cards, it's still a gamble).

Hence my previous suggestion of RAID10 + 2 Controller cards. I built that setup about 4 years ago, and it's survived two (separate) drive failures. I even had a controller get flaky on me. Replacing it required downing the whole system, but I didn't have to break out any black candles and do a recovery on the RAID.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
How do I setup multiple FTP servers with distinct data sets with 1 master FTP server? tekky Linux - Networking 1 08-28-2009 05:00 AM
Postfix transport file multiple servers for domain? tuxtutorials Linux - Server 0 07-16-2009 01:17 PM
Multiple Blade servers booting from multiple disk drives simultaneously NGC_cheryl Linux - Enterprise 0 11-26-2007 08:38 AM
multiple mysql servers on 1 server stoffell Debian 1 03-01-2005 07:28 AM
Setting up multiple mail servers on one server tumana Linux - Newbie 5 03-12-2004 07:38 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 07:32 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration