LinuxQuestions.org
Review your favorite Linux distribution.
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > General
User Name
Password
General This forum is for non-technical general discussion which can include both Linux and non-Linux topics. Have fun!

Notices


Reply
  Search this Thread
Old 09-16-2003, 08:45 PM   #1
BrianK
Senior Member
 
Registered: Mar 2002
Location: Los Angeles, CA
Distribution: Debian, Ubuntu
Posts: 1,334

Rep: Reputation: 51
Putting together high performance file server - suggestions?


I'm designing a render farm with 10 nodes (initially). Without getting into too much detail, I need a really good (read: fast file access) file server. I want it to have RAID 1 (mirror) and possibly RAID 0 (stripe) for speed - if it helps out tremendously. It also needs at least half a terabyte (500 GB) of storage space, and it will likely need gigabit ethernet. The speed of the processor is not nearly as important as the speed at which it can access and write files.

Anyone have any experience building a server like this? Am I better off just buying one from a big company like Dell or Compaq (I can't see how that would be possible, but I could be convinced) or is it just as good to piece one together myself?

My initial thought was a Gigabyte GA-8KNXP motherboard running four SATA 250 GB hard drives - two of them being RAID 0 and the other two on RAID 1 mirroring the first two. That motherboard also has gigabit ethernnet built in and can run dual channel ddr.

Any suggestions? Is SATA fast enough or should I go SCSI? Half a terabyte of SCSI sounds REALLY expensive - is it worth it? Feel free to be as specific as you'd like - even going into part numbers and such if it makes a difference. Suggestions on cooling and other stuff would also be helpful.

I've got all the nodes taken care of, but I've never built a file server before.
 
Old 09-17-2003, 12:43 AM   #2
Azmeen
Senior Member
 
Registered: May 2003
Location: Malaysia
Distribution: Slackware, LFS, CentOS
Posts: 1,307

Rep: Reputation: 46
Damn... if I lived near you, I would have volunteered to work with you for free. It would be interesting to actually get something like this up and running. Although I never had the priviledge to work on something similar to what you're doing, I'd say go to vendors only if you need the "end-user support"... however, since this is a Linux project, I doubt you'd find anything useful from Dell support... they do have a reputation for being really good friends with MS.

So I'd say go for a custom-made solution... isn't this what hackers love to do anyway?
 
Old 09-17-2003, 02:18 PM   #3
bulliver
Senior Member
 
Registered: Nov 2002
Location: Edmonton AB, Canada
Distribution: Gentoo x86_64; Gentoo PPC; FreeBSD; OS X 10.9.4
Posts: 3,760
Blog Entries: 4

Rep: Reputation: 78
There is a nice little article on building a terabyte file server from scratch at linux.ie:

http://www.linux.ie/articles/teraserver/

Might give you some help/ideas.
 
Old 09-17-2003, 04:06 PM   #4
BrianK
Senior Member
 
Registered: Mar 2002
Location: Los Angeles, CA
Distribution: Debian, Ubuntu
Posts: 1,334

Original Poster
Rep: Reputation: 51
bulliver: Great reference! Thanks!

Azmeen: I've cobbled together a very small farm out of user workstations before, this will be my first proper farm as well - I'm excited to do it.

I agree that putting them together myself is the way to go.

Anyone else - any more suggestions? Feel free to keep 'em coming.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Putting together my first Linux box, suggestions wanted Lazy Foo' Linux - Hardware 1 12-03-2005 01:41 AM
high-performance laptop memonvil Linux - Laptop and Netbook 7 03-02-2005 07:41 AM
Suggestions of distros for file server Corona4456 Linux - Distributions 5 08-02-2004 06:14 PM
Apache-linux gateway to NT file server NEED SUGGESTIONS josephswagner Linux - Software 5 04-25-2003 02:05 PM
processor speed vs. file server performance ScreeminChikin Linux - Hardware 6 09-20-2002 07:59 PM

LinuxQuestions.org > Forums > Non-*NIX Forums > General

All times are GMT -5. The time now is 08:47 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration