LinuxQuestions.org
Latest LQ Deal: Latest LQ Deals
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware
User Name
Password
Linux - Hardware This forum is for Hardware issues.
Having trouble installing a piece of hardware? Want to know if that peripheral is compatible with Linux?

Notices


Reply
  Search this Thread
Old 09-22-2009, 01:27 PM   #1
sohel2009
LQ Newbie
 
Registered: Sep 2009
Posts: 1

Rep: Reputation: 0
Post Linux cluster for heavy compilation tasks


Hi everyone, my first post here.

I have to choose a linux-friendly motherboard supporting an intel Q9650 (quad-core 3GHz, 1333MHZ FSB) and 2/4Gb of DDR3 1333Mhz RAM in dual channel mode.

The mobo should have:
- one Gbit LAN port
- the possibility to boot linux from a USB2.0 key
- a very-cheap on-board VGA
- a very basic disk controller (no raid).

I think we might use a very light linux distribution or maybe Debian.

The system will be diskless (or maybe with a very small SSD) because its only purpose will be to perform very heavy code-compilation tasks, and to send the results via FTP.

By the way, I have to build four of these systems in order to create a 16-cores cluster, so any help in finding a cheap but reliable mobo would be very appreciated.

Thanks in advance.
 
Old 10-01-2009, 10:53 AM   #2
andrew_nh
LQ Newbie
 
Registered: Nov 2008
Posts: 8

Rep: Reputation: 0
If you are building a serious build machine I would get an i7 processor. The large cache and faster memory access should be much faster then a quad core of the same MHz speed. I'm am building a machine now with a ASUS P6T SE motherboard. The Asus board plus a 2.66 processor is under $500.
 
Old 10-01-2009, 12:02 PM   #3
johnsfine
LQ Guru
 
Registered: Dec 2007
Distribution: Centos
Posts: 5,286

Rep: Reputation: 1197Reputation: 1197Reputation: 1197Reputation: 1197Reputation: 1197Reputation: 1197Reputation: 1197Reputation: 1197Reputation: 1197
Quote:
Originally Posted by sohel2009 View Post
2/4Gb of DDR3
By "2/4" you mean "2 or 4"?

Probably your compile tasks are much less demanding than ours. We (where I work) do a lot of compiles on several Linux systems and those with less than 2GB of ram per core are frequently limited by that, sometimes to the point that it isn't even effective to try to use all the cores.

Every day the code we build gets even bigger as multiple programmers add features.

Quote:
The system will be diskless
Why? Are you really trimming the cost that aggressively? Disk drives are very low cost.

A few GB of swap space is very helpful in a compile server in case the most demanding compiles all happen it once. That's a lot better than exhausting ram and failing.

Quote:
and to send the results via FTP.
Odd choice. We store the results by SMB or NFS. So how do you get the source code (which we also get by SMB or NFS)? If that also by FTP? FTP seems even less convenient for getting the source code that for pstoring the binaries. Where do you store the source code during the compile?

Quote:
By the way, I have to build four of these systems in order to create a 16-cores cluster
BTW, how will you distribute the work between those systems? I haven't yet dealt with that. We have the super crude approach of manually selecting one when starting a build job.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: Measuring Heavy CPU Usage Over Time On Linux And Unix LXer Syndicated Linux News 0 03-31-2009 07:00 AM
LXer: OSDL Mobile Linux Initiative Gains Another Heavy Hitter LXer Syndicated Linux News 0 11-29-2006 03:54 AM
LXer: Penguin Computing's Scyld ClusterWare(TM) HPC Offers Enhanced High Availability and Most Advanced Linux Cluster Virtualization, Enabling Broader Cluster Use LXer Syndicated Linux News 0 04-06-2006 06:03 PM
linux tasks lennysokol Linux - Software 1 04-28-2005 12:47 AM
is JFS the best linux filesystem for playing heavy games? Necronomicom Linux - Games 3 08-18-2004 02:05 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware

All times are GMT -5. The time now is 08:03 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration