LinuxQuestions.org
Latest LQ Deal: Latest LQ Deals
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 11-24-2011, 02:42 PM   #1
jhwilliams
Senior Member
 
Registered: Apr 2007
Location: Portland, OR
Distribution: Debian, Android, LFS
Posts: 1,168

Rep: Reputation: 211Reputation: 211Reputation: 211
Pointers/Tips for Two 40-core Build Servers


We're getting some seriously nice equipment, (2) of the following boxes:

4-way 10-core Xeons (so 4x10x2 = 80 threads per box)
128GB RAM
5 x 600GB SSD

The systems will be distributed, 1000 miles apart, principally to reduce latency at each site.

Primary use case is running GNU Make.

Question (1): What's the best configuration for this hardware and network topology, to accomplish lighting fast builds? Potential benefit from distcc, ccache, given non-collocation? Best to use independently, or over network?

(2) Again, given that the systems are geographically distributed, what would be a responsible data availability schema between the two (DRBD, NFS, plain ol' rsync cron jobs?)

(3) Is there any reason I shouldn't put the SSDs at each site into RAID5s?

(4) Is there any recent (~Linux 3.x) data on multicore scalability in the kernel at this range (40core)?

Any other general tips on build servers, targeted multicore speedup, cross-site data availability?

Thanks!
 
Old 11-25-2011, 08:45 AM   #2
rhbegin
Member
 
Registered: Oct 2003
Location: Arkansas, NWA
Distribution: Fedora/CentOS/SL6
Posts: 381

Rep: Reputation: 23
I would configure the raid as raid 10, you will lose some disk space but the I/O gains will be substantial.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: Tips To Protect Linux Servers Physical Console Access LXer Syndicated Linux News 0 03-19-2009 04:10 PM
LXer: Tips and Tricks for Linux Admins: Keep an Eye On Your Servers LXer Syndicated Linux News 0 02-27-2007 08:31 PM
Build a DAW - audiorecording computer - Tips ? freakrush Linux - Hardware 0 06-13-2006 05:16 AM
Tips for managing multiple linux servers benr77 Linux - General 3 09-14-2005 04:32 AM
Tips/Pointers for home network Texicle Slackware 1 01-24-2003 03:44 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 05:53 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration