LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions
User Name
Password
Linux - Distributions This forum is for Distribution specific questions.
Red Hat, Slackware, Debian, Novell, LFS, Mandriva, Ubuntu, Fedora - the list goes on and on... Note: An (*) indicates there is no official participation from that distribution here at LQ.

Notices


Reply
  Search this Thread
Old 12-15-2016, 04:40 PM   #1
Nauntilus
Member
 
Registered: Oct 2005
Distribution: All of them
Posts: 137

Rep: Reputation: 17
Question Light Weight Linux Distro for High Performance Clusters


I've been searching around online trying to find a good lightweight linux distro that I can use to create a high performance cluster. I've considered using DSL but I haven't looked into it's capabilities in this arena. I was wondering if any of you have recommendations for something that would require minimal resources and allow for a clustered environment.

I don't even care if it has a GUI. Command line is fine with me.
 
Old 12-16-2016, 09:51 AM   #2
TenTenths
Senior Member
 
Registered: Aug 2011
Location: Dublin
Distribution: Centos 5 / 6 / 7
Posts: 2,356

Rep: Reputation: 841Reputation: 841Reputation: 841Reputation: 841Reputation: 841Reputation: 841Reputation: 841
Nobody can tell you because you don't tell us what you want to achieve.

"Clustering" is an extremely vague term:

High Availability Clustering
Load Balancing Clustering
Compute Clustering
Database Clustering for resilience (kinda ties in with both HA and LB)
Distributed Storage/Processing ( la hadoop)

The list goes on.....
 
Old 12-16-2016, 09:52 AM   #3
Nauntilus
Member
 
Registered: Oct 2005
Distribution: All of them
Posts: 137

Original Poster
Rep: Reputation: 17
Computation Cluster.
 
Old 12-16-2016, 09:52 AM   #4
TenTenths
Senior Member
 
Registered: Aug 2011
Location: Dublin
Distribution: Centos 5 / 6 / 7
Posts: 2,356

Rep: Reputation: 841Reputation: 841Reputation: 841Reputation: 841Reputation: 841Reputation: 841Reputation: 841
Oh, or even the current industry buzz-word "Cloud" using clusters of hardware and something like OpenStack.
 
Old 12-16-2016, 10:00 AM   #5
TenTenths
Senior Member
 
Registered: Aug 2011
Location: Dublin
Distribution: Centos 5 / 6 / 7
Posts: 2,356

Rep: Reputation: 841Reputation: 841Reputation: 841Reputation: 841Reputation: 841Reputation: 841Reputation: 841
Quote:
Originally Posted by Nauntilus View Post
Computation Cluster.
Ok, so your next step is check to see if the application you want to run supports clustering and if so, what the application recommends.

When it comes to compute clusters the choice of platform is very much driven by what the application will support.
 
Old 12-16-2016, 10:22 AM   #6
Nauntilus
Member
 
Registered: Oct 2005
Distribution: All of them
Posts: 137

Original Poster
Rep: Reputation: 17
I'm writing my own application to run on the cluster. So yes it will support clustering whichever setup I use. I just have to have a cluster setup first.
 
Old 12-16-2016, 10:23 AM   #7
Nauntilus
Member
 
Registered: Oct 2005
Distribution: All of them
Posts: 137

Original Poster
Rep: Reputation: 17
However I am specifically looking to maximize my usage of the available processor and memory, which is why I'm looking for a lightweight distro.
 
Old 12-16-2016, 08:15 PM   #8
jefro
Moderator
 
Registered: Mar 2008
Posts: 16,042

Rep: Reputation: 2332Reputation: 2332Reputation: 2332Reputation: 2332Reputation: 2332Reputation: 2332Reputation: 2332Reputation: 2332Reputation: 2332Reputation: 2332Reputation: 2332
I guess you could build your kernel and use busybox on it. More depends on what all you need on to support your cluster and the application.
 
Old 12-17-2016, 11:22 AM   #9
DavidMcCann
Senior Member
 
Registered: Jul 2006
Location: London
Distribution: CentOS, Salix
Posts: 4,346

Rep: Reputation: 1316Reputation: 1316Reputation: 1316Reputation: 1316Reputation: 1316Reputation: 1316Reputation: 1316Reputation: 1316Reputation: 1316Reputation: 1316
Using the Distrowatch search came up with two specialist distros

http://distrowatch.com/table.php?dis...n=rockscluster
http://distrowatch.com/table.php?dis...ion=pelicanhpc
 
Old 12-18-2016, 12:53 PM   #10
Nauntilus
Member
 
Registered: Oct 2005
Distribution: All of them
Posts: 137

Original Poster
Rep: Reputation: 17
Quote:
Originally Posted by DavidMcCann View Post
Thank you David. One of these seems like it will work.
 
Old 12-18-2016, 01:28 PM   #11
jamison20000e
Senior Member
 
Registered: Nov 2005
Location: ...uncanny valley... infinity\1975; (randomly born:) Milwaukee, WI, US, Earth, end border$! ◣◢┌∩┐ Fe26-E,e...
Distribution: any GPL that works well on my cheapest; has been KDE or CLI but open... http://goo.gl/NqgqJx &c ;-)
Posts: 3,382
Blog Entries: 2

Rep: Reputation: 987Reputation: 987Reputation: 987Reputation: 987Reputation: 987Reputation: 987Reputation: 987Reputation: 987
netinst is my opinion, so-many built on it... why not yours?
 
  


Reply

Tags
beowulf, cluster, damnsmalllinux, hpc


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: LINUX DASH (Widgets Based) - Light Weight System Performance Monitoring Tool for Linux LXer Syndicated Linux News 0 07-27-2016 09:24 AM
[SOLVED] Want to build my own debian based light weight linux distro mylinuxlogin Linux - Newbie 1 02-03-2012 07:15 PM
Wanted: Light-Weight Linux Distro with Server and Development Tools rm_-rf_windows Linux - General 4 04-03-2008 01:10 PM


All times are GMT -5. The time now is 01:31 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration