LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions
User Name
Password
Linux - Distributions This forum is for Distribution specific questions.
Red Hat, Slackware, Debian, Novell, LFS, Mandriva, Ubuntu, Fedora - the list goes on and on... Note: An (*) indicates there is no official participation from that distribution here at LQ.

Notices


Reply
  Search this Thread
Old 11-21-2005, 04:59 PM   #1
BrokenBrick
LQ Newbie
 
Registered: Feb 2005
Posts: 3

Rep: Reputation: 0
Help choosing a distro


Here is the gist of what I am looking for. I would like to build a high performance cluster so that I can do two things:

A. View the disks on my cluster as one large network disk (shared filesystem)
B. Parallell certain programs, most likely AutoGK so that I could run encodes much faster (hopefully)

I have found some distros that address either of these two things individually, but none that incorporate both simultaneously. I thought of using ClackConnect to build a fileserver cluster in some way, but this does not address computing/memory power. I also looked into OpenMossix, but it is not designed for building high performace clusters for parallel applications, but high availability clusters for multiple applications. Basically, I want what would sort of be a NAS sollution, while at the same time a sollution for parallel computing. I planned on buying 4-6 identical Dell Optiplex desktops from RetroBox (~700 Mhz/256 Mb RAM) and tossing a 300 gig drive in each. This would give me 1.2-1.8 TiB of storage, 2.8-4.2 ghz CPU, and 1-1.5 gigs of RAM. It would also give me something to do in my spare time, and something new to learn about Any suggestions for a sollution that might satisfy these needs, or a reason why I should not play with such power for pure recreation are much appreciated

Last edited by BrokenBrick; 11-21-2005 at 05:01 PM.
 
Old 11-21-2005, 09:05 PM   #2
uberNUT69
Member
 
Registered: Jan 2005
Location: Tasmania
Distribution: Xen Debian Lenny/Sid
Posts: 578

Rep: Reputation: 30
I very much doubt that you will find a solution that involves:
1) downloading a nice cd
2) pressing a button and
3) all your requirements are fulfilled.

However:
A:
You should be able to make a network raid with gnbd devices:
http://sources.redhat.com/cluster/gnbd/

B:
I very much doubt that you'll get a MSWin computer to be a master
in any sort of Linux-based cluster, but the closest thing to the
'prepackaged distro' you seem to be looking for would be ClusterKnoppix:
http://www.knoppix.net/wiki/Cluster_Live_CD
 
Old 12-07-2005, 04:45 PM   #3
BrokenBrick
LQ Newbie
 
Registered: Feb 2005
Posts: 3

Original Poster
Rep: Reputation: 0
I've been looking at LFS lately. The only problem is I am not sure if I can use it to build a distro exactly fitting these requirements. I thought it would be cool if the distro could boot from a live CD or a small partition, automatically mount already existing linux partitions (Have not decided whether NFS or LVM would be best), and detect free space and automatically add it to the existing share (in the case of a new drive/new system altogether) All it really needs to do besides this is to add them to a default samba share, or one specified in the setup where all new free space should be allocated. The hard part would be getting all the machines to relay and appear as one large network drive. This sort of distro would, I hope, provide something that I have found to be lacking in the market today, and that is the ability to add large volumes of networks storage at relatively low costs. Rather than buying raid arrays, SCSI disks, or NAS devices, one could simply build their own which would have great expandability and easy maintenence. If this type of cluster could also be used as an HPC for cPU intensive processes then that would be great, but I am not sure that this is possible. Any more info on this subject would be greatly appreciated, and if anyone is interested in helping me to build such a distro then please reply with your comments.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Choosing a Distro raspera Linux - Newbie 5 08-02-2005 05:16 PM
choosing a Distro SabaumLinux Linux - Distributions 8 02-13-2005 03:05 PM
Choosing Distro synonymy Linux - Newbie 6 10-31-2004 07:54 PM
Help choosing a distro. American Psycho Linux - Distributions 7 04-14-2004 12:46 AM
Help with choosing a Distro! Oricon Linux - General 18 12-22-2002 11:19 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions

All times are GMT -5. The time now is 05:09 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration