LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 12-03-2002, 11:03 AM   #1
rauenzahn
LQ Newbie
 
Registered: Dec 2002
Posts: 1

Rep: Reputation: 0
clustering with SMPs


i had posted this on google and gotten no replies, so i thought i would try here. i am looking for some advice.

we have three 8-way SMPs that we are going to hook together to form a 24-processor cluster. right now, we envision that the head node (a separate, one-processor pentium) will talk to a RAID-5 system through its SCSI interface, and the 8-way's will be backend crunch boxes that can only speak to the RAID through networking.

can someone point me in the right direction as far as what the best way to load the OS is? do i need it on all 4 boxes, or can i effectively run the three backends diskless, with local swap on each of them. if i do run the OS on all four boxes, what is the best way to keep them all up to date and synchronized? is redhat advanced server a way to go here? if someone could point me to a link, it would be great.

i appreciate the help. i hope that this is the right forum.

R
 
Old 12-30-2002, 03:31 AM   #2
kmoallem
LQ Newbie
 
Registered: Dec 2002
Location: Toronto, Canada
Distribution: mostly redhat
Posts: 10

Rep: Reputation: 0
Hi,

This is interesting because I’m planning on building a cluster too. At first I was inclined to make a disk-less cluster much like your setup. But, after some surfing around, I ran across an email (internal IBM actually) where the sender's advice was to stay away form disk-less clusters. His argument was that disk-less clusters put too much unnecessary strain on the network and that even under moderate loads an nfs would occasionally fail!

Personally, I don’t have any experience with nfs to form my own opinion but it does seem to make sense. I would also imagine that you would need a lot of memory in a disk-less setup… the last thing you want to see is swapping over the network.

Any way, since the cluster is purely for educational purposes… I‘ve decided to take a route somewhere in the middle, the nodes will have a very small disk (a compact flash card actually) to boot into a very light but working system, then anything else would be mounted over the network.

If you decide to take a similar rout as me, take a look at “white dwarf linux” (www.whitedwarflinux.org). It is a very light distribution made for embedded systems, it is based on slackware and has a modern kernel (2.4.18), after a bit of tweaking, I’ve got it installed with networking fully working at under 16 Mb (after “tinylogin”, before “busybox” … check them out!).

If you decide to take a fully disk-less approach, you will need to setup the tftp server on the head node (for the network boot) and have the nodes boot from a floppy disk or an EPROM (on the NIC). Take a look at PXELINUX and NILO (syslinux.zytor.com and www.nilo.org) they are network boot loaders. You can get the EPROM’s from D-Link or you can buy NICs that already have the EPROM built in … I don’t know this as a fact but I once read that the Intel NIC's have a download limit (for ethernet boot) that is less than your average linux kernel and thus useless.

Either way, take a look at:

www.tldp.org/HOWTO/Beowulf-HOWTO.html
www.tldp.org/HOWTO/Clone-HOWTO/index.html
www.tldp.org/HOWTO/Cluster-HOWTO.html
www.tldp.org/HOWTO/Diskless-HOWTO.html
www.tldp.org/HOWTO/Diskless-root-NFS-HOWTO.html


Well I hope this essay came in handy
Best of luck
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
clustering mimithebrain Linux - General 2 06-13-2005 09:02 AM
which os for clustering junctionking Linux - Distributions 4 05-25-2005 03:03 PM
Clustering anand_rhce Linux - Hardware 0 12-15-2004 06:01 AM
Clustering Stephanie General 5 01-29-2004 12:04 AM
New to clustering... sb73542 Linux - Networking 2 07-31-2003 11:05 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 08:57 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration