LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 09-28-2005, 08:56 AM   #1
edman007
Member
 
Registered: Sep 2003
Distribution: slackware-current
Posts: 173

Rep: Reputation: 30
clusters


i'm going to be setting up a cluster at school and was wondering if anyone here has done this. as of now we have 12 10/100 network cards (i know, 100 is slow for this, but i did not pick them out) and 6 computers (p3 i think)

so who has done this? any tips? what is the best distro for clustering? and what programs do i need?

i was hoping to end up with a system that looks from a programs point of view as a computer with just 6 CPUs, is that possible or do i have to use special programs to distribute the load to the other programs and/or compile the program special for the cluster?
 
Old 09-28-2005, 09:10 AM   #2
MoveZig
LQ Newbie
 
Registered: May 2004
Distribution: Fedora Core 3 and 4
Posts: 7

Rep: Reputation: 0
I'm also interested in the replies. I found this thread that might help: http://www.linuxquestions.org/questi...04/02/1/141140
 
Old 09-28-2005, 01:19 PM   #3
Warder
LQ Newbie
 
Registered: Sep 2005
Distribution: Slackware / Slamd64
Posts: 12

Rep: Reputation: 0
I'm actually about to start a cluster at my school aswell with 8 dual PII Celeron 550s (don't ask why Intel decided to dual Celerons).

I havn't started yet, but am debating whether or not to use ClusterKnoppix. Anybody else use this? Good? Bad? Ugly?
 
Old 09-28-2005, 03:36 PM   #4
abcdefg
Member
 
Registered: Aug 2003
Posts: 30

Rep: Reputation: 15
What are you going to be doing with the cluster?

Remember, you are limited to 100Mbps throughput on the system. That is a huge bottleneck, so dont count on anything being like a computer with six CPU's.

Having them work back and forth as one main computer, would be a waste.

But having them all work together on one very large chunk of data, something like tens of gigabytes of video to encode would be easy.

The memory bus between my computers cpu and the ram is around 51000Mbps (DDR400). 100Mbps ethernet shared between 5 or 6 or 20 computers is a very small thing to be working with.

It really doesnt matter if you have 10Gbps ethernet, the computers really wont work well in a cluster on small bits of data. Ethernet is always going to be a bottleneck.

There is something out for apache, which seems fairly simple.

One master controller computer is hooked to the internet/network source, it acceps all the incoming connections, looks at the clustered apache comptuers, figures out which IP's go where to balance out the load, and thats about it.
 
Old 09-28-2005, 08:52 PM   #5
edman007
Member
 
Registered: Sep 2003
Distribution: slackware-current
Posts: 173

Original Poster
Rep: Reputation: 30
as i see it now, its more so that we can say we have a cluster and that we made it, as i don't see any use for it either, so far we have decided that since the people who purchased the NICs thought that 12 100Mbps cards as one input and one output card per comp (what what were they thinking) would be best, but we have since decided that a master with 5 cards and 5 clients each with a card would be the best, that gives us 500Mbps each way from the master (100Mbps per comp), still slow, but not as bad


looking at the ClusterKnoppix link provided they mention blender3d, i may just end up benchmarking that.....and that distro does look good, i'm going to give it a test run
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Linux Clusters the_crony Linux - Networking 2 01-10-2006 08:55 AM
Benchmarking programs for clusters bassmadrigal Linux - Software 2 06-26-2005 12:41 AM
HDD with bad clusters... mufy Linux - Hardware 1 03-14-2005 04:50 AM
what live cd for clusters? Maver Linux - Distributions 2 04-30-2004 05:13 PM
beowulf clusters fatpig Linux - Networking 3 01-02-2002 04:52 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 09:24 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration