LinuxQuestions.org
Visit Jeremy's Blog.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 07-06-2007, 03:57 PM   #1
igorblackbelt
LQ Newbie
 
Registered: May 2007
Posts: 13

Rep: Reputation: 0
Linux Clustering


Folks,
Our company has 3 Suse Linux Servers and I've been thinking of throwing out there the idea of clustering all 3 servers together, because of all issues we've been having with running processes in separate servers. Does Novell offer a cluster solution for their Enterprise Servers? If not, is there anything out there that would allow me to do implementation?

Thoughts?
 
Old 07-07-2007, 03:36 PM   #2
GATTACA
Member
 
Registered: Feb 2002
Location: USA
Distribution: Fedora, CENTOS
Posts: 209

Rep: Reputation: 32
Before you throw it out there, have you considered what tasks you would use a cluster for? Do you run a lot of serial jobs that you can queue up? Do you run lots of parallel jobs that could use MPI?

Also, you say you have 3 servers. How many processors/cores are you talking about? Is this a case of 3 physical processors each with 4 cores? (thus your effective cluster size is 12 cpus) or are their more/less cpus? Generally speaking, the more cpus you have, the "better" a cluster. Mind you my last statement is a _very_ big generalization, a cluster is only as good as the use you can make of it.

I've used ROCKS cluster software at my work and I've been pretty happy with it.

HTH
 
Old 07-09-2007, 01:22 PM   #3
igorblackbelt
LQ Newbie
 
Registered: May 2007
Posts: 13

Original Poster
Rep: Reputation: 0
Gattaca,

Thanks for your reply, yes, as I said, we currently have 3 Linux server with 4 processors and about 4GB of memory each. These servers are used for ETL (Extract Transform and Load, Data) processes and since our data universe is growing constantly, these servers are becoming relatively small for these processes, I was thinking that if we cluster the 3 servers all together, we could make a better used of both, processors and space.

Yes, we do a lot of serial jobs, we never used any type of technology that would allow us to queue these jobs up, not even sure how to do that, even though I don't believe this would be a great idea, since we live in a very tight schedule. The real solution would buy another server, but we don't have money on the budget for that right now, so I thought that another solution would be clustering the servers.

I'm not sure what MPI is, please explain.

Correct, 4 CPUS/4 Cores.

So, should I "cluster"?
 
Old 07-09-2007, 03:25 PM   #4
GATTACA
Member
 
Registered: Feb 2002
Location: USA
Distribution: Fedora, CENTOS
Posts: 209

Rep: Reputation: 32
First some clarification: In total you have 12 processors? --> 3 computers with 4 processors each = 12 total processors right?

The whole point of a serial-job cluster is to distribute jobs sequentially to processors as they become available. In a perfect world, the user only has to submit one big job to the cluster and then gets an email when all of the work is done.

If you only run serial jobs but you don't think queuing up jobs to be done one after another is a good idea, then clustering is not for you.
 
Old 07-10-2007, 10:23 AM   #5
igorblackbelt
LQ Newbie
 
Registered: May 2007
Posts: 13

Original Poster
Rep: Reputation: 0
First some clarification: In total you have 12 processors? --> 3 computers with 4 processors each = 12 total processors right?

Correct.

The whole point of a serial-job cluster is to distribute jobs sequentially to processors as they become available. In a perfect world, the user only has to submit one big job to the cluster and then gets an email when all of the work is done.


I misunderstood then.
 
Old 07-10-2007, 10:33 AM   #6
GATTACA
Member
 
Registered: Feb 2002
Location: USA
Distribution: Fedora, CENTOS
Posts: 209

Rep: Reputation: 32
Quote:
Originally Posted by igorblackbelt
I misunderstood then.
What did you misunderstand? The purpose of a cluster? or what I wrote? I'm not the clearest writer so I just want to make sure I haven't put you off clustering just because I can't write.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Linux Clustering - How to scollura Linux - Networking 1 06-30-2007 12:58 AM
linux clustering Ammad Linux - Networking 3 02-23-2007 12:40 PM
best clustering s/w for linux FC vineet7kumar Linux - Software 0 08-06-2006 04:52 AM
Linux Clustering nev_neo Linux - Software 5 11-02-2004 04:34 PM
Clustering in Linux....? redshadow Programming 2 01-05-2004 05:49 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 04:08 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration