LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 01-14-2010, 12:40 PM   #1
Myiagros
Member
 
Registered: Mar 2009
Distribution: Ubuntu, CentOS 5.3
Posts: 75

Rep: Reputation: 18
Sun Grid Engine Confusion


I'm attempting to set up SGE 6.1 to do load sharing on my network. I am becoming quite confused though with the installation and configuration.

I've installed the Master and Exception host on the main server and all services are started. I'm attempting to install a second Exception server now which is causing some of the confusion.

Quote:
Before installing an execution host, you first need to have installed the master server as described in How to Install the Master Host.
Do I do this even on the computers that aren't masters? I'll be setting up Grid on up to 10 computers, does this mean I have to go through the installation process 20 times(1 install of master and execution per computer)?

Classic or Berkeley Spooling? By the looks of it Berkeley is the way to go as it is faster than Classic. This will require me to install more software, correct?

If there is a full, non-terribly written guide somewhere I would love to see one. I've been using the ones from Sun but they don't go into detail on most things that could use it.
 
Old 01-18-2010, 10:03 AM   #2
zordrak
Member
 
Registered: Feb 2008
Distribution: Slackware
Posts: 595

Rep: Reputation: 116Reputation: 116
Quote:
Originally Posted by Myiagros View Post
I'm attempting to set up SGE 6.1 to do load sharing on my network. I am becoming quite confused though with the installation and configuration.

I've installed the Master and Exception host on the main server and all services are started. I'm attempting to install a second Exception server now which is causing some of the confusion.
Be clear they are "Execution" hosts not "Exception" hosts.

Quote:
Originally Posted by Myiagros View Post
Do I do this even on the computers that aren't masters? I'll be setting up Grid on up to 10 computers, does this mean I have to go through the installation process 20 times(1 install of master and execution per computer)?
No. There must be one master. From that master you can then install the execution hosts.

What you need to understand is that the installation directory (e.g. /opt/sge) should be accessible from ALL hosts. Each host does not have a separate installation, there is a shared installation across them all. This allows all hosts to have the same information about the current state of the system.

For example, you should share /opt/sge via NFS and mount it on all execution hosts as /opt/sge. Then using the installer on the Master server, perform the execution host installation on all hosts.

Quote:
Originally Posted by Myiagros View Post
Classic or Berkeley Spooling? By the looks of it Berkeley is the way to go as it is faster than Classic. This will require me to install more software, correct?
There is a lot of documentation available as to which to use and I cannot comment without knowing a lot more about the setup.

Start with classic.

Quote:
Originally Posted by Myiagros View Post
If there is a full, non-terribly written guide somewhere I would love to see one. I've been using the ones from Sun but they don't go into detail on most things that could use it.
The Sun documentation is sufficient.
http://docs.sun.com/app/docs/coll/1017.3

There are many many guides on the Internet detailing what individuals have done, mainly blog posts, that will also help. Google is your friend.
 
Old 01-19-2010, 01:54 PM   #3
Myiagros
Member
 
Registered: Mar 2009
Distribution: Ubuntu, CentOS 5.3
Posts: 75

Original Poster
Rep: Reputation: 18
I managed to get it running correctly. The first guides I used had no mention about having to share the installation directory. Another thing I had to do in order to set up the execution hosts at the same time as the master was to set up password-less SSH access, otherwise all other hosts would show as "Resolvable".

Another Q:

I want to limit the number of jobs for each execution host in the cluster. I see a spot to limit jobs per user/group but nothing for host. Is there a way to do this or does it have to be done through resource management only(free mem, cpu, etc)?

My cluster consists of 5 computers and some of the regressions that get compiled use up to 6GB of memory but I have been asked to have it set up so that only one job can be run on each execution host at a time instead of doing it the simple way with the free memory variable.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] Sun Grid Engine on linux me_spearhead Linux - General 5 03-12-2010 07:11 AM
Does anybody knows SUN GRID ENGINE?? meng_en Linux - General 4 02-24-2010 11:03 PM
How does Sun Grid Engine 6.2u3 kick off jobs? gumbyjnm Linux - General 5 10-26-2009 10:09 PM
SGE (Sun Grid Engine) advice please johnsfine Linux - Networking 0 05-06-2009 02:55 PM
Installation Of Sun Grid Engine parani86 Linux - Software 7 08-06-2008 07:56 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 06:54 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration