LinuxQuestions.org
LinuxAnswers - the LQ Linux tutorial section.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices

Reply
 
Search this Thread
Old 01-21-2013, 02:21 AM   #1
$u$hil_k$
LQ Newbie
 
Registered: Jan 2012
Posts: 23

Rep: Reputation: Disabled
Building a simple Beowulf Like Cluster with Ubuntu 12.04 using MPICH 2


Hello people, am trying to connect 2 systems as a Beowulf Like Cluster with Ubuntu 12.04 using MPICH . Right now i have already inatlled Ubuntu 12.04 in both the systems and i want one system as a master and another as a slave so kindly tell me steps to build a Beowulf Like Cluster with Ubuntu 12.04 using MPICH 2 making one as master and another as slave and also test an MPI program...

Please tell me if u know ASAP.

Thnak you in Advance

Last edited by $u$hil_k$; 01-21-2013 at 03:00 AM.
 
Old 01-22-2013, 12:48 AM   #2
btmiller
Senior Member
 
Registered: May 2004
Location: In the DC 'burbs
Distribution: Arch, Scientific Linux, Debian, Ubuntu
Posts: 4,108

Rep: Reputation: 311Reputation: 311Reputation: 311Reputation: 311
It's not hard, really. Generally, you need to connect both systems to the same network (usually wired Ethernet, but it can really be anything you like -- many clusters use InfiniBand for MPI traffic, but you certainly don't have to). Make sure that there are no firewalls blocking access between the two machines. Then install the MPICH2 packages on both machines and try to run a test program (the distribution comes with several). You will be using the mpdboot to set up communication and then mpirun or mpiexec to run the program (see http://www.dartmouth.edu/~rc/classes...mpich2_ex.html for some further explanation). The MPICH-2 development team provides excellent documentation, which I suggest you read.

Note that MPI has no concept of "master" and "slave" -- all ranks are created equal. Of course this does not stop one from writing an MPI program using a master/worker paradigm, in which one rank (usually 0) is the master and doles out work to the "workers", but this is a function of how the code divides up its workload and not anything inherent to MPI.

It's nice to have a shared filesystem accessible on both nodes (using NFS for starters, or if you need high IOPS something like Lustre and Ceph, but it sounds like you're just playing around so vanilla NFS will probably work just fine). If you want to designate one of your nodes the "master", you can put a big disk in it and export it via NFS to other other system. This saves you the bother of having to copy files to both systems.
 
Old 01-23-2013, 03:32 AM   #3
$u$hil_k$
LQ Newbie
 
Registered: Jan 2012
Posts: 23

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by btmiller View Post
It's not hard, really. Generally, you need to connect both systems to the same network (usually wired Ethernet, but it can really be anything you like -- many clusters use InfiniBand for MPI traffic, but you certainly don't have to). Make sure that there are no firewalls blocking access between the two machines. Then install the MPICH2 packages on both machines and try to run a test program (the distribution comes with several). You will be using the mpdboot to set up communication and then mpirun or mpiexec to run the program (see http://www.dartmouth.edu/~rc/classes...mpich2_ex.html for some further explanation). The MPICH-2 development team provides excellent documentation, which I suggest you read.

Note that MPI has no concept of "master" and "slave" -- all ranks are created equal. Of course this does not stop one from writing an MPI program using a master/worker paradigm, in which one rank (usually 0) is the master and doles out work to the "workers", but this is a function of how the code divides up its workload and not anything inherent to MPI.

It's nice to have a shared filesystem accessible on both nodes (using NFS for starters, or if you need high IOPS something like Lustre and Ceph, but it sounds like you're just playing around so vanilla NFS will probably work just fine). If you want to designate one of your nodes the "master", you can put a big disk in it and export it via NFS to other other system. This saves you the bother of having to copy files to both systems.

Thank you very much i finnaly built a beowulf like cluster.....but when executing some of the programs i get the following error

HYDU_create_process (./utils/launch/launch.c:69): execvp error on file ./cpi.c (Permission denied)

Any Idea why? and ./cpi.c is just my objectfile name i.e binary file

Last edited by $u$hil_k$; 01-23-2013 at 03:33 AM.
 
  


Reply

Tags
beowulf, cluster, ubuntu 12.04


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Beowulf Cluster on Ubuntu 10.04 ? darkwolf Linux - Newbie 19 01-07-2012 06:49 PM
Beowulf-like cluster luigi Linux - General 5 11-18-2009 08:30 AM
Few questions about building a beowulf cluster Aleks` Linux - General 1 09-23-2008 05:24 PM
cluster beowulf grened23 Linux - Networking 0 09-11-2006 08:13 AM
errors while testing cluster machines (MPICH) nedian123 Linux - Networking 0 12-09-2004 03:27 AM


All times are GMT -5. The time now is 12:53 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration