Admin: Flag as outdated (client review pass)

2026-07-25T15:59:51Z

Flag as outdated (client review pass)

← Older revision		Revision as of 15:59, 25 July 2026
Line 1:		Line 1:
			{{Outdated\|reason=Old Technology and Customer But Relevant for Understanding\|date=2026-07}}
	[[category:Installation]]		[[category:Installation]]
	[[category:Tetra Clients]]		[[category:Tetra Clients]]

Biswajit at 11:01, 18 December 2012

2012-12-18T11:01:26Z

← Older revision		Revision as of 11:01, 18 December 2012
Line 1:		Line 1:
	[[category:~~Implementation~~]]		[[category:Installation]]
	[[category:Tetra Clients]]		[[category:Tetra Clients]]

Biswajit at 04:19, 15 December 2012

2012-12-15T04:19:55Z

← Older revision		Revision as of 04:19, 15 December 2012
Line 2:		Line 2:
	[[category:Tetra Clients]]		[[category:Tetra Clients]]

	=='''Documentation of High Processing Cluster in IIT'''==		=='''Documentation of High Processing Cluster in IIT ( 2008 )'''==

Biswajit at 04:12, 15 December 2012

2012-12-15T04:12:30Z

← Older revision		Revision as of 04:12, 15 December 2012
Line 1:		Line 1:
	[[~~catagory~~:Implementation]]		[[category:Implementation]]
	[[~~catagory~~:Tetra Clients]]		[[category:Tetra Clients]]

	=='''Documentation of High Processing Cluster in IIT'''==		=='''Documentation of High Processing Cluster in IIT'''==
Line 17:		Line 17:


	='''Master node'''=		=='''Master node'''==

Biswajit at 04:10, 15 December 2012

2012-12-15T04:10:46Z

← Older revision		Revision as of 04:10, 15 December 2012
Line 1:		Line 1:
	'''Documentation of High Processing Cluster in IIT'''		[[catagory:Implementation]]
			[[catagory:Tetra Clients]]

			=='''Documentation of High Processing Cluster in IIT'''==


Line 5:		Line 8:


	'''Diagramatic View of High Processing Cluster'''		=='''Diagramatic View of High Processing Cluster'''==


Line 11:		Line 14:


	<nowiki></nowiki>'''Brief overview of cluster'''		==<nowiki></nowiki>'''Brief overview of cluster'''==


	'''Master node'''		='''Master node'''=


Line 24:		Line 27:
	# user wolf and group Beowulf responsible for operating cluster		# user wolf and group Beowulf responsible for operating cluster

	'''Slave node'''.		=='''Slave node'''==


Line 35:		Line 38:


	# '''Preparation of Master node.'''		=='''Preparation of Master node.'''==

	a.First the entries where made in /etc/hosts of each cluster as follows		a.First the entries where made in /etc/hosts of each cluster as follows
Line 117:		Line 120:


	g. Installation of MPI ( Message Passing Interface)		==g. Installation of MPI ( Message Passing Interface)==


Line 232:		Line 235:


	# '''Preparation of slave nodes'''.		=='''Preparation of slave nodes'''==

	a. beowulf and wolf user were created as in master node		a. beowulf and wolf user were created as in master node
Line 280:		Line 283:


	'''Installation of ganglia (cluster monitoring tool) on each node.'''		='''Installation of ganglia (cluster monitoring tool) on each node.'''=

Biswajit at 04:06, 15 December 2012

2012-12-15T04:06:09Z

← Older revision		Revision as of 04:06, 15 December 2012
Line 8:		Line 8:


	<center>[[Image:]]</center>		<center>[[Image:hpc_iit.png]]</center>

Biswajit: High Processing Cluster in IIT

2012-12-15T04:03:33Z

High Processing Cluster in IIT

New page

'''Documentation of High Processing Cluster in IIT'''

IIT had a requirement of High Processing Cluster for there application called “Fluent”.For this four slave node computer and one master node computer were used. RHEL5 client where installed in each slave server and RHEL 5 server was installed in master node.

'''Diagramatic View of High Processing Cluster'''

<center>[[Image:]]</center>

<nowiki>**</nowiki>'''Brief overview of cluster**'''

'''Master node'''

# NFS server running
# Ganglia daemon “gomnd” and “gmetad” running.
# apache running to provide web interface for ganglia
# mpd (MPI) daemon running.
# .mpd.conf file is created in wolf home directory
# user wolf and group Beowulf responsible for operating cluster

'''Slave node'''.

# NFS share is mounted on four slave nodes
# Ganglia daemon “gomnd” and “gmetad” running.
# mpd (MPI) is started by master node on each slave node.
# .mpd.conf file is created in wolf home directory in each slave node.

User wolf and group Beowulf responsible for operating cluster

# '''Preparation of Master node.'''

a.First the entries where made in /etc/hosts of each cluster as follows

10.52.3.111 master_node

10.52.3.112node1

10.52.3.113node2

10.52.3.114node3

10.52.3.115node5

b.A group was created and a user who will be responsible for operating cluster was added as follows.

groupadd beowulf

useradd -g beowulf wolf

c.Following line were added in /home/wolf/.bash_profile

umask 007

d.NFS server was created as follows in master node.

mkdir /shared

chmod 770 /shared

chown -R wolf:beowulf /shared

Following entry is made in /etc/exports file

/wolf * (rw,no_root_squash,sync)

e.Communication among the nodes takes place through ssh, so ssh login for user “wolf” has to be without need of entering the password. This was acheived as follow.

Uncomment the following in /etc/sshd/sshd_config

<nowiki>#RSAAuthentication yes </nowiki>

<nowiki>#AuthorizedKeysFile .ssh/authorized_keys</nowiki>

f.Reboot and login as wolf because operation of cluster will always be done by user “wolf”

g.To generate your public and private SSH keys, do this:

ssh-keygen -b 1024 -f ~/.ssh/id_rsa -t rsa -N ""

This will generate the two public/private key pain in .ssh directory. Copy the id_rsa.pub file into a file called "authorized_keys" right there in the .ssh directory.This key will be used later. Modify the security of file and directory

chmod 644 ~/.ssh/auth*

chmod 755 ~/.ssh

h.Add these entries is /home/wolf/.bash_profile

export LAMRSH='ssh -x'

ssh-agent sh -c 'ssh-add && bash'

g. Installation of MPI ( Message Passing Interface)

Initally LAM was used as MPI but the application Fluent doesn't work with this MPI so we installed MPICH2. The MPI mpich2 can be downloaded from http://www.mcs.anl.gov/research/projects/mpich2

1. Unpack the tar ﬁle.

tar xfz mpich2.x.x.x.tar.gz

2. Choose an installation directory (the default is /usr/local/bin):

mkdir /usr/local/mpich2/

cd /mpich2

./configure –prefix=/usr/local/mpich2

make

make install.

Set the enviroment variable for user “wolf” in /home/wolf/.bash_profile

Add following lines.

MPICH2=/usr/local/mpich2

PATH=$PATH:$HOME/bin:$MPICH2/bin

2.MPICH2, uses an external process manager for scalable startup of large MPI jobs. The default process manager is called MPD, which is a ring of daemons on the machines where you will run your MPI programs.

For security reasons, mpd looks in your home directory for a ﬁle named

.mpd.conf containing the line in home directory. So create this file as follows

cd $HOME

touch .mpd.conf

chmod 600 .mpd.conf

add a line

<nowiki>secretword=<anysecretword></nowiki>

we used “fluentwolf” as secretword in our case.

3.The ﬁrst sanity check consists of bringing up a ring of one mpd on

the local machine, testing one mpd command, and bringing the “ring”

down.

mpd &

mpdtrace

mpdallexit

The output of mpdtrace should be the hostname of the machine you

are running on. The mpdallexit causes the mpd daemon to exit

4.Now we will bring up a ring of mpd’s on a set of machines. Create a

ﬁle consisting of a list of machine names, one per line. Name this ﬁle

.mpd.hosts in home directory of user wolf. These hostnames will be used as targets for ssh so include full domain names if necessary. Check that you can reach these machines with ssh without entering a password. You can test by doing.

Ssh node1 –l wolf

# Start the daemons on (some of) the hosts in the ﬁle mpd.hosts

mpdboot -n <nowiki><number to start> -f mpd.hosts</nowiki>

The number to start can be less than 1 + number of hosts in the ﬁle,but cannot be greater than 1 + the number of hosts in the ﬁle. One mpd is always started on the machine where mpdboot is run, and is counted in the number to start, whether or not it occurs in the ﬁle. By default, mpdboot will only start one mpd per machine even if the machine name appears in the hosts ﬁle multiple times.

mpdboot -n 5 -f mpd.hosts

This will start the cluster.

mpdtrace

This command will show you the nodes in the cluster like below

Master_node

Node1

Node2

# '''Preparation of slave nodes'''.

a. beowulf and wolf user were created as in master node

b. Edit file /home/wolf/.bash_pofile

export LAMRSH='ssh -x'

ssh-agent

MPICH2=/usr/local/mpich2

PATH=$HOME/bin:$MPICH2/bin

Make /shared directory

mkdir shared

c. Create entry in /etc/fstab/

master_node:/shared /shared nfs rw,hard,intr 0 0

This will mount the nfs shared drive at boot time

c. Reboot all the nodes.

d. login as wolf users and install MPI as described above in MPI installation section.

'''Note''': Firewall should be disabled in all nodes as MPI uses randoms ports each time it is started.

“mpdboot -n 5 -f mpd.hosts” command should be executed as root user from master node. This will start mpd daemon in slave nodes

First master node must boot then slave node so that nfs share are mounted on slave machine.

2 . Finally we installed the IIT application “Fluent” on to the shared directory /shared which is shared by all nodes too. Mdp daemon has to be started on all the nodes as mentioned above and then only master node as user wolf can start the application.

'''Installation of ganglia (cluster monitoring tool) on each node.'''

Ganglia can be downloaded from [http://ganglia.sourceforge.net/downloads.php http://ganglia.sourceforge.net/downloads.php]

#
## Install ganglia as follows

# rpm –Uvh rrdtool-x.x.x.rpm ( this is dependency of ganglia)
# rpm –Uvh rrdtool-devel-.x.x.x.rpm
# rpm –Uvh ganglia-gmond-x.x.x.rpm
# rpm –Uvh ganglia-gmetad-x.x.x.rpm
# rpm –Uvh ganglia-web-x.x.x.rpm ( web interface for ganglia to be installed only in master node)
# create a file /etc/httpd/conf.d/ganglia.conf only in master node.

Alias /ganglia /usr/share/ganglia

# open the file /etc/gmetad.conf and edit the file with following entry only in master node

data_source “unspecified” master_node node1 node2 node3 node4

# start the ganglia service in each node.

/etc/init.d/gmond start

/etc/init.d/gmetad start

# gateway of all nodes should be master_node.

# ganglia can be accessed in any browser with the url [http://10.52.3.110/ganglia http://10.52.3.110/ganglia]