Editing HPC High Processing Cluster in BITS PILANI (section)

= <center>'''INSTALLATION OF 9-Node(SUNFIRE) HIGH PROCESSING CLUSTER'''</center>=

=='''Master node'''==

* NFS Client
* Ganglia daemon “gomnd” and “gmetad” running. 
* apache running to provide web interface for ganglia 
* mpd (MPI) daemon running. 
* .mpd.conf file is created in wolf and lam home directory 
* user wolf2 and group beowulf2 responsible for operating cluster for all pgassignments members, here “pgassignments” is an OU of ldap.All “pgassignments’ members use only wolf2 user for HPC.
* user lam1 and group prolam1 responsible for operating for all projects members,here “ugassignments” is an OU of ldap. All “ugassignments” members use only lam user for HPC

=='''Slave node'''==

* NFS client
* Ganglia daemon “gomnd” and “gmetad” running. 
* mpd (MPI) is started by master node on each slave node. 
* .mpd.conf file is created in wolf and lam home directory 
* user wolf2 and group beowulf2 responsible for operating cluster for all pgassignments members, here “pgassignments” is an OU of ldap.All “pgassignments’ members use only wolf2 user for HPC.
* user lam1 and group prolam1 responsible for operating for all projects members,here “ugassignments” is an OU of ldap. All “ugassignments” members use only lam user for HPC

Note : wolf2 and lam1 are local system users in master and slave nodes., 

== Preparation of Master node(IBM-39) ==
* First the entries where made in /etc/hosts of each cluster as follows 

172.20.4.25sunfire-25

172.20.4.26sunfire-26

172.20.4.27sunfire-27

172.20.4.28sunfire-28

172.20.4.29sunfire-29

172.20.4.30sunfire-30

172.20.4.31sunfire-31

172.20.4.32sunfire-32

172.20.4.33sunfire-33


* Two groups was created and a two users who will be responsible for operating cluster was added as follows. 

 groupadd beowulf2 
 useradd -g beowulf2 wolf2 
 groupadd prolam1
 useradd –g prolam1 lam1

'''Note : This document is concern about wolf2 user.'''

* Following line were added in /home/wolf2/.bash_profile 

 umask 007 

* '''Mount all home directories for these HPC2 Cluster i.e.'''

Mkdir /ugassignments /pgassignments

 mount –t nfs 172.20.4.43: /ugassignments /ugassignments 
 mount –t nfs 172.20.4.43: /pgassignments /pgassignments 

Then make permanent entry on fstab

* Communication among the nodes takes place through ssh, so ssh login for user “wolf” has to be without need of entering the password. This was acheived as follow. 

Uncomment the following in /etc/sshd/sshd_config 

 <nowiki>#RSAAuthentication yes </nowiki>
 <nowiki>#AuthorizedKeysFile .ssh/authorized_keys </nowiki>

* Reboot and login as wolf because operation of cluster will always be done by user “wolf”
* To generate your public and private SSH keys, do this: 

 ssh-keygen –t rsa 

This will generate the two public/private key pain in .ssh directory. Copy the id_rsa.pub file into a file called "authorized_keys" right there in the .ssh directory.This key will be used later. Modify the security of file and directory 

 chmod 644 ~/.ssh/auth* 
 chmod 755 ~/.ssh 

* Add these entries is /home/wolf/.bash_profile 

 export LAMRSH='ssh -x' 
 ssh-agent sh -c 'ssh-add && bash' 

* Install MPI as above HPC1 section 
* Install slave nodes as above section but home directories mount as a nfs.
* Install Ganglia as above HPC1 section