Editing HPC High Processing Cluster in BITS PILANI (section)

=<center>'''INSTALLATION OF 2-Node(IBM) HIGH PROCESSING CLUSTER'''</center>=

=='''Master node'''==

* NFS server running in High Availability.
* Ganglia daemon “gomnd” and “gmetad” running. 
* apache running to provide web interface for ganglia 
* mpd (MPI) daemon running. 
* .mpd.conf file is created in wolf and lam home directory 
* user wolf and group Beowulf responsible for operating cluster for all staff members, here “staff” is an OU of ldap.All “staff’ members use only wolf user for HPC.
* user lam and group prolam responsible for operating for all projects members,here “projects” is an OU of ldap. All “projects” members use only lam user for HPC

=='''Slave node'''==

* NFS server running in High Availability
* Ganglia daemon “gomnd” and “gmetad” running. 
* mpd (MPI) is started by master node on each slave node. 
* .mpd.conf file is created in wolf and lam home directory 
* user wolf and group Beowulf responsible for operating cluster for all staff members, here “staff” is an OU of ldap.All “staff’ members use only wolf user for HPC.
* user lam and group prolam responsible for operating for all projects members,here “projects” is an OU of ldap. All “projects” members use only lam user for HPC

Note : wolf and lam are local system users in master and slave nodes.,

== Preparation of Master node(IBM-39) ==
* First the entries where made in /etc/hosts of each cluster as follows 


172.20.4.39		 ibm-39.bits.ac		ibm-39 
172.20.4.40       	 ibm-40.bits.ac		ibm-40

* Two groups was created and a two users who will be responsible for operating cluster was added as follows. 

 groupadd beowulf 
 useradd -g beowulf wolf 
 groupadd prolam
 useradd –g prolam lam

'''Note : This document is concern about wolf user.'''

* Following line were added in /home/wolf/.bash_profile 

 umask 007 

* NFS server was created as follows in master node. 

 mkdir /linuxeda 

This file have all the binaries and need to rsync with all when changes occurred.

 chmod 770 /linuxeda 

All home directories are in lvm mode name and location 

/staff :This Home directory is for 2 node IBM HPC.

/projects:This Home directory is for 2 node IBM HPC.

/ugassignments:This Home directory is for 9 node Sunfire HPC.

/pgassignments:This Home directory is for 9 node Sunfire HPC.

'''Following entry is made in /etc/exports file '''

 /staff <nowiki>* (rw,no_root_squash,sync) </nowiki>
 /projects <nowiki>* (rw,no_root_squash,sync) </nowiki>
 /ugassignments<nowiki>* (rw,no_root_squash,sync) </nowiki>
 /pgassignments<nowiki>* (rw,no_root_squash,sync) </nowiki>

 <nowiki># service nfs start ; chkconfig nfs on</nowiki>


* Communication among the nodes takes place through ssh, so ssh login for user “wolf” has to be without need of entering the password. This was acheived as follow. 

Uncomment the following in /etc/sshd/sshd_config 

 <nowiki>#RSAAuthentication yes </nowiki>
 <nowiki>#AuthorizedKeysFile .ssh/authorized_keys </nowiki>

* Reboot and login as wolf because operation of cluster will always be done by user “wolf”
* To generate your public and private SSH keys, do this: 

 ssh-keygen –t rsa 

This will generate the two public/private key pain in .ssh directory. Copy the id_rsa.pub file into a file called "authorized_keys" right there in the .ssh directory.This key will be used later. Modify the security of file and directory 

 chmod 644 ~/.ssh/auth* 
 chmod 755 ~/.ssh 

* Add these entries is /home/wolf/.bash_profile 

 export LAMRSH='ssh -x' 

 ssh-agent sh -c 'ssh-add && bash'