Tutorial: Running MPI Programs on Hadoop Cluster

--D. Thiebaut (talk) 13:57, 15 October 2013 (EDT)

---

Setup to run MPI on multiple Linux-Mint computers

• Follow general directions from this page, or follow the steps summarized below.

• First set up password-less login setup

Setup password-less ssh

• Follow directions in this page, or follow the steps summarized below.
• We'll use 3 of the Linux-Mint machines for this demo.

This section is only visible to computers located at Smith College

• login to one of the Linux-Mint machines with your 352a-xx account.
• enter the following commands:

ssh-keygen -t rsa
ls .ssh
cd .ssh
mv id_rsa id_rsa.mpi
mv id_rsa.pub id_rsa.mpi.pub
ls -l
total 12
-rw------- 1 352a 352a 1675 Oct 15 13:33 id_rsa.mpi
-rw------- 1 352a 352a  396 Oct 15 13:33 id_rsa.mpi.pub
-rw-r--r-- 1 352a 352a  444 Oct 14 14:26 known_hosts
cat id_rsa.mpi.pub > authorized_keys
emacs -nw config     (and add the next line to the file)
IdentityFile ~/.ssh/id_rsa.mpi

• Now login to another Linux-Mint machine. You should be able to login without having to enter a password.

Configuration

• create a file called hosts in the directory where the mpi programs are located.
• Store the following IP addresses in it:

This section is only visible to computers located at Smith College