Difference between revisions of "Tutorial: Running MPI Programs on Hadoop Cluster"

From dftwiki3
Jump to: navigation, search
Line 25: Line 25:
 
  mv id_rsa.pub id_rsa.mpi.pub
 
  mv id_rsa.pub id_rsa.mpi.pub
 
  ssh yourusername@hadoop02.dyndns.org mkdir -p .ssh
 
  ssh yourusername@hadoop02.dyndns.org mkdir -p .ssh
  cat id_rsa.mpi.pub | ssh dominique@hadoop02.dyndns.org 'cat >> .ssh/authorized_keys'
+
  cat id_rsa.mpi.pub | ssh yourusername@hadoop02.dyndns.org 'cat >> .ssh/authorized_keys'
 
</source>
 
</source>
 
<br />
 
<br />
Line 36: Line 36:
 
:::<source lang="text">
 
:::<source lang="text">
 
  ssh yourusername@hadoop03.dyndns.org mkdir -p .ssh
 
  ssh yourusername@hadoop03.dyndns.org mkdir -p .ssh
  cat id_rsa.mpi.pub | ssh dominique@hadoop03.dyndns.org 'cat >> .ssh/authorized_keys'
+
  cat id_rsa.mpi.pub | ssh yourusername@hadoop03.dyndns.org 'cat >> .ssh/authorized_keys'
 +
 
 
  ssh yourusername@hadoop04.dyndns.org mkdir -p .ssh
 
  ssh yourusername@hadoop04.dyndns.org mkdir -p .ssh
  cat id_rsa.mpi.pub | ssh dominique@hadoop04.dyndns.org 'cat >> .ssh/authorized_keys'
+
  cat id_rsa.mpi.pub | ssh yourusername@hadoop04.dyndns.org 'cat >> .ssh/authorized_keys'
 
</source>
 
</source>
 
<br />
 
<br />

Revision as of 11:09, 15 March 2017

--D. Thiebaut (talk) 13:57, 15 October 2013 (EDT)
Revised: --D. Thiebaut (talk) 12:02, 15 March 2017 (EDT)



Setup Password-Less ssh to the Hadoop cluster



This section is only visible to computers located at Smith College

Configuration

  • create a file called hosts in the directory where the mpi programs are located.
  • Store the following IP addresses in it:

This section is only visible to computers located at Smith College