Difference between revisions of "Hadoop/MapReduce Tutorials"

From dftwiki3
Jump to: navigation, search
(Created page with 'right| 250px <br /> right | 150px <bluebox> <br /> <br /> These tutorials target the Hadoop/MapReduce Cluster in the CS Dep…')
 
Line 1: Line 1:
[[Image:AmazonAWS.jpg |right| 250px]]
+
[[Image:AmazonAWS.jpg |right| 150px]]
 
<br />
 
<br />
 
[[File:HadoopCartoon.png | right | 150px]]
 
[[File:HadoopCartoon.png | right | 150px]]
Line 26: Line 26:
 
|
 
|
 
Running WordCount in Python on the Smith College Hadoop/MapReduce Cluster
 
Running WordCount in Python on the Smith College Hadoop/MapReduce Cluster
 +
|-
 
|
 
|
|-
 
 
[[Hadoop Tutorial 3 -- Hadoop on Amazon AWS | Tutorial #3]]
 
[[Hadoop Tutorial 3 -- Hadoop on Amazon AWS | Tutorial #3]]
 
|
 
|
Line 33: Line 33:
 
|-
 
|-
 
|
 
|
[[Hadoop Tutorial 3.1 -- Using Amazon's WordCount program | Tutorial 3.1]]
+
[[Hadoop_Tutorial_3.1_--_Using_Amazon's_WordCount_program | Tutorial 3.1]]
 
|
 
|
 
Uploading text to S3 and running Amazon's WordCount Java program on our own data.
 
Uploading text to S3 and running Amazon's WordCount Java program on our own data.
 
|-
 
|-
[[Hadoop Tutorial 3.2 -- Using Your Own WordCount program | Tutorial 3.2]]
+
|
 +
[[Hadoop_Tutorial_3.2_--_Using_Your_Own_WordCount_program | Tutorial 3.2]]
 
|
 
|
 
Compiling our own version of the Java WordCount program and uploading it to AWS.
 
Compiling our own version of the Java WordCount program and uploading it to AWS.
 
|-
 
|-
 +
|
 
[[Hadoop Tutorial 4: Start an EC2 Instance | Tutorial 4]]
 
[[Hadoop Tutorial 4: Start an EC2 Instance | Tutorial 4]]
 
|
 
|

Revision as of 06:25, 1 April 2010

AmazonAWS.jpg


HadoopCartoon.png



These tutorials target the Hadoop/MapReduce Cluster in the CS Dept. at Smith College, as well as Amazon's EC2 and S3.




Tutorial Comments

Tutorial #1

Running WordCount written in Java on the Smith College Hadoop/MapReduce Cluster

Tutorial #2

Running WordCount in Python on the Smith College Hadoop/MapReduce Cluster

Tutorial #3

Running Hadoop jobs on Amazon AWS

Tutorial 3.1

Uploading text to S3 and running Amazon's WordCount Java program on our own data.

Tutorial 3.2

Compiling our own version of the Java WordCount program and uploading it to AWS.

Tutorial 4

Start a server on Amazon's EC2 infrastructure