Hadoop Tutorial 1 -- Running WordCount

From dftwiki3
Revision as of 12:28, 16 March 2010 by Thiebaut (talk | contribs) (Created page with '{| | __TOC__ | <bluebox> This tutorial will introduce you to the Hadoop Cluster in the Computer Science Dept. at Smith College, and how to submit jobs on it. The setup of the cl…')
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

This tutorial will introduce you to the Hadoop Cluster in the Computer Science Dept. at Smith College, and how to submit jobs on it.

The setup of the cloud cluster is fully documented here.

Setup

Cluster Ips

  • You can get the up-to-date Ips of the different nodes here. These Ip should most likely remain in effect for long periods of time:
131.229.101.218     hadoop1
131.229.99.216 hadoop2
131.229.103.202 hadoop3
131.229.100.208 hadoop4
131.229.103.204 hadoop5


Verifying Cluster Operation

  • Ssh to hadoop1