Hadoop Tutorial 1 -- Running WordCount
This tutorial will introduce you to the Hadoop Cluster in the Computer Science Dept. at Smith College, and how to submit jobs on it. The setup of the cloud cluster is fully documented here. |
Setup
Cluster Ips
- You can get the up-to-date Ips of the different nodes here. These Ip should most likely remain in effect for long periods of time:
131.229.101.218 | hadoop1 |
131.229.99.216 | hadoop2 |
131.229.103.202 | hadoop3 |
131.229.100.208 | hadoop4 |
131.229.103.204 | hadoop5 |
Verifying Cluster Operation
- Ssh to hadoop1