Setup Virtual Hadoop Cluster under Ubuntu with VirtualBox
--D. Thiebaut (talk) 14:35, 22 June 2013 (EDT)
Server Hardware/OS Configuration
- ASUS M5A97 R2.0 AM3+ AMD 970 SATA 6Gb/s USB 3.0 ATX AMD Motherboard ($84.99)
- Corsair Vengeance 16GB (2x8GB) DDR3 1600 MHz (PC3 12800) Desktop Memory (CMZ16GX3M2A1600C10) ($120.22)
- AMD FX-8150 8-Core Black Edition Processor Socket AM3+ FD8150FRGUBOX ($175)
- 2x 1 TB-RAID 1 disks
- used Ctrl-F in POS to call RAID setup.
- setup 2 1TB drives as RAID-1
- Ubuntu Desktop V13.04
Software Setup
- VirtualBox
- emacs
- eclipse
- python 3.1
- ddclient (for dyndns.org, e.g. hadoop0.dyndns.org)
- open-ssh to access remotely
- setup keyboard ctrl/capslock swap
- setup 2 video displays
Test Hadoop on 1 Node
- Download hadoop-1.1.2.tar.gz and install according to Michael G. Noll's excellent instructions.