Setup Virtual Hadoop Cluster under Ubuntu with VirtualBox

From dftwiki3
Revision as of 13:35, 22 June 2013 by Thiebaut (talk | contribs) (Created page with "--~~~~ ---- <center> <font size="+2">Page under construction!</font> <br \>300px </center> <br /> =Server Hardware/OS Configuration= * ASUS M5A...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

--D. Thiebaut (talk) 14:35, 22 June 2013 (EDT)


Page under construction!
UnderConstruction.jpg


Server Hardware/OS Configuration

  • ASUS M5A97 R2.0 AM3+ AMD 970 SATA 6Gb/s USB 3.0 ATX AMD Motherboard ($84.99)
  • Corsair Vengeance 16GB (2x8GB) DDR3 1600 MHz (PC3 12800) Desktop Memory (CMZ16GX3M2A1600C10) ($120.22)
  • AMD FX-8150 8-Core Black Edition Processor Socket AM3+ FD8150FRGUBOX ($175)
  • 2x 1 TB-RAID 1 disks
    • used Ctrl-F in POS to call RAID setup.
    • setup 2 1TB drives as RAID-1
  • Ubuntu Desktop V13.04

Software Setup

  • VirtualBox
  • emacs
  • eclipse
  • python 3.1
  • ddclient (for dyndns.org, e.g. hadoop0.dyndns.org)
  • open-ssh to access remotely
  • setup keyboard ctrl/capslock swap
  • setup 2 video displays

Test Hadoop on 1 Node

  • Download hadoop-1.1.2.tar.gz and install according to Michael G. Noll's excellent instructions.