Difference between revisions of "CSC352 Notes 2013"

From dftwiki3
Jump to: navigation, search
(Setting up Eclipse for Hadoop)
(Setting up Eclipse for Hadoop)
Line 15: Line 15:
 
* setup eclipse  
 
* setup eclipse  
 
:  http://v-lad.org/Tutorials/Hadoop/17%20-%20set%20up%20hadoop%20location%20in%20the%20eclipse.html
 
:  http://v-lad.org/Tutorials/Hadoop/17%20-%20set%20up%20hadoop%20location%20in%20the%20eclipse.html
 +
** localhost
 +
** Map/Reduce Master: localhost, 9101
 +
** DFS Master: user M/R Master ht, localhost, 9000
 +
** user name: hadoop-user
 +
** SOCKS proxy: host, 1080
 +
* Open DFS Locations
 +
** localhost
 +
*** (2)
 +
**** tmp(1)
 +
***** hadoop-thiebaut (1)
 +
****** mapred (1)
 +
******* system (0)
 +
**** user(1)
 +
***** thiebaut (2)
 +
****** hello.txt
 +
****** readme.txt
  
 
=Notes on doing example in Yahoo Tutorial, Module 2=
 
=Notes on doing example in Yahoo Tutorial, Module 2=

Revision as of 19:48, 15 December 2009

Setting up Eclipse for Hadoop

 start-all.sh
  • setup eclipse
http://v-lad.org/Tutorials/Hadoop/17%20-%20set%20up%20hadoop%20location%20in%20the%20eclipse.html
    • localhost
    • Map/Reduce Master: localhost, 9101
    • DFS Master: user M/R Master ht, localhost, 9000
    • user name: hadoop-user
    • SOCKS proxy: host, 1080
  • Open DFS Locations
    • localhost
      • (2)
        • tmp(1)
          • hadoop-thiebaut (1)
            • mapred (1)
              • system (0)
        • user(1)
          • thiebaut (2)
            • hello.txt
            • readme.txt

Notes on doing example in Yahoo Tutorial, Module 2

http://developer.yahoo.com/hadoop/tutorial/module2.html

   cd ../hadoop/examples/
   cat > HDFSHelloWorld.java
   mkdir hello_classes
   javac -classpath /Users/thiebaut/hadoop/hadoop-0.19.2-core.jar -d hello_classes HDFSHelloWorld.java 
   emacs HDFSHelloWorld.java -nw
   javac -classpath /Users/thiebaut/hadoop/hadoop-0.19.2-core.jar -d hello_classes HDFSHelloWorld.java 
   ls
   ls hello_classes/
   jar -cvf helloworld.jar -C hello_classes/ .
   ls
   ls -ltr
   find . -name "*" -print
   hadoop jar helloworld.jar HDFSHelloWorld

   Hello, world!