Difference between revisions of "CSC352 Class Page 2010"

From dftwiki3
Jump to: navigation, search
Line 6: Line 6:
  
 
=References & Bibliography=
 
=References & Bibliography=
<onlysmith>
+
 
 
==Parallel Processing/Good background information==
 
==Parallel Processing/Good background information==
 
* Asanovic K. ''et al'', [http://www.eecs.berkeley.edu/Pubs/TechRpts/2006/EECS-2006-183.pdf The Landscape of Parallel Computing Research: A View from Berkeley], Dec. 2006. ([[media:LandscapeParallelProcessingBerkeley1206.pdf|cached copy]])
 
* Asanovic K. ''et al'', [http://www.eecs.berkeley.edu/Pubs/TechRpts/2006/EECS-2006-183.pdf The Landscape of Parallel Computing Research: A View from Berkeley], Dec. 2006. ([[media:LandscapeParallelProcessingBerkeley1206.pdf|cached copy]])
Line 23: Line 23:
  
 
==Cloud Computing==
 
==Cloud Computing==
 +
 
===Literature===
 
===Literature===
 
* Dean, J., and S. Ghemawat, [http://labs.google.com/papers/mapreduce-osdi04.pdf MapReduce: Simplified Data Processing on Large Clusters], Dec. 2004,  ([[media:MapReduce1204.pdf|cached copy]])
 
* Dean, J., and S. Ghemawat, [http://labs.google.com/papers/mapreduce-osdi04.pdf MapReduce: Simplified Data Processing on Large Clusters], Dec. 2004,  ([[media:MapReduce1204.pdf|cached copy]])
Line 34: Line 35:
 
*[http://code.google.com/edu/parallel/tools/hadoopvm/index.html  Hadoop at Google]:
 
*[http://code.google.com/edu/parallel/tools/hadoopvm/index.html  Hadoop at Google]:
 
: Setting up a Hadoop cluster can be an all day job. However, if you want to experiment with the platform right now, [Google] has created a virtual machine image with a preconfigured single node instance of Hadoop
 
: Setting up a Hadoop cluster can be an all day job. However, if you want to experiment with the platform right now, [Google] has created a virtual machine image with a preconfigured single node instance of Hadoop
*[http://code.google.com/edu/parallel/tools/hadoopvm/index.html Setting up Eclipse for Hadoop]
+
*[http://code.google.com/edu/parallel/tools/hadoopvm/index.html IBM's guide for setting up Eclipse for Hadoop]
 
:The IBM MapReduce Tools for Eclipse Plug-in is a robust plug-in that brings Hadoop support to the Eclipse platform. Features include server configuration, support for launching MapReduce jobs and browsing the distributed file system. This setup assumes that you are running Eclipse (version 3.3 or above) on your computer.
 
:The IBM MapReduce Tools for Eclipse Plug-in is a robust plug-in that brings Hadoop support to the Eclipse platform. Features include server configuration, support for launching MapReduce jobs and browsing the distributed file system. This setup assumes that you are running Eclipse (version 3.3 or above) on your computer.
 
*[http://www.cloudera.com/blog/2009/04/20/configuring-eclipse-for-hadoop-development-a-screencast/ Configuring Eclipse for Hadoop]
 
*[http://www.cloudera.com/blog/2009/04/20/configuring-eclipse-for-hadoop-development-a-screencast/ Configuring Eclipse for Hadoop]
 
:A video from Cloudera on setting up Hadoop... not easy to follow...
 
:A video from Cloudera on setting up Hadoop... not easy to follow...
 
</onlysmith>
 

Revision as of 11:03, 3 December 2009

Python Threads

XGrid Programming

Cloud Computing

References & Bibliography

Parallel Processing/Good background information

Python

XGrid

Cloud Computing

Literature

Class Material

The University of Washington ran an upper-division course on Distributed Computing with MapReduce in Spring 2007. Below you'll find the materials that were used for the class: five lectures in powerpoint format, as well as four lab exercises designed which were completed by students over the duration of the course, using a cluster running Hadoop.

Software

Setting up a Hadoop cluster can be an all day job. However, if you want to experiment with the platform right now, [Google] has created a virtual machine image with a preconfigured single node instance of Hadoop
The IBM MapReduce Tools for Eclipse Plug-in is a robust plug-in that brings Hadoop support to the Eclipse platform. Features include server configuration, support for launching MapReduce jobs and browsing the distributed file system. This setup assumes that you are running Eclipse (version 3.3 or above) on your computer.
A video from Cloudera on setting up Hadoop... not easy to follow...