Difference between revisions of "CSC352 Class Page 2010"
| Line 6: | Line 6: | ||
=References & Bibliography= | =References & Bibliography= | ||
| − | + | ||
==Parallel Processing/Good background information== | ==Parallel Processing/Good background information== | ||
* Asanovic K. ''et al'', [http://www.eecs.berkeley.edu/Pubs/TechRpts/2006/EECS-2006-183.pdf The Landscape of Parallel Computing Research: A View from Berkeley], Dec. 2006. ([[media:LandscapeParallelProcessingBerkeley1206.pdf|cached copy]]) | * Asanovic K. ''et al'', [http://www.eecs.berkeley.edu/Pubs/TechRpts/2006/EECS-2006-183.pdf The Landscape of Parallel Computing Research: A View from Berkeley], Dec. 2006. ([[media:LandscapeParallelProcessingBerkeley1206.pdf|cached copy]]) | ||
| Line 23: | Line 23: | ||
==Cloud Computing== | ==Cloud Computing== | ||
| + | |||
===Literature=== | ===Literature=== | ||
* Dean, J., and S. Ghemawat, [http://labs.google.com/papers/mapreduce-osdi04.pdf MapReduce: Simplified Data Processing on Large Clusters], Dec. 2004, ([[media:MapReduce1204.pdf|cached copy]]) | * Dean, J., and S. Ghemawat, [http://labs.google.com/papers/mapreduce-osdi04.pdf MapReduce: Simplified Data Processing on Large Clusters], Dec. 2004, ([[media:MapReduce1204.pdf|cached copy]]) | ||
| Line 34: | Line 35: | ||
*[http://code.google.com/edu/parallel/tools/hadoopvm/index.html Hadoop at Google]: | *[http://code.google.com/edu/parallel/tools/hadoopvm/index.html Hadoop at Google]: | ||
: Setting up a Hadoop cluster can be an all day job. However, if you want to experiment with the platform right now, [Google] has created a virtual machine image with a preconfigured single node instance of Hadoop | : Setting up a Hadoop cluster can be an all day job. However, if you want to experiment with the platform right now, [Google] has created a virtual machine image with a preconfigured single node instance of Hadoop | ||
| − | *[http://code.google.com/edu/parallel/tools/hadoopvm/index.html | + | *[http://code.google.com/edu/parallel/tools/hadoopvm/index.html IBM's guide for setting up Eclipse for Hadoop] |
:The IBM MapReduce Tools for Eclipse Plug-in is a robust plug-in that brings Hadoop support to the Eclipse platform. Features include server configuration, support for launching MapReduce jobs and browsing the distributed file system. This setup assumes that you are running Eclipse (version 3.3 or above) on your computer. | :The IBM MapReduce Tools for Eclipse Plug-in is a robust plug-in that brings Hadoop support to the Eclipse platform. Features include server configuration, support for launching MapReduce jobs and browsing the distributed file system. This setup assumes that you are running Eclipse (version 3.3 or above) on your computer. | ||
*[http://www.cloudera.com/blog/2009/04/20/configuring-eclipse-for-hadoop-development-a-screencast/ Configuring Eclipse for Hadoop] | *[http://www.cloudera.com/blog/2009/04/20/configuring-eclipse-for-hadoop-development-a-screencast/ Configuring Eclipse for Hadoop] | ||
:A video from Cloudera on setting up Hadoop... not easy to follow... | :A video from Cloudera on setting up Hadoop... not easy to follow... | ||
| − | |||
| − | |||
Revision as of 10:03, 3 December 2009
Contents
Python Threads
XGrid Programming
Cloud Computing
References & Bibliography
Parallel Processing/Good background information
- Asanovic K. et al, The Landscape of Parallel Computing Research: A View from Berkeley, Dec. 2006. (cached copy)
- Mauer, R., Xen Virtualization and Linux Clustering, Linux Journal January 12th, 2006
- Barham P., et al., Xen and the Art of Virtualization, University of Cambridge Computer Laboratory 15 JJ Thomson Avenue, Cambridge, UK, CB3 0FD
- AMD News
- Hardwidge, B., AMD plans supercomputer with 1,000 GPUs, Jan. 2009, bit-tech.net (or graphics goes to the clouds!)
- Halfacree G., AMD supercomputer tops TOP500 list, November 2009, bit-tech.net (or Intel gets a black eye!)
Python
- Norman Matloff and Francis Hsu's Tutorial on Python Threads (University of California, Davis) (cached copy)
- Understanding Threading in Python, Krishna G Pai, Linux Gazette, Oct. 2004
- Thread Objects from Python.Org
XGrid
Cloud Computing
Literature
- Dean, J., and S. Ghemawat, MapReduce: Simplified Data Processing on Large Clusters, Dec. 2004, (cached copy)
- Czajkowski G., Sorting 1 PB with MapReduce, Nov. 2008, (cached copy)
- Armbrust M, et al, Above the Clouds: A Berkeley View of Cloud Computing, Tech Rep. CB/EECS-2009-28, Feb. 2009 (cached copy)
Class Material
- The University of Washington ran an upper-division course on Distributed Computing with MapReduce in Spring 2007. Below you'll find the materials that were used for the class: five lectures in powerpoint format, as well as four lab exercises designed which were completed by students over the duration of the course, using a cluster running Hadoop.
Software
- Setting up a Hadoop cluster can be an all day job. However, if you want to experiment with the platform right now, [Google] has created a virtual machine image with a preconfigured single node instance of Hadoop
- The IBM MapReduce Tools for Eclipse Plug-in is a robust plug-in that brings Hadoop support to the Eclipse platform. Features include server configuration, support for launching MapReduce jobs and browsing the distributed file system. This setup assumes that you are running Eclipse (version 3.3 or above) on your computer.
- A video from Cloudera on setting up Hadoop... not easy to follow...
