Difference between revisions of "CSC352 Class Page 2013"

From dftwiki3
Jump to: navigation, search
(→‎Weekly Schedule)
Line 374: Line 374:
 
This is a tentative and non exhaustive list of papers scheduled for reading this semester.
 
This is a tentative and non exhaustive list of papers scheduled for reading this semester.
 
===Introduction===
 
===Introduction===
 +
{|
 +
! Paper
 +
! title
 +
|-
 +
|
 
* [http://www.eecs.berkeley.edu/Pubs/TechRpts/2006/EECS-2006-183.pdf The Landscape of Parallel Computing Research: A View From Berkely], 2006, still good! (very long paper)
 
* [http://www.eecs.berkeley.edu/Pubs/TechRpts/2006/EECS-2006-183.pdf The Landscape of Parallel Computing Research: A View From Berkely], 2006, still good! (very long paper)
 +
|
 +
50
 +
|
 +
|-
 +
|
 
* [[Media:UpdateOnaViewFromBerkeley2010.pdf | Update on a view from Berkeley]], 2010. (short paper)
 
* [[Media:UpdateOnaViewFromBerkeley2010.pdf | Update on a view from Berkeley]], 2010. (short paper)
 +
|
 +
2
 +
|}
  
 
===General/Parallelism===
 
===General/Parallelism===
 +
 +
{|
 +
! Paper
 +
! title
 +
|-
 +
|
 
* [[Media:ParallelCOmputingWithPatternsAndFrameworks2010b.pdf | Parallel Computing with Patterns and Frameworks]], 2010, ''XRDS''.
 
* [[Media:ParallelCOmputingWithPatternsAndFrameworks2010b.pdf | Parallel Computing with Patterns and Frameworks]], 2010, ''XRDS''.
 
* [[Media:UnderstandingThroughputOrientedArchitectures2010.pdf | Understanding Throughput-Oriented Architectures]], CACM, 2010.
 
* [[Media:UnderstandingThroughputOrientedArchitectures2010.pdf | Understanding Throughput-Oriented Architectures]], CACM, 2010.
Line 383: Line 402:
  
 
===MPI===
 
===MPI===
−
* [[Media:LearningFromTheSuccessOfMPI2002_WilliamGropp.pdf | Learning from the Success of MPI]], by WIlliam D. Gropp,  Argonne National Lab, 2002.
+
{|
 +
! Paper
 +
! title
 +
|-
 +
|* [[Media:LearningFromTheSuccessOfMPI2002_WilliamGropp.pdf | Learning from the Success of MPI]], by WIlliam D. Gropp,  Argonne National Lab, 2002.
 +
|
 +
11
 +
|}
  
 
===GPUs===
 
===GPUs===
 +
{|
 +
! Paper
 +
! title
 +
|-
 +
|
 
* [[Media:GeneralPurposeVsGPU_Comparison_Many_Cores_2010_Caragea.pdf |General-Purpose vs. GPU: Comparisons of Many-Cores on Irregular Workloads]], 2010
 
* [[Media:GeneralPurposeVsGPU_Comparison_Many_Cores_2010_Caragea.pdf |General-Purpose vs. GPU: Comparisons of Many-Cores on Irregular Workloads]], 2010
 +
|
 +
6
 +
|}
  
 
===Virtualization===
 
===Virtualization===
 +
{|
 +
! Paper
 +
! title
 +
|-
 +
|
 
* [[Media:ServerVirtualizationArchitectureAndImplementation2009.pdf | Server Virtualization Architecture and Implementation]], xrds, 2009.
 
* [[Media:ServerVirtualizationArchitectureAndImplementation2009.pdf | Server Virtualization Architecture and Implementation]], xrds, 2009.
 +
|
 +
5
 +
|}
  
 
===Cloud===
 
===Cloud===
 +
{|
 +
! Paper
 +
! title
 +
|-
 +
|
 
* [[Media:NIST_Definition_Cloud_Computing_2010.pdf | The NIST Definition of Cloud Computing (Draft)]] (very short paper)
 
* [[Media:NIST_Definition_Cloud_Computing_2010.pdf | The NIST Definition of Cloud Computing (Draft)]] (very short paper)
 +
|
 +
1.5
 +
|-
 +
|
 
* [[Media:AViewOfCloudComputing_CACM_Apr2010.pdf| A View of Cloud Computing]], 2010, By Armbrust, Michael and Fox, Armando and Griffith, Rean and Joseph, Anthony D. and Katz, Randy and Konwinski, Andy and Lee, Gunho and Patterson, David and Rabkin, Ariel and Stoica, Ion and Zaharia, Matei.
 
* [[Media:AViewOfCloudComputing_CACM_Apr2010.pdf| A View of Cloud Computing]], 2010, By Armbrust, Michael and Fox, Armando and Griffith, Rean and Joseph, Anthony D. and Katz, Randy and Konwinski, Andy and Lee, Gunho and Patterson, David and Rabkin, Ariel and Stoica, Ion and Zaharia, Matei.
 +
|
 +
9
 +
|-
 +
|
 
* [[Media:MapReduceDeanGhemawat_2004.pdf |MapReduce: SImplified Data Processing on Large Clusters]], by Dean and Ghemawat, First published in OSDI 2004, also in Commun. ACM 51, 1 (January 2008), 107-113.
 
* [[Media:MapReduceDeanGhemawat_2004.pdf |MapReduce: SImplified Data Processing on Large Clusters]], by Dean and Ghemawat, First published in OSDI 2004, also in Commun. ACM 51, 1 (January 2008), 107-113.
 +
|
 +
13
 +
|-
 +
|
 
* [[Media:NobodyGotFiredUsingHadoopOnCluster_2012.pdf| Nobody ever got fired for using Hadoop on a cluster]], Rowstron, Antony and Narayanan, Dushyanth and Donnelly, Austin and O'Shea, Greg and Douglas, Andrew
 
* [[Media:NobodyGotFiredUsingHadoopOnCluster_2012.pdf| Nobody ever got fired for using Hadoop on a cluster]], Rowstron, Antony and Narayanan, Dushyanth and Donnelly, Austin and O'Shea, Greg and Douglas, Andrew
 +
|
 +
5
 +
|-
 +
|
 
* [[Media:BeyondHadoop_CACM_Mone_2013.pdf | Beyond Hadoop]], Gregory Mone, CACM, 2013. (short paper).
 
* [[Media:BeyondHadoop_CACM_Mone_2013.pdf | Beyond Hadoop]], Gregory Mone, CACM, 2013. (short paper).
 +
|
 +
2
 +
|}
  
 
===Project-Related===
 
===Project-Related===
 +
{|
 +
! Paper
 +
! title
 +
|-
 +
|
 
* [[Media:XGridHadoopCloser2011.pdf | Processing Wikipedia Dumps: A Case-Study comparing the XGrid and MapReduce Approaches]], D. Thiebaut, Yang Li, Diana Jaunzeikare, Alexandra Cheng, Ellysha Raelen Recto, Gillian Riggs, Xia Ting Zhao, Tonje Stolpestad, and Cam Le T Nguyen, ''in proceedings of 1st Int'l Conf. On Cloud Computing and Services Science'' (CLOSER 2011), Noordwijkerhout, NL, May 2011. ([[Media:XGridHadoopFeb2011.pdf |longer version]])
 
* [[Media:XGridHadoopCloser2011.pdf | Processing Wikipedia Dumps: A Case-Study comparing the XGrid and MapReduce Approaches]], D. Thiebaut, Yang Li, Diana Jaunzeikare, Alexandra Cheng, Ellysha Raelen Recto, Gillian Riggs, Xia Ting Zhao, Tonje Stolpestad, and Cam Le T Nguyen, ''in proceedings of 1st Int'l Conf. On Cloud Computing and Services Science'' (CLOSER 2011), Noordwijkerhout, NL, May 2011. ([[Media:XGridHadoopFeb2011.pdf |longer version]])
 +
|
 +
8
 +
|}
  
 
<p>
 
<p>

Revision as of 22:13, 30 September 2013

--D. Thiebaut (talk) 11:15, 9 August 2013 (EDT)



Main Page|Syllabus|Links & Resources | PIAZZA



Weekly Schedule

Week Topics Reading
Week 1
9/3
  • Tuesday
    • Syllabus
    • Introduction to final project
      • Approach
      • Programming
      • Testing
      • ==> paper (see 2011 paper for example).
    • Parallelism: going to the source: Interrupts!
      • 8086 type of interrupts (simplified)
      • Interrupt Vector
      • Interrupt Priority
      • Context Switch
      • Stack and Stack Frame
      • Global and Local Variables
    • What is a process?
    • What is a thread?
  • Thursday
    • Goals of multithreading:
      • Enhanced performance
      • Increased throughput
      • Greater user responsiveness
    • What should we remember 5 years from now?



    • Introduction to a graph we'll use all throughout the semester. The idea of threads
    Thread 1 ----------------------|====|-------------------------> time

    Thread 2 ------------|====|-----------------------------------> time
    • Multithreaded programming.


    • Comments on bimonthly newsletter
      • The format should be similar to the ACM Tech News format.
      • The header should contain a title, your name, the class (CSC352) and the date
      • Each paragraph should have a header with a title, the source of news, the date, and possibly a link to the full article.
      • The paragraph describing a news item should be between 3 to 10 lines, give or take.
      • Write 1 full page to 2 pages, depending on the richness of events in the technology field
      • Feel free to present N-1 topics with just 3 lines, and 1 topic which you highlight with a longer paragraph.
      • Topics: anything related to parallelism: computers, mobile platforms, cloud, companies, new software, new algorithms, conferences, people in the field, etc.
      • Good sources of information to get started:
      • Recommendation for news aggregator: Feedly.com
  • Homework: play with Latex. Find or adapt a document template for your needs (minimalist is the name of the game at this point), and start gathering news bits. First newsletter due Thursday Sept. 19th. The ACM Tech News format is a good and simple format to emulate.
Week 2
9/10
  • Tuesday
      • Introduction to measuring performance. Comparing execution times.
      • Introduction to Speedup( N ), where N is the number of threads, or the number of processors.
      • Amdahl's Law
AmdahlsLaw.jpg
      • A bit of Computer Architecture: Cores and Caches
4CoreAndLevel123Caches.png



4CoreAndLevel3CacheDie.jpg



LatenciesInMemoryHierarchy.png

(last slide taken from [www.cs.utexas.edu/users/mckinley/352/lectures/16.pdf http://www.cs.utexas.edu/users/mckinley/352/lectures/16.pdf])

  • Thursday
    • Discussion of A View of Parallel Processing from Berkeley. Prepare a 1- to 2-page summary of the paper in Latex. Hand-in the summary in class. No summaries will be accepted after class.
AViewFromBerkeleyWordle.png


    • Some topics taken from the paper:
      • Moore's Law:

MooresLawProcessorMemoryGap.gif

      • Barnes and Hut approach to N-Body problem


ManyCoreArchitecture.jpg

(Image taken from URL: http://www.altera.com/technology/system-design/articles/2012/multicore-many-core.html)

      • nanometers: where are we now?
Nm fabricationProcess.png


( Image taken from http://en.wikipedia.org/wiki/22_nanometer)

RingNetworkLinkingMultiCoreIntelArch.png
    • Short preparation for Maggie Lind's tour of the SCMA on Tuesday. Meeting place is entrance of SCMA.
      • What the project is about can be included in the field of Culturomics


Week 3
9/17

All the data structures of interest (concurrent non-blocking and blocking) can be found in the Oracle documentation. The information is a bit cryptic, but you need to get comfortable with it!

Week 4
9/24
  • Tuesday: Tentative Guest Lecture/Informal discussion with by Tim Draper
    • Some questions to start the conversation:
    • How has the cloud infrastructure changed entrepreneurship, if at all?
    • There is a whole ecosystem growing around the cloud services offered by Amazon and the other players: new companies offering services and using Amazon's AWS for example. What are some of the most interesting companies/ideas/technologies emerging that you have discovered or been involved with?
    • There is tremendous worries about the safety and privacy of data in the cloud. Is this an area of growth students should consider?
    • What other area of growth do you see that students should keep in their view-sight?
    • If a graduating major is interested in joining a start-up company, what are the signs she should be looking for before joining such a group?
    • Some students are interested in a management track, starting at a big company and climbing fast. What is your advice for best preparing for this type of career?
    • What is the most exciting development in your eyes happening now with cloud technology?
    • It has been said that the 21st century is the century of the entrepreneur. Do you see this as true?
    • Companies rise and fall. Microsoft was once the place where all our majors wanted to go. The most prestigious company for programmers. Now it's Google, and Facebook. Which company(ies) do you see as potential new meccas for programmers?
    • If somebody were to form a start-up with friends. Say 10 people. Who/What/Where? Who should the people be? What field should they be experts in? Where should the company locate?


    • Review of Homework 1 and its Solution.
      • Understand static variables
      • don't use global random generators!
      • /usr/bin/time multiplies time by the # of cores for threaded applications
      • be sure to understand if you need the same random seed or a different seed in your experiments
      • create a different user on your laptop with no extra applications loaded in the background (e.g. Skype): less stress on the O.S.
  • Thursday Mountain Day!


MountainDay.png

 

Week 5
10/1
  • Thursday (Grace Hopper Conference)
    • Newsletter #2 due today. Please include 1 news item about some form of image collage, representation of many images in some form, hopefully digital. Also, please use a Latex feature you haven't used in your first newsletter
Week 6
10/8
  • Tuesday
  • Thursday: 50-min Presentation by Rocco Piccinino in FH241 on using the library resources for research.

 

Week 7
10/15
  • Tuesday: Fall Break
  • Thursday
Week 8
10/22
  • Tuesday
  • Thursday

 

Week 9
10/29
  • Tuesday
  • Thursday
Week 10
11/5
  • Tuesday: Otelia Cromwell Day
  • Thursday

 

Week 11
11/12
  • Tuesday
  • Thursday
Week 12
11/19
  • Tuesday: Guest Lecture (DT @ INFOCOMP 2013)
  • Thursday: Tentative guest lecture: Nick Howe on CUDA and GPUs

 

Week 13
11/26
  • Tuesday
  • Thursday: Thanksgiving Break
Week 14
12/3
  • Tuesday
  • Thursday

 

Week 15
12/10
  • Tuesday: Last Day of Class



Links and Resources


On-Line Resources


Classics



Papers

This is a tentative and non exhaustive list of papers scheduled for reading this semester.

Introduction

Paper title

50

2

General/Parallelism

Paper title

MPI

Paper title
* Learning from the Success of MPI, by WIlliam D. Gropp, Argonne National Lab, 2002.

11

GPUs

Paper title

6

Virtualization

Paper title

5

Cloud

Paper title

1.5

  • A View of Cloud Computing, 2010, By Armbrust, Michael and Fox, Armando and Griffith, Rean and Joseph, Anthony D. and Katz, Randy and Konwinski, Andy and Lee, Gunho and Patterson, David and Rabkin, Ariel and Stoica, Ion and Zaharia, Matei.

9

13

5

2

Project-Related

Paper title

8














Retrieved from "http://dominiquethiebaut.com/dftwiki3/index.php?title=CSC352_Class_Page_2013&oldid=18001"