CSC352 Class Page 2017

--D. Thiebaut (talk) 10:37, 2 December 2016 (EST)

---

Home | Syllabus | Schedule | Links & Resources

Topics to be covered:	Week (approx)
Syllabus Parallelism Interrupts Processes/Threads Latex	Week 1
Performance Speedup Amdhal's Law Java threads + Synchronization	Week 2
Java Thread-Safe Libraries Static Variables	Week 3
Introduction to C	Week 4 Week 5
MPI	Week 6 Week 7
AWS MySQL + MPI MPI Clusters on AWS	Week 8 Week 9
MapReduce Hadoop, Java Hadoop, Python Hadoop AWS	Week 10 Week 11
Apache Spark	Week 12
GPU	Week 13

 

---

Week 1 Jan 26, 27

Topics:	Lab/Hw	Reading
Thursday Syllabus papers Biweekly newsletters in Latex Parallelism: going to the source: Interrupts! 8086 type of interrupts (simplified) Interrupt Vector Interrupt Priority Slides (pdf)		Definition of a Process Definition of a Thread Coverage (with examples) of Processes and Threads, provided by Oracle Definition of an interrupt

 

---

Week 2 Jan 31, Feb 2

Topics:	Lab/Hw	Reading
Tuesday Pick a paper for presentation Newsletter Example newsletter The format should be similar to the ACM Tech News format. The header should contain a title, your name, the class (CSC352) and the date Each paragraph should have a header with a title, the source of news, the date, and possibly a link to the full article. The paragraph describing a news item should be between 3 to 10 lines, give or take. Write 1 full page to 2 pages, depending on the richness of events in the technology field Feel free to present N-1 topics with just 3 lines, and 1 topic which you highlight with a longer paragraph. Topics: anything related to parallelism: computers, mobile platforms, cloud, companies, new software, new algorithms, conferences, people in the field, etc. Good sources of information to get started: the ACM Tech News Wired magazine The NYT Technology Bits MIT Technology Review The Official Google blog Review: Tom's Hardware Some of the sites listed in this page's top 40 list. Recommendation for news aggregator: Feedly.com Introduction to Latex DT's tutorial #1 A page with a Latex skeleton for technical reports Example of Bibtex file Learn how to find BibTex entries. Example: The Unreasonable Effectiveness of Data (go to ACM and click on BibTex link). Interrupts (continued) Context Switch Stack and Stack Frame Global and Local Variables What is a process? What is a thread? Python programs illustrating threads and processes Lab (see slides) Multithreading in Java. See this page on Java threads, and the computation of Pi in Java Slides (pdf) Thursday Presenting Technical Papers, a Presentation Multiprocessing in Python: in-class lab on parallel computation of Pi using the Monte-Carlo approach. Multi-Processing Lujun's Lab solution program Slides (pdf)		References on Latex The Latex Project A not-so-short Introduction to Latex (pdf) The TeX User Group WikiBooks guide to Latex Users Guide to Writing a Thesis in a Physics/Astronomy Institute of the University of Bonn References on Processes and Threads Oracle's lesson on Concurrency, a very good source of information on processes and threads for the Java platform.

 

---

Week 3 Feb 7, 9

Topics:	Lab/Hw	Reading
Tuesday Using bash to measure execution time Synchronizing access to shared variables and data structures. DT's notes on Java Synchronization (contains programs seen in class) slides (pdf) Thursday Paper Presentation: Berkeley Newsletter due		Read Oracle's documentation on locks and synchronized methods, objects, and classes. Read Wikipedia's article on Compare-and-Swap

 

---

Week 4 Feb 14, 16

Topics:	Lab/Hw	Reading
Tuesday Discussion of View from Berkeley paper. Many concepts to revisit Moore's Law Amdahl's Law Multi-Core vs Many-Core Nanometers Multi-Core Performance as a fn of # of Processors Programming Lab: Making the Game of Life parallel Using Script Files to Measure Performance of Programs Slides (pdf) Thursday Rocco Piccinino: presentation on Library Resources. You can find a link to Rocco's presentation here Paper Presentations: Patterns + Framework (presented by Riley), and Throughput Oriented Architectures Game of Life?		Two papers to read for Thrusday. In class discussion. Parallel computing with Patterns and Frameworks Understanding Throughput-Oriented Architectures

 

---

Week 5 Feb 21

Topics:	Lab/Hw	Reading
Tuesday Game of Life Using blocking queues Using Bash to measure execution times Slides (pdf) Thursday: Rally Day Newsletter due on Moodle, at 1:00 p.m., just before Rally Day events. Requirements for newsletter: Add an image or figure to your newsletter. It could be a photo of you at the top, as the author, or a graph, or a logo. You pick the jpeg or png, and incorporate it in your newsletter.	Game of Life Homework	Java BlockingQueues Simple tutorial on BlockingQueues ArrayBlockingQueues

 

---

Week 6 Feb 28, Mar 2

Topics:	Lab/Hw	Reading
Tuesday Game of Life, revisited Deadlocks, starvation, and the Dining Philosophers problem Thread states Measuring performance: speedup, bash scripts, R graphs Performance measures Thursday Paper Presentation: Unreasonable, and Top500

 

---

Week 7 Mar 7, 9

Topics:	Lab/Hw	Reading
Tuesday Thursday Paper Presentation: Success of MPI, and General purpose vs GPU Newsletter due

SPRING BREAK

 

---

Week 8 Mar 21, 23

Topics:	Lab/Hw	Reading
Tuesday Thursday Paper Presentations: Virtualization, and View of Cloud

 

---

Week 9 Mar 28, 30

Topics:	Lab/Hw	Reading
Tuesday Thursday Paper Presentations: MapReduce and (Nobody got fired + Beyond Hadoop) Newsletter due

 

---

Week 10 Apr 4, 6

Topics:	Lab/Hw	Reading
Tuesday Thursday Paper Presentations: Spark and Microsoft Bet Future

 

---

Week 11 Apr 11, 13

Topics:	Lab/Hw	Reading
Tuesday Thursday Paper Presentations: Wikipedia dumps, and Cloud & Top500 Newsletter due

 

---

Week 12 Apr 18, 20

Topics:	Lab/Hw	Reading
Tuesday Thursday 3 Project Presentations (lunch period included)?

 

---

Week 13 Apr 25, 27

Topics:	Lab/Hw	Reading
Tuesday 3 Project Presentations (Lunch time included?) Thursday 3 Project Presentations (Lunch time included?)

 

---

Week 14 May 2, 4

Topics:	Lab/Hw	Reading
Tuesday 3 Project Presentations (Lunch time included?) Thursday 3 Project Presentations (Lunch time included?)

Projects

Go to the project page for information on the projects.

Links and Resources

Latex

Here are some nice video tutorials on using Latex to write papers.

• Latex tutorial (video)
• How to write a thesis in Latex (video)
• Presentations with Beamer (video)
• TikZ examples (video), for drawing diagrams with lines, circles, ellipses, etc.

Smith Elements of Style

• "Writing Papers" from the Smith College Jacobson Center for writing

On-Line Resources

• Introduction to Parallel Processing, by Blaise Barney, Lawrence Livermore National Laboratory. A good read. Covers most of the important topics.

MPI

• Introduction to MPI, by Blaise Barney, Lawrence Livermore National Laboratory. Another short but excellent coverage of a topic in parallel processing, this time MPI.

Hadoop

• Thiebaut's class notes

Microprocessors

• A 90-Minute Guide to Modern Microprocessors

Papers

This is a tentative and non exhaustive list of papers scheduled for reading this semester.

Introduction

Paper	Pages
The Landscape of Parallel Computing Research: A View From Berkely, 2006, still good! (very long paper)	50
Update on a view from Berkeley, 2010. (short paper)	2

General/Parallelism

Paper	Pages
Parallel Computing with Patterns and Frameworks, 2010, XRDS.	5
Understanding Throughput-Oriented Architectures, CACM, 2010.	7
The Unreasonable Effectiveness of Data, by Halevy, Norvig, Pereira, IEEE Intelligent Systems, IEEE Intelligent Systems, March 2009, Vol. 24, No. 2, pp. 8-12.	5
Top500 Versus Sustained Performance, by William Kramer, 21st International Conference On Parallel Architectures And Compilation Techniques (PACT12), 19–23 September 2012, Minneapolis, MN, US	8

MPI

Paper	Pages
Learning from the Success of MPI, by WIlliam D. Gropp, Argonne National Lab, 2002.	11

GPUs

Paper	Pages
General-Purpose vs. GPU: Comparisons of Many-Cores on Irregular Workloads, 2010	6

Virtualization

Paper	Pages
Server Virtualization Architecture and Implementation, xrds, 2009	5

Cloud

Paper	Pages
The NIST Definition of Cloud Computing (Draft) (very short paper)	1.5
A View of Cloud Computing, 2010, By Armbrust, Michael and Fox, Armando and Griffith, Rean and Joseph, Anthony D. and Katz, Randy and Konwinski, Andy and Lee, Gunho and Patterson, David and Rabkin, Ariel and Stoica, Ion and Zaharia, Matei.	9
MapReduce: SImplified Data Processing on Large Clusters, by Dean and Ghemawat, First published in OSDI 2004, also in Commun. ACM 51, 1 (January 2008), 107-113.	13
Nobody ever got fired for using Hadoop on a cluster, Rowstron, Antony and Narayanan, Dushyanth and Donnelly, Austin and O'Shea, Greg and Douglas, Andrew	5
Beyond Hadoop, Gregory Mone, CACM, 2013. (short paper).	2
Apache Spark: A Unified Engine for Big Data Processing, Zaharia Matei et al, CACM, Nov 2016, Vol. 59, No. 11. See also this page for video.	10
Metz Cade, Microsoft bets future chips reprogram fly, Wired Magazine, 9/25/16. (pdf) Comments on Microsoft bets future paper	19
Processing Wikipedia Dumps: A Case-Study comparing the XGrid and MapReduce Approaches, D. Thiebaut, Yang Li, Diana Jaunzeikare, Alexandra Cheng, Ellysha Raelen Recto, Gillian Riggs, Xia Ting Zhao, Tonje Stolpestad, and Cam Le T Nguyen, in proceedings of 1st Int'l Conf. On Cloud Computing and Services Science (CLOSER 2011), Noordwijkerhout, NL, May 2011. (longer version)	8
Can Cloud Computing Reach the Top500?, by Jeffrey Napper and Paolo Bientinesi, Proceeding of UCHPC-MAW '09 on UnConventional high performance computing workshop plus memory access workshop, Ischia, Italy — May 18 - 20, 2009.	4