CSC352 Class Page 2013

--D. Thiebaut (talk) 11:15, 9 August 2013 (EDT)

---

Main Page|Syllabus|Links & Resources | PIAZZA

Weekly Schedule

Week	Topics	Reading
Week 1 9/3	Tuesday Syllabus Introduction to final project Approach Programming Testing ==> paper (see 2011 paper for example). Parallelism: going to the source: Interrupts! 8086 type of interrupts (simplified) Interrupt Vector Interrupt Priority Context Switch Stack and Stack Frame Global and Local Variables What is a process? What is a thread? Thursday Goals of multithreading: Enhanced performance Increased throughput Greater user responsiveness What should we remember 5 years from now? Introduction to a graph we'll use all throughout the semester. The idea of threads Thread 1 ----------------------|====|-------------------------> time Thread 2 ------------|====|-----------------------------------> time Multithreaded programming. Computing Pi Mini Lab 1 Regroup and gather statistics on the different machines in the classroom Introduction to Latex Tutorial #1 on Latex and ShareLatex Latex document template Latex Example: Bib File: Example Bib File for Latex paper (from ACM) Learn how to find BibTex entries. Example: The Unreasonable Effectiveness of Data (go to ACM and click on BibTex link). If you are considering working on an honors thesis, you might want to take a look at this page on writing Honors thesis with Latex. Comments on bimonthly newsletter The format should be similar to the ACM Tech News format. The header should contain a title, your name, the class (CSC352) and the date Each paragraph should have a header with a title, the source of news, the date, and possibly a link to the full article. The paragraph describing a news item should be between 3 to 10 lines, give or take. Write 1 full page to 2 pages, depending on the richness of events in the technology field Feel free to present N-1 topics with just 3 lines, and 1 topic which you highlight with a longer paragraph. Topics: anything related to parallelism: computers, mobile platforms, cloud, companies, new software, new algorithms, conferences, people in the field, etc. Good sources of information to get started: the ACM Tech News Wired magazine The NYT Technology Bits MIT Technology Review The Official Google blog Review: Tom's Hardware Some of the sites listed in blorge.com's top-40 list. Recommendation for news aggregator: Feedly.com Homework: play with Latex. Find or adapt a document template for your needs (minimalist is the name of the game at this point), and start gathering news bits. First newsletter due Thursday Sept. 19th. The ACM Tech News format is a good and simple format to emulate.	Definition of a Process Definition of a Thread Coverage (with examples) of Processes and Threads, provided by Oracle Definition of an interrupt References on Latex The Latex Project A not-so-short Introduction to Latex (pdf) The TeX User Group WikiBooks guide to Latex Users Guide to Writing a Thesis in a Physics/Astronomy Institute of the University of Bonn
Week 2 9/10	Tuesday Introduction to measuring performance. Comparing execution times. Introduction to Speedup( N ), where N is the number of threads, or the number of processors. Amdahl's Law A bit of Computer Architecture: Cores and Caches (last slide taken from [www.cs.utexas.edu/users/mckinley/352/lectures/16.pdf http://www.cs.utexas.edu/users/mckinley/352/lectures/16.pdf]) Synchronizing Java Threads Using Bash to run a program multiple times Thursday Discussion of A View of Parallel Processing from Berkeley. Prepare a 1- to 2-page summary of the paper in Latex. Hand-in the summary in class. No summaries will be accepted after class. Some topics taken from the paper: Moore's Law: Processor-DRAM gap increasing (graph taken from www.cs.virginia) Barnes and Hut approach to N-Body problem Monte Carlo: see the current Homework #1 and Solution Example of Many-Core architecture: (Image taken from URL: http://www.altera.com/technology/system-design/articles/2012/multicore-many-core.html) nanometers: where are we now? ( Image taken from http://en.wikipedia.org/wiki/22_nanometer) Ring network connecting cores in Intel architecture (http://semiaccurate.com/2012/08/28/intel-details-knights-corner-architecture-at-long-last/) Short preparation for Maggie Lind's tour of the SCMA on Tuesday. Meeting place is entrance of SCMA. What the project is about can be included in the field of Culturomics Homework #1, due 9/19/13 and Solution	Java Synchronization methods
Week 3 9/17	Tuesday: Guided tour by Maggie Lind at the SCMA. Meeting in entrance of museum. Thursday: Newsletter #1 due today! Organization and Anatomy of the View from Berkeley paper. How to prepare a talk: An example: "The Butler Did It!" (and also this) Java synchronization, a presentation Producer-Consumer Lab Homework 2, will be due 9/28/13 at midnight	All the data structures of interest (concurrent non-blocking and blocking) can be found in the Oracle documentation. The information is a bit cryptic, but you need to get comfortable with it! BlockingQueue ConcurrentLinkedQueue
Week 4 9/24	Tuesday: Tentative Guest Lecture/Informal discussion with by Tim Draper Some questions to start the conversation: How has the cloud infrastructure changed entrepreneurship, if at all? There is a whole ecosystem growing around the cloud services offered by Amazon and the other players: new companies offering services and using Amazon's AWS for example. What are some of the most interesting companies/ideas/technologies emerging that you have discovered or been involved with? There is tremendous worries about the safety and privacy of data in the cloud. Is this an area of growth students should consider? What other area of growth do you see that students should keep in their view-sight? If a graduating major is interested in joining a start-up company, what are the signs she should be looking for before joining such a group? Some students are interested in a management track, starting at a big company and climbing fast. What is your advice for best preparing for this type of career? What is the most exciting development in your eyes happening now with cloud technology? It has been said that the 21st century is the century of the entrepreneur. Do you see this as true? Companies rise and fall. Microsoft was once the place where all our majors wanted to go. The most prestigious company for programmers. Now it's Google, and Facebook. Which company(ies) do you see as potential new meccas for programmers? If somebody were to form a start-up with friends. Say 10 people. Who/What/Where? Who should the people be? What field should they be experts in? Where should the company locate? Review of Homework 1 and its Solution. Understand static variables don't use global random generators! /usr/bin/time multiplies time by the # of cores for threaded applications be sure to understand if you need the same random seed or a different seed in your experiments create a different user on your laptop with no extra applications loaded in the background (e.g. Skype): less stress on the O.S. Thursday </br>
Week 5 10/1	Tuesday (Grace Hopper Conference) Introduction to Packing pdf and ppt Studying the Red-Black Tree data-structure Why is it not thread-safe? How can we make it thread-safe? Profiling Java applications (introduction to Java's GC). Thursday (Grace Hopper Conference) Newsletter #2 due today. Please include 1 news item about some form of image collage, representation of many images in some form, hopefully digital. Also, please use a Latex feature you haven't used in your first newsletter
Week 6 10/8	Tuesday Thursday: 50-min Presentation by Rocco Piccinino in FH241 on using the library resources for research.
Week 7 10/15	Tuesday: Fall Break Thursday
Week 8 10/22	Tuesday Thursday
Week 9 10/29	Tuesday Thursday
Week 10 11/5	Tuesday: Otelia Cromwell Day Thursday
Week 11 11/12	Tuesday Thursday
Week 12 11/19	Tuesday: Guest Lecture (DT @ INFOCOMP 2013) Thursday: Tentative guest lecture: Nick Howe on CUDA and GPUs
Week 13 11/26	Tuesday Thursday: Thanksgiving Break
Week 14 12/3	Tuesday Thursday
Week 15 12/10	Tuesday: Last Day of Class

Links and Resources

On-Line Resources

• Introduction to Parallel Processing, by Blaise Barney, Lawrence Livermore National Laboratory. A good read. Covers most of the important topics.
• Introduction to MPI, by Blaise Barney, Lawrence Livermore National Laboratory. Another short but excellent coverage of a topic in parallel processing, this time MPI.
• A 90-Minute Guide to Modern Microprocessors

Classics

• Designing and Building Parallel Programs, by Ian Foster. A relatively old reference (1995), with still good information.

Papers

This is a tentative and non exhaustive list of papers scheduled for reading this semester.

Introduction

• The Landscape of Parallel Computing Research: A View From Berkely, 2006, still good! (very long paper)
• Update on a view from Berkeley, 2010. (short paper)

General/Parallelism

• Parallel Computing with Patterns and Frameworks, 2010, XRDS.
• Understanding Throughput-Oriented Architectures, CACM, 2010.
• The Unreasonable Effectiveness of Data, by Halevy, Norvig, Pereira, IEEE Intelligent Systems, IEEE Intelligent Systems, March 2009, Vol. 24, No. 2, pp. 8-12.

MPI

• Learning from the Success of MPI, by WIlliam D. Gropp, Argonne National Lab, 2002.

GPUs

• General-Purpose vs. GPU: Comparisons of Many-Cores on Irregular Workloads, 2010

Virtualization

• Server Virtualization Architecture and Implementation, xrds, 2009.

Cloud

• The NIST Definition of Cloud Computing (Draft) (very short paper)
• A View of Cloud Computing, 2010, By Armbrust, Michael and Fox, Armando and Griffith, Rean and Joseph, Anthony D. and Katz, Randy and Konwinski, Andy and Lee, Gunho and Patterson, David and Rabkin, Ariel and Stoica, Ion and Zaharia, Matei.
• MapReduce: SImplified Data Processing on Large Clusters, by Dean and Ghemawat, First published in OSDI 2004, also in Commun. ACM 51, 1 (January 2008), 107-113.
• Nobody ever got fired for using Hadoop on a cluster, Rowstron, Antony and Narayanan, Dushyanth and Donnelly, Austin and O'Shea, Greg and Douglas, Andrew
• Beyond Hadoop, Gregory Mone, CACM, 2013. (short paper).

Project-Related

• Processing Wikipedia Dumps: A Case-Study comparing the XGrid and MapReduce Approaches, D. Thiebaut, Yang Li, Diana Jaunzeikare, Alexandra Cheng, Ellysha Raelen Recto, Gillian Riggs, Xia Ting Zhao, Tonje Stolpestad, and Cam Le T Nguyen, in proceedings of 1st Int'l Conf. On Cloud Computing and Services Science (CLOSER 2011), Noordwijkerhout, NL, May 2011. (longer version)