Difference between revisions of "CSC352 Class Page 2017"
(→ ) |
(→ ) |
||
(46 intermediate revisions by the same user not shown) | |||
Line 370: | Line 370: | ||
'''SPRING BREAK''' | '''SPRING BREAK''' | ||
<br /> | <br /> | ||
− | [[Image:CalvinDancing.gif | center]] | + | <!-- [[Image:CalvinDancing.gif | center]] --> |
|} | |} | ||
<!-- ============================================================= --> | <!-- ============================================================= --> | ||
Line 433: | Line 433: | ||
::* [[Media:CSC352_Week9_MPI.pdf | Slides (pdf)]] | ::* [[Media:CSC352_Week9_MPI.pdf | Slides (pdf)]] | ||
* '''Thursday''' | * '''Thursday''' | ||
+ | ::* MPI, Continued | ||
+ | ::* [[Media:CSC352_Week9_MPI.pdf | Slides (pdf)]] | ||
::* [[Tutorial:_Create_an_MPI_Cluster_on_the_Amazon_Elastic_Cloud_(EC2)| MPI on AWS, Part 1 (Hello World!)]] | ::* [[Tutorial:_Create_an_MPI_Cluster_on_the_Amazon_Elastic_Cloud_(EC2)| MPI on AWS, Part 1 (Hello World!)]] | ||
− | |||
::* <font color="magenta">Paper Presentations: MapReduce (Sam) and (Nobody got fired + Beyond Hadoop) (Grace)</font> | ::* <font color="magenta">Paper Presentations: MapReduce (Sam) and (Nobody got fired + Beyond Hadoop) (Grace)</font> | ||
::* <font color="red">Newsletter due</font> | ::* <font color="red">Newsletter due</font> | ||
Line 456: | Line 457: | ||
{| class="mw-collapsible " style="width:100%" border="1" | {| class="mw-collapsible " style="width:100%" border="1" | ||
|- style="background:#dddddd;" | |- style="background:#dddddd;" | ||
− | |width="60%"| '''Topics''': | + | |width="60%"| '''Topics''': MPI, AWS |
|width="15%"| '''Lab/Hw''' | |width="15%"| '''Lab/Hw''' | ||
|width="25%"| '''Reading''' | |width="25%"| '''Reading''' | ||
Line 462: | Line 463: | ||
| | | | ||
* '''Tuesday''' | * '''Tuesday''' | ||
− | ::* | + | ::* More MPI functions |
+ | ::* [[Tutorial:_Create_an_MPI_Cluster_on_the_Amazon_Elastic_Cloud_(EC2)| MPI on AWS, Part 1 (Hello World!)]] | ||
+ | ::* [[Computing_Pi_on_an_AWS_MPI-Cluster | MPI on AWS, Part 2 (Computing Pi)]] | ||
+ | ::* [[media:CSC352_Slides_Week10MPIAWS_2017.pdf| slides (pdf)]] | ||
* '''Thursday''' | * '''Thursday''' | ||
::* <font color="magenta">Paper Presentations: Spark (Youyou), and Microsoft Bet Future (Isaiah & Muriel)</font> | ::* <font color="magenta">Paper Presentations: Spark (Youyou), and Microsoft Bet Future (Isaiah & Muriel)</font> | ||
| | | | ||
− | * | + | * [[CSC352 Homework 3 2017| Homework 3]] |
| | | | ||
* | * | ||
Line 490: | Line 494: | ||
| | | | ||
* '''Tuesday''' | * '''Tuesday''' | ||
− | ::* | + | ::* Finish [[Computing_Pi_on_an_AWS_MPI-Cluster | tutorial on MPI on AWS (Computing Pi)]] |
+ | ::* Map-Reduce | ||
+ | :::* Introduction to Functional Programming | ||
+ | :::* Implementing Map-Reduce in Python | ||
* '''Thursday''' | * '''Thursday''' | ||
− | ::* | + | ::* Class cancelled |
− | |||
| | | | ||
Line 501: | Line 507: | ||
|} | |} | ||
<br /> | <br /> | ||
+ | |||
==== ==== | ==== ==== | ||
---- | ---- | ||
Line 517: | Line 524: | ||
|-valign="top" | |-valign="top" | ||
| | | | ||
− | * '''Tuesday''' | + | * '''Tuesday/Thursday''' |
− | * ' | + | ::* <font color="magenta">Paper Presentations: Wikipedia dumps (Angie), and Can Cloud Reach Top500 (Vega)</font> |
− | ::* | + | ::* Map-Reduce |
+ | :::* Implementing Map-Reduce in Python: various problems solved with Map-Reduce | ||
+ | ::::* [[Map-Reduce_Examples| Example page]] | ||
+ | ::::* [[CSC352_Game_of_Life_in_Map-Reduce| Solving Conway's Game of Life with Map-Reduce]] | ||
+ | |||
+ | ::* [[Media:CSC352_Week12_MapReduce.pdf | Map-Reduce slides (pdf)]] | ||
+ | |||
| | | | ||
* | * | ||
Line 544: | Line 557: | ||
| | | | ||
* '''Tuesday''' | * '''Tuesday''' | ||
− | ::* | + | ::* Labs |
+ | :::* [[Tutorial:_Creating_a_Hadoop_Cluster_on_Amazon_AWS | Lab 1: Hadoop on AWS]] | ||
+ | :::* [[Hadoop_Tutorial_2.3_--_Running_WordCount_in_Python_on_AWS | Lab 2:Hadoop on AWS: streaming Python]] | ||
+ | :::* [[Hadoop_Tutorial_1.1_--_Generating_Task_Timelines | Lab 3: Creating Task Graphs]] | ||
+ | |||
* '''Thursday''' | * '''Thursday''' | ||
− | ::* Project Presentations | + | ::* Project Presentations: |
+ | :::* Isaiah | ||
| | | | ||
− | * | + | * [[CSC352 Homework 4 2017| Homework 4, Game of Life using Map-Reduce on AWS]] |
| | | | ||
* | * | ||
Line 571: | Line 589: | ||
| | | | ||
* '''Tuesday''' | * '''Tuesday''' | ||
− | ::* Project Presentations ( | + | ::* Project Presentations: |
+ | :::* Grace (lunch time) | ||
+ | :::* Kathleen | ||
+ | :::* Riley | ||
* '''Thursday''' | * '''Thursday''' | ||
− | ::* Project Presentations ( | + | ::* Project Presentations: |
+ | :::* Sam & Angie (lunch time) | ||
+ | :::* Lujun & Vega | ||
+ | :::* Youyou and Zainab | ||
| | | | ||
* | * | ||
Line 595: | Line 619: | ||
| | | | ||
* '''Friday, May 12, 4:00 p.m.''': pdf of project due on Moodle. | * '''Friday, May 12, 4:00 p.m.''': pdf of project due on Moodle. | ||
+ | * '''Friday, May 12, 4:00 p.m.''': Hadoop Game of Life due. | ||
|} | |} | ||
+ | <br /> | ||
+ | |||
+ | =Links & Resources= | ||
+ | <br /> | ||
+ | ==Map-Reduce== | ||
+ | <br /> | ||
+ | * [https://www.tutorialspoint.com/hadoop/hadoop_mapreduce.htm Map-Reduce Tutorial from tutorialpoint.com] | ||
+ | * [https://www.slideshare.net/andreaiacono/mapreduce-34478449 Good slides on Slide-Share by Andrea Jacono] | ||
<br /> | <br /> | ||
Latest revision as of 12:50, 25 April 2017
--D. Thiebaut (talk) 10:37, 2 December 2016 (EST)
Topics to be covered: | Week (approx) |
|
Week 1 |
|
Week 2 |
|
Week 3 |
|
Week 4 |
|
Week 6 |
|
Week 8 |
|
Week 10 |
|
Week 12 |
|
Week 13 |
Week 1 Jan 26, 27 |
Topics: | Lab/Hw | Reading |
|
|
|
Week 2 Jan 31, Feb 2 |
Topics: | Lab/Hw | Reading |
|
|
|
Week 3 Feb 7, 9 |
Topics: | Lab/Hw | Reading |
|
|
|
Week 4 Feb 14, 16 |
Topics: | Lab/Hw | Reading |
|
|
Two papers to read for Thrusday. In class discussion. |
Week 5 Feb 21 |
Topics: | Lab/Hw | Reading |
|
Week 6 Feb 28, Mar 2 |
Topics: | Lab/Hw | Reading |
|
|
|
Week 7 Mar 7, 9 |
Topics: | Lab/Hw | Reading |
|
|
|
SPRING BREAK
|
Week 8 Mar 21, 23 |
Topics: | Lab/Hw | Reading |
|
|
|
Week 9 Mar 28, 30 |
Topics: | Lab/Hw | Reading |
|
|
|
Week 10 Apr 4, 6 |
Topics: MPI, AWS | Lab/Hw | Reading |
|
|
Week 11 Apr 11, 13 |
Topics: | Lab/Hw | Reading |
|
|
|
Week 12 Apr 18, 20 |
Topics: | Lab/Hw | Reading |
|
|
|
Week 13 Apr 25, 27 |
Topics: | Lab/Hw | Reading |
|
|
Week 14 May 2, 4 |
Topics: | Lab/Hw | Reading |
|
|
|
Exam Week May 9, 12 |
Final Exam Week |
|
Links & Resources
Map-Reduce
Final Project
- Go to the project page for information on the projects.
Links and Resources
Cloud Services
Cloud Services | |
---|---|
Name | Description |
Provides AMIs on AWS with GPUs attached. The AMIs are already loaded with tensorflow and python, as well as Jupyter for remote development of Python programs. They offer a 5-day free trial. | |
A whole cloud infrastructure similar to AWS, but (apparently) not running on AWS. Offers a cluster infrastructure with many packages preloaded, including Node.js, Rails, Redis, MongoDB, Cassandra, Docker, MediaWiki, Django, Drupal, Drone, LAMP, LEMP, Ruby, etc. Offers a $10 credit when first signing up. |
Latex
Here are some nice video tutorials on using Latex to write papers.
- Latex tutorial (video)
- How to write a thesis in Latex (video)
- Presentations with Beamer (video)
- TikZ examples (video), for drawing diagrams with lines, circles, ellipses, etc.
Smith Elements of Style
On-Line Resources
- Introduction to Parallel Processing, by Blaise Barney, Lawrence Livermore National Laboratory. A good read. Covers most of the important topics.
MPI
- Introduction to MPI, by Blaise Barney, Lawrence Livermore National Laboratory. Another short but excellent coverage of a topic in parallel processing, this time MPI.
- Launching and Amazon EC2 MPI Cluster
Hadoop
- Thiebaut's class notes
- How to create a simple hadoop cluster with VirtualBox
- StarCluster's Hadoop Plugin
Microprocessors
Papers
This is a tentative and non exhaustive list of papers scheduled for reading this semester.
Introduction
Paper | Pages |
---|---|
|
50 |
|
2 |
General/Parallelism
Paper | Pages |
---|---|
|
5 |
|
7 |
|
5 |
|
8 |
MPI
Paper | Pages |
---|---|
|
11 |
GPUs
Paper | Pages |
---|---|
6 |
Virtualization
Paper | Pages |
---|---|
5 |
Cloud
Paper | Pages |
---|---|
|
1.5 |
|
9 |
|
13 |
|
5 |
|
2 |
|
10 |
|
19 |
|
8 |
Ischia, Italy — May 18 - 20, 2009. |
4 |