CSC352 Homework 4

From dftwiki3
Revision as of 08:45, 10 April 2010 by Thiebaut (talk | contribs) (Created page with '<bluebox> This homework is due 4/20/10, at midnight. </bluebox> <br /> ==Problem #1== Below is the timeline of the WordCount program running on 4 xml files of 180 MB each on …')
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

This homework is due 4/20/10, at midnight.


Problem #1

Below is the timeline of the WordCount program running on 4 xml files of 180 MB each on a cluster of 6 single-core Linux servers. (data available here). The files are in the HDFS on our cluster, in wikipages/block.

TaskTimeline4 180MBFiles.png

Question
Explain the camel back of the time line, in particular the dip in the middle of the Map tasks.