Difference between revisions of "CSC352 MapReduce/Hadoop Class Notes"

From dftwiki3
Jump to: navigation, search
Line 337: Line 337:
 
?
 
?
  
?
+
# of bytes read by map and reduce tasks
?
+
# bytes written by map and reduce tasks
 
?
 
?
 
?
 
?
  
?
+
# reduce tasks launched, including speculative tasks
?
+
# tasks that ran on node in same rack as input data
?
+
# map tasks launched, including speculative tasks
?
+
# map tasks that ran on same node as input data
  
10 unique words
+
# reduce key groups consumed by all reducers
10 words times number of files
+
# output records produced by combiners
number of files
+
# input records consumed by map tasks
?
+
# records produced by all the maps
?
+
# bytes produced by all the maps
60 bytes times number of files
+
# input bytes consumed by maps
10 unique words + 1
+
# records consumed by combiners
?
+
# output records produced by map tasks
number of different words
+
# records consumed by reduce tasks
 
</pre></code>
 
</pre></code>
 
|}
 
|}

Revision as of 15:47, 31 March 2010


This section is only visible to computers located at Smith College