Difference between revisions of "CSC352 Problem of the Day"

From dftwiki3
Jump to: navigation, search
(Homework #4, Problem #2)
(Homework #4, Problem #2)
Line 11: Line 11:
 
! Number of files
 
! Number of files
 
! Number of wiki pages
 
! Number of wiki pages
 +
! Number of categories
 
! Execution Time<br />(seconds)
 
! Execution Time<br />(seconds)
 
|-
 
|-
 
| 589
 
| 589
 
| 589
 
| 589
 +
| 832
 
| 388
 
| 388
 
|-
 
|-
 
| 1
 
| 1
 
| 117,617
 
| 117,617
 +
| 51,120
 
| 30.7
 
| 30.7
 
|-
 
|-
 
| Ratio=589/1
 
| Ratio=589/1
 
| Ratio=1/199
 
| Ratio=1/199
 +
| Ratio=1/61.4
 
| Ratio=12.6/1
 
| Ratio=12.6/1
 
|}
 
|}

Revision as of 21:56, 26 April 2010

Homework #4, Problem #2

  • Conditions:
    • Processing of wiki pages with Hadoop on 6-PC cluster
    • Same Mapper and same Reducer program to process two different input folders



Number of files Number of wiki pages Number of categories Execution Time
(seconds)
589 589 832 388
1 117,617 51,120 30.7
Ratio=589/1 Ratio=1/199 Ratio=1/61.4 Ratio=12.6/1



  • Discuss these results
  • Identify the parties responsible for this surprising difference