Description

Besides catering to client requests, Job progress is calculated in every heartbeat to the RM so as to print the MR AM's progress. Today the map and reduce progresses are calculated by looking up of each task in a big map while we can simply make do with a scan and aggregate. With large number of tasks, this can make a difference.

Hadoop QA
added a comment - 21/Dec/11 01:25 -1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12508170/MAPREDUCE-3568-20111220.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 9 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1487//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1487//console
This message is automatically generated.

Hadoop QA
added a comment - 22/Dec/11 20:17 +1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12508419/MAPREDUCE-3568-20111222.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 15 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1495//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1495//console
This message is automatically generated.

Hadoop QA
added a comment - 27/Dec/11 18:45 +1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12508693/MAPREDUCE-3568-20111227.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 15 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1510//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1510//console
This message is automatically generated.