-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/42150/
-----------------------------------------------------------
(Updated Jan. 13, 2016, 11:36 a.m.)
Review request for Falcon.
Bugs: FALCON-1677
https://issues.apache.org/jira/browse/FALCON-1677
Repository: falcon-git
Description
-------
Currently, Falcon retries only on failure. We should extend support in case of timed-out instances
too. Earlier, since we were relying on post-processing to notify the instance status, this
was not possible. Now that Falcon relies on Oozie JMS notifications, we can support retries
for timed out instances too.
If a dataset is expected to get delayed for a long time, the user is currently forced to supply
a large timeout value. This is an overhead in terms of Oozie having to poll for that long.
If we introduce retries, the timeout can be a reasonable value with periodic/exponential back-off
retries.
Diffs (updated)
-----
addons/recipes/hdfs-replication/src/main/resources/hdfs-replication.properties 7ef4095
addons/recipes/hive-disaster-recovery/src/main/resources/hive-disaster-recovery-secure.properties
df4a8fd
addons/recipes/hive-disaster-recovery/src/main/resources/hive-disaster-recovery.properties
c2915fb
client/src/main/java/org/apache/falcon/recipe/RecipeToolOptions.java 0ece90b
client/src/main/java/org/apache/falcon/recipe/util/RecipeProcessBuilderUtils.java 9477bb4
client/src/main/resources/process-0.1.xsd 256a29f
common/src/main/java/org/apache/falcon/entity/EntityUtil.java f448d70
common/src/test/java/org/apache/falcon/entity/parser/ProcessEntityParserTest.java da22d56
docs/src/site/twiki/EntitySpecification.twiki c4f5f76
falcon-regression/merlin/src/test/resources/HdfsRecipe/hive-disaster-recovery.properties
fb2a4fc
falcon-regression/merlin/src/test/resources/HiveDrRecipe/hive-disaster-recovery.properties
dd781a5
falcon-regression/merlin/src/test/resources/HiveDrSecureRecipe/hive-disaster-recovery-secure.properties
da0bcd1
rerun/src/main/java/org/apache/falcon/rerun/handler/RetryHandler.java 84cd93f
src/conf/runtime.properties f535b0f
webapp/src/test/resources/hdfs-replication.properties bd77a1c
Diff: https://reviews.apache.org/r/42150/diff/
Testing
-------
Done.
Thanks,
Narayan Periwal