oozie工作流框架使用指南x

《oozie工作流框架使用指南x》由会员上传分享，免费在线阅读，更多相关内容在教育资源-天天文库。

1、工作流框架使用指南2013年10月SystemInstallationJobDesignOozieOverviewWorkFlowDesignCoordinatorDesignReferenceContentsRequirementsClouderaManagerCDHOozieInstallConfigHueInstallConfig(2items)BasicOperationSystemInstallationActionOverviewAnexecution/computationtask(Map-Red

2、ucejob,Pigjob,ashellcommand).Itcanalsobereferredastaskor'actionnode'.JobDesignerJobDesignExampleFsActionMapReduceActionJobDesignOozieAworkflowschedulersystemtomanageApacheHadoopjobsWorkFlowWorkflowjobsareDirectedAcyclicalGraphs(DAGs)ofactionsCoordinatorCoord

3、inatorjobsarerecurrentworkflowjobstriggeredbytime(frequency)anddataavailabilty.IntegratedMRFSEmailShellSshHivePigSqoopDistcpJavaScalableReliableExtensibleOozieOverviewDoesnotsupportcirclesWorkflowNodesControlFlowNodesWorkflowActionNodesWorkFlowRecov

4、eryoozie.wf.rerun.failnodesoozie.wf.rerun.skip.nodesWorkFlowDesignWorkflowdefinitionscanbeparameterizedWhenworkflownodeisexecutedbyOoziealltheELsareresolvedintoconcretevaluesELexpressionscanbeusedintheconfigurationvaluesofactionanddecisionnodesWorkflowJobPro

5、perties(orParameters)ExpressionLanguageFunctionsParameterizationofWorkflowsExampleStartMapReduce1输出>500行MapReduce2End是Coordinatorexecuteworkflowjobs：RecurrentInterdependentCoordinatorBased：TimeintervalsDataavailabilityTimeintervalsand/ordataavailabilityCoord

6、inatorOverviewCoordinatorArchtechtureDatetime,FrequencyandTime-PeriodCoordinatorActionParameterizationofCoordinatorCoordinatorDesignCoordinatorDesign定期创建文件夹开始时间：结束时间：频率：每3分钟一次文件夹名字为标定时间格式化yyyy-MM-ddTHH-mmExampleOozieHomepageDocumentsHueHomepageTutorialsExpre

7、ssionLanguageTutorialsReference