apache官方文档---hadoopstreaming

《apache官方文档---hadoopstreaming》由会员上传分享，免费在线阅读，更多相关内容在行业资料-天天文库。

1、HadoopStreamingContent-Typetext/html;utf-8Tableofcontents1HadoopStreaming..............................................................................................................32HowDoesStreamingWork.......................................................................

2、.......................33PackageFilesWithJobSubmissions.................................................................................44StreamingOptionsandUsage...........................................................................................44.1Mapper-OnlyJobs....

3、....................................................................................................44.2SpecifyingOtherPluginsforJobs................................................................................44.3LargefilesandarchivesinHadoopStreaming.....................

4、........................................54.4SpecifyingAdditionalConfigurationVariablesforJobs.............................................64.5OtherSupportedOptions..............................................................................................75Moreusageexamples

5、........................................................................................................85.1CustomizingtheWaytoSplitLinesintoKey/ValuePairs..........................................85.2AUsefulPartitionerClass(secondarysort,the-partitionerorg.apache.hadoop.mapr

6、ed.lib.KeyFieldBasedPartitioneroption)........................................95.3WorkingwiththeHadoopAggregatePackage(the-reduceaggregateoption).........105.4FieldSelection(similartounix'cut'command)........................................................116FrequentlyAskedQu

7、estions...........................................................................................116.1HowdoIuseHadoopStreamingtorunanarbitrarysetof(semi-)independenttasks?........................................................................................................

8、......................................126.2HowdoIprocessfiles,oneper