资源描述：
《Chukwa A large-scale monitoring system》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。
1、Chukwa:Alarge-scalemonitoringsystemJeromeBoulonAndyKonwinskiRunpingQijboulon@yahoo-inc.comandyk@cs.berkeley.edurunping@yahoo-inc.comYahoo!,incUCBerkeleyYahoo!,incArielRabkinEricYangMacYangasrabkin@cs.berkeley.edueyang@yahoo-inc.commacyang@yahoo-inc.comUCBerkeleyYahoo!,incYahoo!,incAbs
2、tractdata.Logsareperiodicallydeleted,unlessuserstaketheinitiativeinstoringthem.WedescribethedesignandinitialimplementationofWebelievethatoursituationistypical,andthatlo-Chukwa,adatacollectionsystemformonitoringandan-calstorageofloggingdataisacommonmodelforveryalyzinglargedistributedsy
3、stems.Chukwaisbuiltonlargedeployments.TotheextentthatmoresophisticatedtopofHadoop,anopensourcedistributedfilesystemanddatamanagementtechniquesareutilized,theyarelargelyMapReduceimplementation,andinheritsHadoop’sscal-supportedbyad-hocproprietarysolutions.Awelldocu-abilityandrobustness.C
4、hukwaalsoincludesaflexiblementedopensourcetoolsetforhandlingmonitoringdataandpowerfultoolkitfordisplayingmonitoringandanal-thussolvesasignificantpracticalproblemandprovidesysisresults,inordertomakethebestuseofthiscollectedavaluablereferencepointforfuturedevelopmentinthisdata.area.Wedidn
5、otaimtosolvetheproblemofreal-timemon-1Introductionitoringforfailuredetection,whichsystemssuchasGan-gliaalreadydowell.Rather,wewantedasystemthatHadoopisadistributedfilesystemandMapReduce[1]wouldprocesslargevolumesofdatainatimescaleofimplementationthatisusedpervasivelyatYahoo!foraminutes
6、,notseconds,todetectmoresubtleconditions,varietyofcriticalbusinesspurposes.Productionclustersandtoaidinfailurediagnosis.Humanengineersandop-oftenincludethousandsofnodes.Largedistributedsys-eratorsdonotgenerallyreactonatimescaleofseconds,temssuchasHadooparefearsomelycomplex,andcanandso
7、aprocessingdelayofafewminutesisnotacon-failincomplicatedandsubtleways.Asaresult,Hadoopcernforus.isextensivelyinstrumented.Atwo-thousandnodeclus-Weareintheprocessofbuildingasystem,whichweterconfiguredfornormaloperationgeneratesnearlyhalfcallChukwa,todemonstratethatpracticallarge-scaleca
8、nbere
