资源描述:
《weil-crush-sc06》由会员上传分享,免费在线阅读,更多相关内容在学术论文-天天文库。
1、CRUSH:Controlled,Scalable,DecentralizedPlacementofReplicatedDataSageA.WeilScottA.BrandtEthanL.MillerCarlosMaltzahnStorageSystemsResearchCenterUniversityofCalifornia,SantaCruz{sage,scott,elm,carlosm}@cs.ucsc.eduAbstractmentaltaskofdistributingdataamongthousandsofsto
2、ragedevices—typicallywithvaryingcapacitiesandperformanceEmerginglarge-scaledistributedstoragesystemsarefacedcharacteristics—remains.withthetaskofdistributingpetabytesofdataamongtensMostsystemssimplywritenewdatatounderutilizedde-orhundredsofthousandsofstoragedevices
3、.Suchsystemsvices.Thefundamentalproblemwiththisapproachisthatmustevenlydistributedataandworkloadtoefficientlyuti-dataisrarely,ifever,movedonceitiswritten.Evenaper-lizeavailableresourcesandmaximizesystemperformance,fectdistributionwillbecomeimbalancedwhenthestoragewh
4、ilefacilitatingsystemgrowthandmanaginghardwaresystemisexpanded,becausenewdiskseithersitemptyorfailures.WehavedevelopedCRUSH,ascalablepseudo-containonlynewdata.Eitheroldornewdisksmaybebusy,randomdatadistributionfunctiondesignedfordistributeddependingonthesystemworkl
5、oad,butonlytherarestofobject-basedstoragesystemsthatefficientlymapsdataob-conditionswillutilizebothequallytotakefulladvantageofjectstostoragedeviceswithoutrelyingonacentraldirec-availableresources.tory.Becauselargesystemsareinherentlydynamic,CRUSHArobustsolutionisto
6、distributealldatainasystemran-isdesignedtofacilitatetheadditionandremovalofstoragedomlyamongavailablestoragedevices.Thisleadstoaprob-whileminimizingunnecessarydatamovement.Thealgo-abilisticallybalanceddistributionanduniformlymixesoldrithmaccommodatesawidevarietyofd
7、atareplicationandandnewdatatogether.Whennewstorageisadded,arandomreliabilitymechanismsanddistributesdataintermsofuser-sampleofexistingdataismigratedontonewstoragedevicesdefinedpoliciesthatenforceseparationofreplicasacrosstorestorebalance.Thisapproachhasthecriticalad
8、vantagefailuredomains.that,onaverage,alldeviceswillbesimilarlyloaded,allow-ingthesystemtoperformwellunderanypotentialwork-1Introductionload[Santo